gitaskhub

Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];

Stars · 41
Language · Python
Ask anything about this repo to start.

By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).