Build software better, together

modelscope / ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

moe glm lora embedding liger peft kimi multimodal reranker sft megatron llm qwen deepseek grpo qwen3 qwen3-vl qwen3-omni jev

Updated Oct 20, 2026
Python

dataelement / bisheng

Star

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Updated Oct 20, 2026
Python

adongwanai / AgentGuide

Star

tutorial interview multi-agent job-hunting rag sft ai-agent llm langchain crewai graphrag grpo agenticrag

Updated Sep 15, 2026
MDX

MakazhanAlpamys / Soup

Star

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Updated Oct 20, 2026
Python

oumi-ai / oumi

Star

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

Updated Oct 20, 2026
Python

walkinglabs / hands-on-modern-rl

Star

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

agent tutorial reinforcement-learning pytorch rl reinforcement ppo sft dpo llm rlhf agentic agentic-ai grpo llm-alignment agentic-rl

Updated Oct 20, 2026
Python

AI-Hypercomputer / maxtext

Star

A simple, performant, and scalable Jax LLM!

gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek llama3 gemma2 gemma3 llama4

Updated Oct 20, 2026
Python

datawhalechina / diy-llm

Star

Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐，6 项渐进代码作业，掌握 LLM 全栈知识

nlp transformer rl cs336 gpu-programming sft datawhale scaling-laws llm grpo

Updated Oct 9, 2026
Jupyter Notebook

ssbuild / chatglm_finetuning

Star

chatglm 6b finetuning and alpaca finetuning

deep-learning pytorch freeze lora sft chatglm p-tuning-v2 adalora qlora ia3

Updated Mar 9, 2025
Python

InternScience / GraphGen

Star

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

qa knowledge-graph data-generation question-answering data-synthesis sft pretrain pretraining graphgen ai4science llm llm-training qwen xtuner llama-factory sft-data

Updated Aug 17, 2026
Python

AgileRL / AgileRL

Sponsor

Star

The complete post-training stack for LLMs, plus RL for any problem. SFT, DPO and multi-turn agentic RL, with evolutionary hyperparameter optimization built in.

training machine-learning reinforcement-learning deep-learning deep-reinforcement-learning distributed artificial-intelligence multi-agent hyperparameter-optimization agents preference hpo reasoning post-training sft rft llm agilerl open-weight

Updated Oct 20, 2026
Python

invergent-ai / surogate

Star

Train and serve LLMs at extreme speed and massive throughput.

deep-learning cuda llama nvidia-gpu fine-tuning sft llm llms generative-ai qwen

Updated Oct 20, 2026
C++

ScienceOne-AI / DeepSeek-671B-SFT-Guide

Star

An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。)

python moe sft llm deepseek-r1

Updated Mar 13, 2025
Python

baidu-baige / LoongForge

Star

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.