Here are 522 public repositories matching this topic...

hiyouga / LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Updated Mar 16, 2026
Python

huggingface / peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

python adapter transformers pytorch lora diffusion fine-tuning peft parameter-efficient-learning llm

Updated Mar 16, 2026
Python

modelscope / ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM-5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, Phi4, ...) (AAAI 2025).

Updated Mar 17, 2026
Python

yangjianxin1 / Firefly

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Updated Oct 24, 2024
Python

zyds / transformers-code

手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube

transformers peft huggingface

Updated Jul 15, 2024
Jupyter Notebook

mymusise / ChatGLM-Tuning

基于ChatGLM-6B + LoRA的Fintune方案

lora peft chatgpt chatglm

Updated Nov 25, 2023
Python

hiyouga / ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

transformers pytorch lora language-model alpaca fine-tuning peft huggingface chatgpt rlhf chatglm qlora chatglm2

Updated Oct 12, 2023
Python

ashishpatel26 / LLM-Finetuning

LLM Finetuning with peft

text-generation pytorch falcon llama lora fine-tuning peft huggingface llm llms llama2

Updated Aug 1, 2025
Jupyter Notebook

stochasticai / xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

adapter deep-learning llama lora quantization language-model mistral fine-tuning peft finetuning mixed-precision gpt-2 gpt-j llm generative-ai gen-ai

Updated Mar 4, 2026
Python

lxe / simple-llm-finetuner

Simple UI for LLM Model Finetuning

ai pytorch llama peft gpt-2 huggingface huggingface-transformers gpt-3 llm

Updated Dec 21, 2023
Jupyter Notebook

ModelCloud / GPTQModel

LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

transformers quantization optimum peft vllm gptq sglang

Updated Mar 17, 2026
Python

X-LANCE / SLAM-LLM

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

speech-processing audio-processing peft music-processing large-language-model multimodal-large-language-models

Updated Jan 15, 2026
Python

dvgodoy / FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

transformers pytorch lora fine-tuning peft finetuning huggingface hugging-face large-language-models llamacpp bitsandbytes finetuning-llms ollama peft-fine-tuning-llm

Updated Feb 28, 2026
Jupyter Notebook

ARahim3 / mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, and Vision fine-tuning — natively on MLX. Unsloth-compatible API.

macos machine-learning deep-learning metal transformers lora mlx peft huggingface on-device-ai apple-silicon large-language-models llm vision-language-model local-llm llm-training llm-finetuning unsloth mlx-framework

Updated Mar 14, 2026
Python

mindspore-lab / step_into_llm

MindSpore online courses: Step into LLM

Updated Dec 22, 2025
Jupyter Notebook

zetavg / LLaMA-LoRA-Tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

machine-learning ai llama gpt lora language-model alpaca peft google-colab gpt-j alpaca-lora

Updated May 29, 2023
Python

Guitaricet / relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

nlp deep-learning transformer llama distributed-training peft

Updated Apr 21, 2024
Jupyter Notebook

Joyce94 / LLM-RLHF-Tuning

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

reinforcement-learning llama lora language-model fine-tuning ppo peft llm rlhf

Updated Oct 11, 2023
Python

GraphPKU / PiSSA

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)

quantization fine-tuning peft

Updated Jun 30, 2025
Jupyter Notebook

TUDB-Labs / mLoRA

An Efficient "Factory" to Build Multiple LoRA Adapters

gpu llama lora finetune peft dpo baichuan llm rlhf chatglm llama2 mlora

Updated Feb 13, 2025
Python