Here are 48 public repositories matching this topic...

alibaba / OpenSandbox

OpenSandbox is a general-purpose sandbox platform for AI applications, offering multi-language SDKs, unified sandbox APIs, and Docker/Kubernetes runtimes for scenarios like Coding Agents, GUI Agents, Agent Evaluation, AI Code Execution, and RL Training.

kubernetes ai sandbox ai-infra ai-agent

Updated Mar 17, 2026
Python

HuaizhengZhang / AI-Infra-from-Zero-to-Hero

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

model-serving model-training mlsys ai-infra large-language-models genai llmsys

Updated Jul 25, 2025

SwanHubX / SwanLab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

visualization python training tracking data-science machine-learning deep-learning tensorflow logging transformers pytorch tensorboard model-versioning mlops ai-infra llm

Updated Mar 16, 2026
Python

thu-ml / TurboDiffusion

TurboDiffusion: 100–200× Acceleration for Video Diffusion Models

rcm distillation video-generation mlsystem diffusion-models inference-acceleration ai-infra consistency-model sageattention sparse-linear-attention

Updated Mar 6, 2026
Python

trustgraph-ai / trustgraph

The context backend for reliable AI.

Updated Mar 16, 2026
Python

thu-ml / SpargeAttn

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

attention vit quantization video-generation mlsys inference-acceleration ai-infra vision-transformer sparse-attention llm sageattention

Updated Feb 25, 2026
Cuda

ForceInjection / AI-fundermentals

AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识

cuda ai-infra ai-agent

Updated Mar 16, 2026
HTML

CurvineIO / curvine

High-performance distributed multi-tier cache system. Built in Rust.

rust ai s3 fluid high-performance-computing cloud-native model-deployment model-training lance inference-acceleration ai-infra opendal lancedb

Updated Mar 17, 2026
Rust

jinbooooom / ai-infra-hpc

hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等

ai deep-learning hpc ai-infra llm

Updated Mar 13, 2026
Cuda

thu-ml / SLA

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

transformer video-generation mlsys inference-acceleration ai-infra linear-attention sparse-attention diffusion-transformer train-acceleration sparse-linear-attention

Updated Feb 24, 2026
Python

jinbooooom / OriginDL

Implement a Pytorch-like DL library in C++ from scratch, step by step

cuda pytorch yolo deeplearning ai-framework ai-infra

Updated Mar 13, 2026
C++

raptor-ml / raptor

Transform your pythonic research to an artifact that engineers can deploy easily.

kubernetes data-science machine-learning production ml data-engineering feature-extraction dataops feature-engineering raptor model-deployment kubeflow mlops ai-infra featurestore raptor-ml feature-platform reactive-ml

Updated Jan 31, 2026
Go

tensorchord / ai-infra-landscape

This is a landscape of the infrastructure that powers the generative AI ecosystem

awesome ai-infra generative-ai llmops genai

Updated Oct 16, 2024
HTML

kleveross / klever

Cloud Native ML/DL Platform

kubernetes machine-learning deep-learning cloud-native model-management kubeflow ai-infra

Updated Sep 9, 2020

lumia431 / photon_infer

A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

modern-cpp inference-engine ai-infra vllm llm-inference paged-attention continuous-batching

Updated Jan 2, 2026
C++

toyaix / triton-runner

Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.

tools triton ai-infra

Updated Mar 12, 2026
Python

agent-sandbox / agent-sandbox

Agent Sandbox is an E2B compatible, enterprise-grade ai-first, cloud-native runtime environment for AI Agents. Allows Agents to securely run untrusted LLM-generated Code, Browser use, Computer use, and Shell commands etc. with stateful, long-running, multi-session and multi-tenant.

agent mcp sandbox container code-executor ai-infra agent-sandbox computer-use browser-use ai-sandbox

Updated Mar 12, 2026
Go

toyaix / TritonLLM

LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model

triton infer ai-infra llm

Updated Mar 16, 2026
Python

usemoss / moss

Official Repo of Moss

real-time retrieval semantic-search ai-agents rag voice-ai ai-infra hybrid-search

Updated Mar 17, 2026
TypeScript

GradientHQ / lattica

💥 Make peer-2-peer global works

rust networking peer-to-peer decentralized ai-infra

Updated Jan 29, 2026
Rust