Here are 52 public repositories matching this topic...

mlflow / mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

open-source machine-learning ai apache-spark evaluation ml openai agents observability model-management mlops mlflow agentops prompt-engineering ai-governance langchain llmops llm-evaluation

Updated Mar 17, 2026
Python

AgentOps-AI / agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

agent ai openai evaluation-metrics mistral cost-estimation autogen groq agentops llm langchain anthropic evals ollama crewai agents-sdk openai-agents

Updated Oct 30, 2025
Python

coze-dev / coze-loop

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

agent open-source playground ai monitoring evaluation openai observability agentops coze langchain llmops prompt-management llm-observability agent-evaluation eino agent-observability

Updated Mar 17, 2026
Go

zenml-io / zenml

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Updated Mar 16, 2026
Python

truera / trulens

Evaluation and Tracking for LLM Experiments and AI Agents

machine-learning neural-networks ai-agents explainable-ml agentops ai-monitoring ai-observability llms llmops llm-eval evals llm-evaluation agent-evaluation

Updated Mar 10, 2026
Python

e2b-dev / awesome-ai-sdks

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

agent awesome framework sdk tools ai openai awesome-list agents ai-agents vercel e2b agentops llm chatgpt langchain llmops llama-index

Updated Feb 26, 2025

papercomputeco / tapes

Transparent telemetry collector for agents

ai otel telemtry agentops

Updated Mar 16, 2026
Go

AgentOps-AI / Spellcaster

AI agent to automatically check grammar and spelling on documentation files

agent ai grammar spelling spelling-correction grammar-checker grammarly agentops

Updated Nov 24, 2025
Python

tonykipkemboi / youtube_yapper_trapper

CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.

ai youtube-api agents groq agentops ollama crewai aiagents

Updated Jun 10, 2024
Python

geniusrise / geniusrise

Geniusrise: Framework for building geniuses

cli ai agent-based-framework fine-tuning mlops agentops llmops llm-framework geniusrise

Updated Nov 16, 2025
Python

alexfazio / firecrawl-quickstarts

A collection of cookbooks to help developers get started quickly with the Firecrawl API.

scraping openai grok agentops anthropic firecrawl

Updated Feb 14, 2025
Jupyter Notebook

atef-ataya / Large-Language-Models-Tutorial

Learn AI, ML, and NLP with interactive Jupyter Notebook tutorials.

pinecone autogen gemini-api milvus summarization-algorithm openai-api agentops large-language-models llms claude-ai langchain-python claude-api openai-api-python langsmith langgraph

Updated Jul 19, 2025
Jupyter Notebook

The-Swarm-Corporation / Multi-Agent-Template-App

A radically simple, reliable, and high performance template to enable you to quickly get set up building multi-agent applications

testing models transformers multi-agent swarms agents autogen huggingface agent-framework transformers-models agentops llms langchain agentic crewai

Updated Dec 8, 2025
Shell

rokbenko / crew-news

CrewNews is an AI news generator that delivers an unbiased version of the news for a given topic, using Streamlit for the GUI, Llama 3.1 as the LLM (inferenced via the AIML API), CrewAI for building AI agents, AgentOps for testing AI agents, and Exa & Firecrawl as tools

aiml exa streamlit agentops crewai firecrawl llama-3-1 crewai-tools

Updated Nov 30, 2024
Python

slaveOftime / open-relay

`oly` turns long-running and interactive CLI workflows into persistent, supervised sessions for humans and AI agents. Close the terminal, keep the process alive, get notified when input is needed, and jump back in from anywhere.

rust cli opencode pty session-management copilot ai-agents agentops gemini-cli claude-code codex-cli

Updated Mar 17, 2026
Rust

khulnasoft / gpt-computer-agent

GPT4 for windows, macos and ubuntu

ai ubuntu openai agent-based-model assistent agentops gpt-4 gpt4 chatgpt langchain

Updated Nov 21, 2025
Python

Dharm3438 / Healthcare-Assistant

This smart assistant uses advanced Multi-Agent AI systems, leveraging over 10+ agents working asynchronously to perform 20+ tasks. From disease research to personalized diet and exercise plans, as well as doctor consultations and patient journeys, it brings all essential healthcare services into a single platform.

youtube openai duckduckgo-search agentops langchain crewai serperdev tavily-api

Updated Jan 11, 2025
Python

boshu2 / 12-factor-agentops

Operational patterns for AI agents and infrastructure from solo to enterprise scale. Applies DevOps + SRE principles to the intersection: infrastructure FOR AI + AI FOR infrastructure. Alpha framework extracting meta-patterns from mission critical environments.

kubernetes workflow devops openshift sre 12-factor ai-agents zero-trust gitops platform-engineering production-operations agentops context-engineering

Updated Feb 15, 2026
Python

24-mohamedyehia / smart-procurement-agents

This is a smart procurement agents that can help you to find the best product for your company. and generate a report for you.

python agent flask ai flask-application agentops ai-tools llm openrouter crewai agentic-ai

Updated Jun 14, 2025
Python

najeed / ai-agent-eval-harness

The open-source MultiAgentOps evaluation harness for any industry scenario.

Updated Mar 16, 2026
HTML