AI Observability & Evaluation
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
Evaluation and Tracking for LLM Experiments and AI Agents
本地监控 + AI 视觉 — LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.
React components for visualizing traces from AI agents
Stop AI agents from doing things you didn't ask for.
g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.
Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.
Onboard AI tools in one step, and catch the rest. Relay sets up Claude Desktop, Claude Code, and Codex to run through your LiteLLM AI Gateway with zero dev setup and routes shadow AI (Notion AI, Perplexity, …) there too.
A comprehensive solution for monitoring your AI models in production
A Python client to interact with Arize API
AI-powered online exam proctoring system that detects suspicious activities using computer vision. Tracks eye movements, face presence, multiple faces, and talking during exams with real-time alerts and dashboard.
Open-source platform for always-on AI agents: a software factory for Claude Code that takes your projects from tickets to merged pull requests, or an AI SRE that watches your systems.
Autonomous AI infrastructure monitoring using Hermes Agent. Cron-based research ingestion, cost forecasting, and headless systemd deployment.
Monitor how AI systems perceive and recommend your software across GPT, Claude, Gemini, and more.
Real-time monitoring dashboard for 47 AI services — uptime, latency, incidents, AIWatch Score reliability ranking.
Laravel AI Guard 🛡️💰🤖 - Control and optimize AI costs in Laravel AI SDK applications 🚀 Track OpenAI & LLM token usage 📊, estimate AI costs before execution
This repo is 🟢 UptimeRobot's single source of truth for ✨ AI native integrations.
Production-ready Retrieval Augmented Generation (RAG) system with hybrid retrieval, advanced evaluation metrics, and monitoring. Build enterprise LLM applications with reduced hallucinations, better context management, and comprehensive observability.
Free open-source monitoring dashboard for OpenClaw AI agents — token usage, session tracking, 7-day trends, multi-model support
To associate your repository with the ai-monitoring topic, visit your repo's landing page and select "manage topics."