Real-Time "Community Notes" for YouTube Shorts & TikToks
Text fact-checking is a solved problem. Video is the final frontier.
VidScrutiny acts as an automated, real-time "Community Notes" overlay for short-form video content. It digests video streams in seconds, transcribes the spoken audio, cross-references claims with the live internet, and projects beautiful, broadcast-quality fact-check overlays directly onto the video exactly when the claims are spoken.
- ⚡ Zero-Latency Feel: Combines Whisper-v3 and Llama-3.3-70b on specialized Groq hardware to process entire Shorts/Reels in seconds.
- 🌐 Live Web Search (RAG): AI hallucinations are neutralized. The system actively queries DuckDuckGo behind the scenes to find real, live URLs to back up or debunk every claim.
- 🇮🇳 Multilingual AI: Natively supports translating English videos into Hindi fact-checks (and vice-versa) via a single UI toggle.
- 🚀 Real-Time WebSockets: No fake loading bars. The Python backend streams its exact processing state to the frontend via WebSockets.
- 💾 Smart SQLite Caching: Analyzed a viral video once? It's cached in the database. The next user who pastes that link gets the result instantly.
- Ingestion (
yt-dlp): Securely bypasses bot-blockers to extract raw.mp4and.m4astreams. - Transcription (Whisper API): Generates a highly accurate, timestamped transcript array.
- Contextual Search (DuckDuckGo): The LLM isolates the main topic and silently searches the internet for real-time context.
- Analysis (Llama 3): Rates each claim as
True,False, orContextand formats it into strict JSON. - Presentation (HTML5/Tailwind): A custom video player triggers sleek, Fitts's Law-compliant UI cards to slide in exactly when the speaker makes the claim.
The absolute best way to run VidScrutiny is via Docker, as it automatically handles complex ffmpeg dependencies required for video manipulation.
- Docker Desktop
- A free Groq API Key
- Clone the repository to your machine.
- Create a
.envfile inside thebackend/directory:GROQ_API_KEY=gsk_your_groq_api_key_here
- Boot the pipeline:
docker-compose up --build
- Open
http://localhost:8000in your browser.
Because this platform relies on WebSockets and FFmpeg, it uses an industry-standard split deployment:
- The Frontend (Vercel): The
frontend/directory is deployed as a lightning-fast static site on Vercel. - The Backend (Render): The
backend/directory andDockerfileare deployed as a persistent Web Service on Render to keep the WebSocket connections alive and execute the heavy video processing.