truthfulness

A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust, NeurIPS 2024 Track Datasets and Benchmarks)

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

Don't make LLMs honest. Make every factual claim auditable. — An LLM Claim Auditing Layer with T1-T7 truth gradients. 98.1% business effectiveness on LiarBench v0.2.

Code and data for evaluating whether AI assistants know when they do not know the answer

A toolbox for benchmarking Multimodal LLM Agents trustworthiness across truthfulness, controllability, safety and privacy dimensions through 34 interactive tasks

Unofficial implementation of Microsoft’s Claimify Paper: extracts specific, verifiable, decontextualized claims from LLM Q&A to be used for Hallucination, Groundedness, Relevancy and Truthfulness detection

[ACL 2026] Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency

Practical anti-trendslop and truthfulness rules for AI tools

A research project on competing notions of truth in large language models.

Google Chrome Extension to add LLM text reading in a browser

Improving LLM truthfulness via reporting confidence

MCP server forcing evidence-gated, honestly-tiered (FACT/INFERENCE/SPECULATION) claim reporting. Deterministic, no-LLM, MIT.

Example VerityIndex Reports on Media

Measuring the computational cost of deception in LLMs through logprob analysis

Adaptive, probe-controlled activation steering that cuts LLM hallucination rate by ~10pp (64.6%→58.5%) on TruthfulQA — steers only when a real-time risk probe flags danger, unlike fixed-strength ITI/CAA/TSV baselines reproduced here for comparison.

A modular benchmark suite for evaluating GenAI capabilities across answer accuracy, truthfulness, instruction following, reasoning, RAG, tool use, and agentic task completion.

Investigating honesty, deception and steering in large language models. Replicating and extending the MASK honesty benchmark on frontier models, working toward internal representation analysis and activation steering for honesty.

LMRI (the Gaslighting Index): does an LLM correct a falsehood planted in its own previous answer — and keep the correction under four rounds of social pressure? 46 models, 180 items, ~23k judged rounds. Dataset, harness, transcripts, leaderboards.