Larry Summers
Hon. Ivan Duque Marquez
Dr. Yen Pottinger
Kevin McCarthy
Scott Jennings
Vuk Jeremic
Fareed Zakaria
Rich Goldberg
Kristen Soltis Anderson
Sebastian Kurz
Michael McFaul
Avik Roy
Elizabeth Economy
At Forum AI, we build systems to scale trusted expert judgement for AI evaluation, focused on the areas where expert insight matters most.
Our expert-guided process delivers precision data and AI models for news and complex topics.
Our systems scale expert judgment for repetitive tasks while engaging them directly for high-leverage work like defining success criteria.
Hands-on Human Evaluation Reports
We evaluate model performance end to end, delivering detailed, expert-backed reports and recommendations. Our expert-trained AI systems handle repetitive annotations at scale, while experts focus on high-impact work—reviewing results and shaping recommendations.
Benchmarks
Prompts sets and evaluation rubrics to support internal evaluation efforts, custom built with experts for your use cases.
Expert-trained LLM Judges
Access Forum AI’s judges via API, fine-tuned for your use cases, built for auto evals and reward modeling.
Training Data Annotation
We partner with your team and our experts to define an evaluation strategy, conduct a comprehensive evaluation of model performance, and then provide detailed reports with expert-backed recommendations for the team.
Retrieval Source Annotation
Forum AI integrates into the search & retrieval stack to label sources with nuanced details to improve LLM prioritization and interpretation of real-time sources.
Licensed Retrieval Packs
Licensed retrieval sources to ensure you have reliable, comprehensive coverage of news and evolving topics.
SFT Data Packs
Expert-designed packs of prompt-response pairs, targeted at addressing specific gaps or issues.
.avif)
.png)
.png)
.png)