Confident AI
Confident AI is a YC Winter 2025 (W25) company. Based in San Francisco, CA, USA. Team of 7.
About Confident AI
Summary
Confident AI builds an evaluation and observability platform for teams shipping LLM-powered applications. Engineers, product managers, QA teams, and domain experts use it to benchmark model quality, monitor production behavior, red-team against adversarial inputs, and enforce AI governance standards across an organization. It replaces ad hoc, team-by-team quality checks with a shared evaluation layer built on DeepEval, the company's open-source LLM testing framework.
Go-to-market
Confident AI sells to B2B engineering and product teams at companies of all sizes, reaching developers through the widely adopted open-source DeepEval framework and converting them to the enterprise platform via a self-serve sign-up or a sales demo.
From the Y Combinator listing
Open-Source Unit Testing for LLM Applications
Confident AI allows companies of all sizes to benchmark, safeguard, and improve LLM applications, with best-in-class metrics and guardrails powered by DeepEval. Built by the creators of DeepEval (12.6k stars, >3m monthly downloads), Confident AI is able to offer battle-tested, open-source evaluation algorithms while providing the infrastructure needed for teams to stay confident their LLM systems.
Facts
- B2B / B2B -> Engineering, Product and Design
- San Francisco, CA, USA
- 7
- Active
- Early
Founders (2)
- Kritin Vongthongsri
Score every batch against your own thesis
GPAgent's sourcing agent reads every company in a batch, scores each one against your fund's thesis in a private workspace, and lines up the founders worth meeting before Demo Day. You decide who to contact. Your scores, notes, and pipeline never appear on these pages.
How Accelerator intelligence works