Litmus
Evals for humans
About Litmus
Litmus is building the most accurate framework for evaluating and benchmarking human capability, starting with software. AI will compound small differences in human capability into increasingly large differences in what people can accomplish, while making existing static benchmarks obsolete. Software is already there: AI can hill-climb any output-based evaluation, while the ability to direct it is becoming the defining advantage. Litmus applies the same approach we already use for model evals to humans – creating world-like environments, and inspecting trajectory instead of just output. Every knowledge industry will soon face the same problem. We build Litmus to tell you what humans are capable of. We're already helping build frontier technical teams at Mercor, Composio, Neo Scholars, and more.
Public traction evidence
Each signal links to the public source used for attribution.
- LinkedIn
Elena Zhao announced Litmus is headed to Y Combinator
Founder post says Elena Zhao and Shaivi Rau are building Litmus and headed to Y Combinator this summer.
- X
new york tech offices > https://t.co/kaPxySTgJK
new york tech offices > https://t.co/kaPxySTgJK
- X
sunday afternoon w/ @ycombinator token anxiety creeping in
sunday afternoon w/ @ycombinator token anxiety creeping in
- X
Litmus is live on @ycombinator! Engineering is changing.
Litmus is live on @ycombinator! Engineering is changing. We help you hire for the role it’s becoming. 🔗 https://t.co/qrS8JvJk5W
- X
I’m back in new york! if you’re hiring engineers, i’ll personally bring @levainbakery cookies to your office.
I’m back in new york! if you’re hiring engineers, i’ll personally bring @levainbakery cookies to your office. we’ll eat cookies, I’ll show you litmus, and soon your engineers will thank you for saving them hours of interviewing (+ me for the cookies) https://t.co/g5WjBGYUyF...
- X
if you’re interested, I’ve gotchu get fast tracked to @august__law’s first round with this link: https://t.co/iZJ21JbG8y
if you’re interested, I’ve gotchu get fast tracked to @august__law’s first round with this link: https://t.co/iZJ21JbG8y
- X
any offices in sf have 3 open desks that the @UseLitmus team could rent out for the summer? we have excellent snack game https://t.co/P2KnygP3ZG
any offices in sf have 3 open desks that the @UseLitmus team could rent out for the summer? we have excellent snack game https://t.co/P2KnygP3ZG
- X
github being down is the tech equivalent of a snow day
github being down is the tech equivalent of a snow day