Benchmark
PeopleSearchBench: how Kretsia's candidate search scores
Kretsia scored 84.12 Overall, 16 to 19 points ahead of Lessie, Juicebox and Exa. On average, 13 of the 15 people it returned met the brief.
How does Kretsia score on PeopleSearchBench?
Kretsia scored 84.12 out of 100 Overall on PeopleSearchBench, the mean of three scoring runs on all 30 recruiting queries (standard deviation 1.15). That is 16 to 19 points ahead of the published scores for Lessie (68.23), Juicebox (65.73) and Exa (64.67), and 33.6 points ahead of Claude Code (50.50). On average, 13.3 of the 15 people Kretsia returned for each query met the brief. We ran it on 25 June 2026 with the benchmark's public, unmodified scoring harness.
Kretsia's numbers, run by run
We submitted 444 people for the 30 queries and had them scored three times with the unmodified benchmark harness. All figures are on a scale of 0 to 100, except the qualified count, which is out of 15.
| Metric | Run 1 | Run 2 | Run 3 | Mean | SD |
|---|---|---|---|---|---|
| Overall | 84.85 | 84.71 | 82.79 | 84.12 | 1.15 |
| Relevance Precision | 84.71 | 84.72 | 83.60 | 84.34 | 0.64 |
| Effective Coverage | 89.11 | 88.44 | 84.21 | 87.25 | 2.66 |
| Information Utility | 80.72 | 80.97 | 80.56 | 80.75 | 0.21 |
| Qualified per query (of 15) | 13.40 | 13.30 | 13.10 | 13.27 | n/a |
| Precision@10 | 90.37 | 89.74 | 87.67 | 89.26 | n/a |
Task completion was 30 of 30 queries in runs 1 and 2, and 29 of 30 in run 3. In each run, Overall is the mean of the three metrics; 84.12 is the mean of the three runs. Effective Coverage varied most between runs (SD 2.66), Information Utility least (SD 0.21).
PeopleSearchBench scores, side by side
Kretsia and four other platforms, ordered by Overall score. The last column says where each score comes from.
| Platform | Overall | Relevance Precision | Effective Coverage | Information Utility | Qualified per query (of 15) | Who produced the score |
|---|---|---|---|---|---|---|
| Kretsia | 84.12 | 84.34 | 87.25 | 80.75 | 13.27 | Kretsia, 25 June 2026. Mean of three scoring runs. |
| Lessie | 68.23 | 74.8 | 75.6 | 54.3 | 11.3 | Published in the PeopleSearchBench repository by LessieAI, which sells Lessie. |
| Juicebox | 65.73 | 66.1 | 75.3 | 55.8 | 11.3 | Published in the PeopleSearchBench repository. |
| Exa | 64.67 | 66.2 | 73.8 | 54.0 | 11.1 | Published in the PeopleSearchBench repository. |
| Claude Code | 50.50 | 59.0 | 46.7 | 45.8 | 7.0 | Published in the PeopleSearchBench repository. |
Kretsia is ahead of Lessie by about 16 points, Juicebox by about 18, Exa by about 19 and Claude Code by about 34. The other four scores are the ones LessieAI published in the benchmark repository at github.com/LessieAI/people-search-bench.
What PeopleSearchBench measures
PeopleSearchBench (PSB) is a public benchmark for people-search tools, published by LessieAI in the open repository github.com/LessieAI/people-search-bench. We ran its recruiting category: 30 natural-language queries written the way a recruiter would phrase them, in English, Dutch, Portuguese and Spanish. Examples are backend developers in London with microservices experience, secretaries in Dutch government bodies, and strength and conditioning coaches in Portugal.
Each platform returns up to 15 people per query. The benchmark then scores them with what it calls Criteria-Grounded Verification. An LLM judge (google/gemini-3-flash-preview) pulls verifiable criteria out of each query, then checks every returned person against web evidence from Tavily. Three metrics come out, each from 0 to 100, and Overall is their mean.
- Relevance Precision (84.34). Are the best matches at the top of the list? The benchmark calls it padded nDCG@10. For a recruiter it is the difference between the right person being first and being buried at number twelve.
- Effective Coverage (87.25). The share of returned people who qualified. At 87.25, about 87 in every 100 people we returned met the brief. Per query, that is 13.3 of 15.
- Information Utility (80.75). How complete and useful each record is. A result that gives you more to act on scores higher than a bare name with a job title.
Precision@10 is reported alongside. Ours was 89.26, which means roughly 9 of the first 10 people on each list qualified.
How we ran it
- Date. We ran the benchmark on 25 June 2026.
- All 30 queries. We submitted 444 people across the 30 queries, up to 15 per query.
- Three scoring runs. We scored the submission three times with the unmodified harness. Overall came out at 84.85, 84.71 and 82.79. We report all three and the standard deviation (1.15), not just the best run.
- Other platforms' scores. The scores for Lessie, Juicebox, Exa and Claude Code are the ones LessieAI published in the repository.
- Candidate records stay private. The 444 returned records contain personal data about real people, so we don't publish them. The queries and the scoring harness are public, so anyone can run the same 30 queries against any platform, including Kretsia, and score the results.
Where Kretsia scored best
Several queries scored a perfect 100 on nDCG@10, which means the ranking was ideal. Among the strongest were:
- Backend developers in London (rec_0001)
- Product managers in Seattle for developer tools (rec_0002)
- Product designers in Amsterdam (rec_0014)
- Full-stack developers in Austin (rec_0019)
- Product marketing managers in San Francisco (rec_0023)
- Senior frontend developers in Stockholm with React and TypeScript (rec_0027)
These are the briefs recruiters write every day: a clear role in a named place, with skills that people list on their own profiles and sites.
What this means if you hire
On the benchmark's 30 recruiting briefs, a Kretsia list averaged about 13 people who met the brief out of every 15, and roughly 9 of the first 10 qualified. You start from a shortlist that already fits, and you decide who to contact.
To see how it does on your own roles, read how Kretsia's candidate sourcing works, or run the same kind of query yourself in a free trial.
FAQ
Questions about the benchmark.
PeopleSearchBench (PSB) is a public benchmark for people-search tools, published by LessieAI in an open GitHub repository. Its recruiting category has 30 natural-language recruiter queries in English, Dutch, Portuguese and Spanish. Each platform returns up to 15 people per query, and an LLM judge checks every person against web evidence. Scores run from 0 to 100 on three metrics: Relevance Precision, Effective Coverage and Information Utility. Overall is their mean.
Kretsia scored 84.12 Overall in a run on 25 June 2026, the mean of three scoring runs (84.85, 84.71 and 82.79; standard deviation 1.15). The three metrics were Relevance Precision 84.34, Effective Coverage 87.25 and Information Utility 80.75. On average, 13.3 of the 15 people returned per query met the brief. That is 16 to 19 points ahead of the published Lessie, Juicebox and Exa scores, and about 34 ahead of Claude Code.
Yes. PeopleSearchBench, its 30 recruiting queries, the scoring harness and the judge model are public on GitHub, so anyone can run the same queries against any platform, including Kretsia, and score the results. We ran the unmodified harness three times and report every run, not just the best one.
Clear roles in named places, with skills people list publicly. Several queries scored a perfect 100 on nDCG@10, among them backend developers in London, product designers in Amsterdam and senior frontend developers in Stockholm with React and TypeScript.
Test it on
your own roles.
Describe a role in plain words and see who Kretsia returns, and why each person fits. Then check the shortlist yourself.