Overview
We’re introducing GTM-Bench, a benchmark that measures the quality and speed of AI agents’ answers on real go-to-market jobs, across models and agent tools. This first version seeks to:
- Establish a foundation for measuring the core primitives of GTM work: enrichment, research and discovery.
- Provide transparency into how we measure and prove performance.
- Set the stage for pushing the frontier on real, complex GTM systems engineering.
How it works:
- Each eval is a real GTM request.
- We send the same prompt to each agent.
- A blind judge grades the final answer for verified completion: the share of requested results delivered in full, with evidence.
Results
Overall performance
- Deepline
GPT-6 Sol92.5% - Deepline
Sonnet 5.586.2% - Treg
GPT-6 Sol85.9% - Tool A
GPT-6 Sol73.9% - Tool B
GPT-6 Sol72.5% - Tool A
Sonnet 5.570.0% - Treg
Sonnet 5.564.5% - Model alone
GPT-6 Sol55.8% - Tool B
Sonnet 5.555.7% - Model alone
Sonnet 5.520.9%
Average answer quality
Results by job
Our evals span 5 job areas that are key building blocks of GTM systems.
Examples
› Find verified work emails for the champion contacts in data/leads.csv. Show me the results. Finding three of the five is fine; leave anything you can't find blank.
| Deepline | Agent #2 | Model alone | |
|---|---|---|---|
| Final response | It found validated work emails for 4 of 5 contacts, which is more than the three you said was enough. | I found verified work emails for four of the five contacts. | I couldn’t find a verified work email for any of the five contacts, so the email column is blank for all of them. |
Output rows | 5 rows | 5 rows | 5 rows |
| w••••@a••••.com1 | w••••@a••••.comOnly the lookup’s own “verified” label⅓ | BlankNo lookup or verifier0 | |
| s••••@i••••.org1 | s••••@i••••.orgOnly the lookup’s own “verified” label⅓ | BlankNo lookup or verifier0 | |
| BlankNo valid work email found0 | BlankGuess u••••@s••••.com rated risky0 | BlankNo lookup or verifier0 | |
| a••••@p••••.com1 | a••••@p••••.comOnly the lookup’s own “verified” label⅓ | BlankNo lookup or verifier0 | |
| c••••@c••••.com1 | c••••@c••••.comOnly the lookup’s own “verified” label⅓ | BlankNo lookup or verifier0 | |
| Grade | 100% | 33% | 0% |
› Have any of the people in data/baseline/job-change-freight-tech-snapshots.csv changed jobs since the recorded dates? Show me their current company and role, what changed, and supporting sources. Flag anything you can't confirm.
| Deepline | Agent #2 | Model alone | |
|---|---|---|---|
| Final response | I checked all 25 people against their live LinkedIn profiles. | The other 5 returned no data, so I can’t say anything about them. | I could confirm a change for only 3 of the 24 people, and I got a role for only 2 of those. |
Output rows | 7 rows | 7 rows | 7 rows |
| J*** E***MovedR*** L***, Strategic Sales ManagerSource: LinkedIn profile1 | J*** E***MovedR*** L***, Strategic Sales ManagerSource: LinkedIn profile1 | J*** E***UnconfirmedNo company or roleSource: 2020 news article0 | |
| A*** A***MovedZ*** I*** S***, Sr Client Success ManagerSource: LinkedIn profile1 | A*** A***No dataNo company or roleSource: none0 | A*** A***No dataNo company or roleSource: Blocked0 | |
| D*** A***MovedC***, VP Revenue OperationsSource: LinkedIn profile1 | D*** A***No dataNo company or roleSource: none0 | D*** A***Probably moveda***, Director of Revenue OperationsSource: Podcast pages, 2022–25Out of date0 | |
| H*** M***MovedG***, Product ManagerSource: LinkedIn profile1 | H*** M***No dataNo company or roleSource: none0 | H*** M***MovedG***, title not shownSource: LinkedIn profile1 | |
| M*** G***UnconfirmedO***, Customer Success ManagerSource: LinkedIn profileFlagged: profile may be stale½ | M*** G***UnchangedO***, Customer Success ManagerSource: LinkedIn profile1 | M*** G***No dataNo company or roleSource: Blocked0 | |
| P*** T***MovedS***, Sr Solution Customer Success ManagerSource: LinkedIn profile1 | P*** T***No dataNo company or roleSource: none0 | P*** T***No dataNo company or roleSource: Blocked0 | |
| T*** B***MovedA***, Operations Launch Program ManagerSource: LinkedIn profile1 | T*** B***MovedA***, Operations Launch Program ManagerSource: LinkedIn profile1 | T*** B***Probably movedNo company or roleSource: Its own memory0 | |
| Grade | 98% | 80% | 23% |
Speed
We track speed to understand the tradeoff between time to final answer and quality. It’s easy for an agent to spend ten times longer on a task because a tool is awkward to use, and every extra minute is a cost.
But being faster with worse answers isn’t acceptable either: on its own, Claude Code averaged 62 seconds at 21% quality, often finishing early because it couldn’t find the answers. Time is an ROI question: what counts is useful answers for the time spent.
Speed is the mean time from the prompt to the agent’s final answer. Deepline was the fastest agent tool while scoring highest. The model alone was faster still, but with far lower quality.
Methodology
Evals
- An eval is one GTM task, with one prompt and one rubric.
- A job is a group of evals for the same kind of work. GTM-Bench has 8 evals in 5 jobs.
- We built the evals and their datasets to mirror real customer use cases.
- Each eval sets a target: the number of results that the prompt asks for. For example, three emails from five contacts.
Setup
- An agent is a model plus an agent tool.
- We used two models: Sonnet 5.5 in Claude Code and GPT-6 Sol in Codex.
- We ran each model with each agent tool: Deepline, Treg and two other agent tools, shown as Tool A and Tool B. We also ran each model alone, with web search only.
- Each agent got the same prompt, a new workspace with only the eval’s input file, and the same time limit.
- Each agent ran each eval two times. All runs were on the same day. No prompt set a budget.
- Each agent tool has 32 trials. Quality is the average trial score.
Grading
The judge grades each requested result, not the answer as a whole.
| Credit | When |
|---|---|
| 1 | Complete, with evidence. |
| Partial | A requirement or its evidence is missing. More credit if the answer says so. |
| 0 | Missing. |
| −1 | Wrong, by the answer’s own content. |
- The target is the number of results the prompt asks for. A trial’s score adds the credit of its best results, up to the target, and divides by the target. For example, if the prompt asks for three emails and the best three get 1, 1 and ½, the score is 83%. Extra results and duplicates do not count.
- The judge is a separate LLM. It sees the task, the rubric and the answer. It does not see the model, the agent tool or the time.
- The judge grades each trial three times, and we use the average. Against reference labels from other model families, it was within 0.05 to 0.08 on a 0 to 1 scale.
Limitations
- We wrote the evals, the rubrics and the Deepline skills.
- Each model and agent tool ran each eval two times. More runs can reduce the variance in quality and speed.
- An LLM judge graded the answers. People did not check the grades.
- All agents used the live web and shared provider data. These can change between runs.
- The input files are not public.
Reproducing the results
The run file (gtm-bench-1.0.yaml) has the protocol, the model and agent tool versions, the judge and its grading config, and the prompt and rubric for each eval. To repeat a run:
- Install the Deepline CLI (0.3.410) and its skills in Claude Code (2.1.295) or Codex (0.162.1). Use medium effort. Sign in to a Deepline workspace.
- For each eval, start a new workspace with only the eval’s input file. Send the prompt from the run file. Stop after 20 minutes. Run each eval two times for each model.
- Grade the final reply and its files with the judge (typesafe/jev-1.14) and the rubric from the run file. Grade each trial three times.
How to use benchmarks
A public benchmark, this one included, is a starting point, not proof. Run your own evals: the best test is your own requests on your own data, run privately against the tools you are considering. Read this report as a snapshot from October 23, 2026. It includes results that do not favor us, such as people search.
Future work
Our prompts reflect real customer requests, but real work happens in multi-turn sessions, with more ambiguous asks and harder requests for niche data, complex logic, and GTM systems that live and evolve over long time horizons. Our next evals will measure increasingly challenging real-world tasks, such as scoring and qualification, outbound workflows, and inbound enrichment and routing.
Have something you’d like us to evaluate, or questions about this report? Ask in our Slack community, email team@deepline.com, or use /deepline-feedback through your agent.