From the eval suite, not a live run
A brief from two fixture feeds (eval case)
- Agent
research-brief@1.0.0- Outcome
- succeeded
- Ran
- 2026-10-27 17:17 UTC
- Took
- Not timed (fakes)
- Cost
- No charge (offline)
The agent's offline eval suite: its real program in an offline sandbox, with fixture feeds and a scripted model. Not a live run.
- evals/research-brief/cases.jsonl in the Slipstream repository
Input
{
"sources": [
{
"url": "https://news.example.com/feed.xml",
"name": "Harbor City News"
},
{
"url": "https://blog.example.org/atom.xml",
"name": "Field Notes"
}
],
"max_stories": 4
}Result
4 stories from 2 sources, 3 summarised in 4 points, each backed by a quote from its story; 3 points dropped for quotes the sources do not hold; 1 told in their own words.
City council approves the new harbor tram line (Harbor City News)
- The council approved a tram line between the harbor and the central station by nine votes to two. Quote: “voted 9 to 2 on Tuesday night to approve a tram line linking the harbor with the central station”
- Building is due to start next spring and take about three years. Quote: “Construction of the harbor tram line is expected to start next spring and take about three years”
Why the old pier is sinking (Field Notes)
- The old pier has sunk by almost 20 cm since a storm two winters ago. Quote: “the old pier has sunk by almost twenty centimetres since the storm two winters ago”
Measuring tides with a cheap pressure sensor (Field Notes)
- A cheap pressure sensor matched the official tide tables to within a few centimetres. Quote: “the readings matched the official tide tables to within a few centimetres”
brief.md
# Research brief
## [City council approves the new harbor tram line](https://news.example.com/articles/harbor-tram?utm_source=rss)
Harbor City News, 2099-10-14
- The council approved a tram line between the harbor and the central station by nine votes to two.
> "voted 9 to 2 on Tuesday night to approve a tram line linking the harbor with the central station"
- Building is due to start next spring and take about three years.
> "Construction of the harbor tram line is expected to start next spring and take about three years"
## [Why the old pier is sinking](https://www.othersite.net/pier-sinking)
Field Notes, 2099-10-12
- The old pier has sunk by almost 20 cm since a storm two winters ago.
> "the old pier has sunk by almost twenty centimetres since the storm two winters ago"
## [Measuring tides with a cheap pressure sensor](https://blog.example.org/posts/tide-sensor)
Field Notes, 2099-10-13
- A cheap pressure sensor matched the official tide tables to within a few centimetres.
> "the readings matched the official tide tables to within a few centimetres"
## [Ferry timetable changes for winter](https://news.example.com/articles/ferry-winter)
Harbor City News, 2099-10-10
> "Winter sailings between the harbor and Gull Island will begin on the first Monday of December, with two fewer crossings each day."
> "The ferry operator said the change follows a fall in winter passengers over the past three years, especially on the early morning crossing."
Checks: 3 of 5 passed
- Passed: fetch news.example.com: 6 items in the feed, 5 kept.
- Passed: fetch blog.example.org: 5 items in the feed, 4 kept.
- Did not pass: articles: 5 read, 2 failed, 2 on hosts not allowed, 0 not tried.
- Did not pass: quotes: 3 points dropped: no quote of it is in the story's text, or it carried a link or an address.
- Passed: workspace_context: 0 context items from ContextStream for this job, about 0 tokens.
- 1 more stories are left out here.
Provenance
- Eval case
evals/research-brief/cases.jsonl, brief-two-feeds- Depot run
0zb9r381xr