Operations & logistics
Operational records across procurement, logistics and scheduling, and the flows between sites and partners.
This page defines a category, not the evaluated scope of a release. See the release coverage for capabilities actually assessed. All categories
Systems and records
- Procurement and logistics records
- Sites, partners and the flows between them
- Scheduled reminders and notifications
What the tasks involve
- Find the operational records that answer a question and report them accurately
- Update an entity or a relationship between entities, such as a flow between two sites
- Set up a follow-up, such as a scheduled reminder, with the right details
Roles and handoffs
The acting role limits what the agent may change. Some tasks require a change another role must approve, so a correct outcome is a pending proposal rather than a saved edit.
What a correct outcome means
The intended records hold the required values after the task, follow-ups exist with the right details, and unrelated records are unchanged.
How it is checked
The checker reads the authoritative records after the run, compares them with the required end state and checks that nothing outside the task changed. Unranked diagnostics may also use a disclosed model judge to check the answer against expected facts.
What this category does not test
- Optimisation quality, such as the cheapest route or the best schedule
- Live logistics feeds or real partner systems
- Physical-world outcomes
Frequently asked questions
- What does the GeistBench Operations & logistics category test?
- Operational records across procurement, logistics and scheduling, and the flows between sites and partners.
- How are Operations & logistics tasks graded?
- The checker reads the authoritative records after the run, compares them with the required end state and checks that nothing outside the task changed. Unranked diagnostics may also use a disclosed model judge to check the answer against expected facts.
- What does the Operations & logistics category not test?
- Optimisation quality, such as the cheapest route or the best schedule. Live logistics feeds or real partner systems. Physical-world outcomes.
- Where are the Operations & logistics scores?
- Category scores are published per release on the GeistBench leaderboard, with 95% intervals. This page does not repeat them. A release may not include every category; then the category has no score in that release.