GeistBench categories

Five categories of enterprise work

These five categories are the benchmark taxonomy, not a claim that all five have published results. Each release lists its actual categories and capability coverage. The overall score averages the included categories; a configuration missing an included category has no overall score.

What this release evaluates

Business categories group tasks. They do not establish which product capabilities were tested. Coverage below refers only to this release's published evidence.

Categories included in this release: Tool reliability.

CapabilityPublished evidenceWhat the evidence supports
Tool argument adherencePublished diagnostic onlyCoached checks with supplied arguments. These do not establish end-to-end workflow ability.
World Map writesNot reportedCapability-specific coverage is unavailable. Neither evaluation nor absence of evaluation can be inferred.
End-to-end World Map editingNot evaluated in this releaseThis capability is outside the release's evaluated scope.
Video tool workflowsNot evaluated in this releaseThis capability is outside the release's evaluated scope.
Video understanding qualityNot evaluated in this releaseThis capability is outside the release's evaluated scope.

Planned or implemented checks describe evaluation readiness. Executed means a run has retained evidence; validated means that evidence passed its review gates; published means approved results appear in a release. None of these states is inferred here from a category name or the presence of code.

These pages explain the categories. Scores for each release are on the leaderboard. See scores on the leaderboard