Archived pilot · Published runs in this database; repository bundles and earlier staging counts are separate inventories.
Archived pilot · runs from 17 Jul 2026 to 1 Oct 2026
Prüfstand
An early pilot, now an archive. We gave models a brief and show what they built from it — as a screenshot, with simple checks of the file. Not a functional test, not a ranking. Current top-tier models are not in this pilot yet.
- public runs
- 28
- models · 6 tasks
- 6
- with a check of the result
- 6/28
- judges published
- 0/28
What was tested
No model of the current frontier (OpenAI, Anthropic, Google, SpaceXAI) is represented in these runs.
Current frontier: the top-tier models of these providers as recorded by agi.jetzt; sources read 4 Oct 2026.
28 published runs of 6 models on 6 tasks. Run dates in UTC.
| Model | Runs | Tasks | Run date | Current frontier |
|---|---|---|---|---|
| Claude Haiku 4.5 | 4 | 4 | 17 Jul 2026 | no |
| GPT-5.6 Sol | 4 | 4 | 17 Jul 2026 | no |
| Claude Fable 5 | 6 | 6 | 18 Jul 2026 | no |
| GPT-5.6 Luna | 6 | 6 | 18 Jul 2026 | no |
| Phi-4-mini-instruct | 3 | 2 | 30 Aug 2026, 1 Oct 2026 | no |
| Qwen3.8-27B | 5 | 5 | 3 Sept 2026 | no |
Filled dot: a run with at least one check of the result. Empty dot: a run without one.
Aurora/Mesh-Gradient-Art
artifact-generative-003-bA · Claude Fable 5 · model + harnessB · GPT-5.6 Luna · model + harness
A · Claude Fable 5 · model + harnessB · GPT-5.6 Luna · model + harnessScreenshots: agi.jetzt renders the stored, model-produced file offline. The file itself is not served. The comparison shows the top of one still frame per run.
Artifact wall · Aurora/Mesh-Gradient-Art
5 runs from 4 models on the same brief. A and B put a screenshot into the comparison. Runs from 18 Jul 2026 to 1 Oct 2026.
4 of 15 verified v2 runs of this task are published. 4 of the 6 models with recorded runs have a published run.Not published: Claude Haiku 4.5 (3 runs; 0 of 2 format checks passed); GPT-5.6 Sol (3 runs; 0 of 2 format checks passed).In addition, 1 published run has no selection record (not part of the v2 import).Source: the selection records of the published runs. They count the task across its variants and know only models with at least one published run.
- Claude Fable 5Claude Fable 5Format: 2 of 2 checks passed · 2 format checks passed — no check of the result · 2 render and interaction checks not runclaude-code-cli · model + harness18 Jul 2026Open run →
- GPT-5.6 LunaGPT-5.6 LunaFormat: 2 of 2 checks passed · 2 format checks passed — no check of the result · 2 render and interaction checks not runcodex-cli · model + harness18 Jul 2026Open run →
Phi-4-mini-instructPhi-4-mini-instructFormat: 1 of 2 checks passed · 1 of 2 format checks passed — no check of the result · 2 without a recorded resultollama · model only1 Oct 2026 · token limit 8192Open run →
Phi-4-mini-instructPhi-4-mini-instructFormat: 1 of 2 checks passed · 1 of 2 format checks passed — no check of the result · 2 render and interaction checks not runollama · model only30 Aug 2026 · token limit 16000Open run →
Qwen3.8-27BQwen3.8-27BFormat: 2 of 2 checks passed · 2 format checks passed — no check of the result · 2 render and interaction checks not runollama · model only3 Sept 2026Open run →
Runs of the same task are not automatically tested alike: runtime, token limit and protocol can differ. Each run lists its own.