📊 Status Dashboard ↑ all runs

workout-corpus-a-fb954a4d-c43-20260801

workout-corpus-a · preserved partial run · 613s elapsed · iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
27
Pass
24 (89%)
Fail
2 (7%)
Unverified
1 (4%)
Pass rate
92%
Avg difficulty
—
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace — needs a human look (that's you 👍/👎-ing it). "Pass rate" = pass ÷ (pass + fail) — it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 1 unclassified — the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened — comprehension vs execution vs cosmetic

Comprehension — picked the wrong action/target (the hard problem)
2 (100%)
Of 2 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? — by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
▸ LOG — log the entry 1311 (85%) 1 (8%) 1 (8%)
▸ INTERNAL_QUERY — answer from app data 99 (100%) 0 (0%) 0 (0%)
▸ STATE_TOGGLE — toggle state 54 (80%) 1 (20%) 0 (0%)
Total2724 (92%)21

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) — this bar chart lights up once that lands.

Clarification follow-ups — scored separately

Second turn: app asked, we replied — did it resolve correctly?
No CLARIFY_ANSWER (follow-up) rows in this run.

Cosmetic only

Not yet classified — pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified — pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
0.2s
p90
0.3s
Max
1.2s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers — click any dot to jump to its detail.
0s
1s
2s
5s
Response path — quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
27
Slowest 8 utterances (click to jump to detail):
"show chest press history"1.2s
"another 10"0.3s
"I did 12 reps on leg press at 180 lb"0.3s
"I did 8 single arm cable rows with 50 lb"0.3s
"I did 10 hammer curls with 25 pound dumbbells"0.3s
"same weight, 8 reps"0.2s
"12"0.2s
"I did 10 lat pulldown at 100 pounds"0.2s

Filter — controls the list below

Pass / Fail / Unverified
PASS 24 FAIL 2 UNVERIFIED 1
Module (intended for)
Workout (27)
Utterance sub-type (within module)
27 shown — 24 pass, 2 fail, 1 unverified

Per-utterance detail

PASSshould log the entry"Log 12 reps at 70 pounds on leg extension" (difficulty —)0.1s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 12 reps @ 70 lb (Leg Extension).
Why verdict Workout set logged (write-truth): 12 reps @ 70 lb (Leg Extension).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Logged leg extension on Leg Extension Machine: 70 lb for 12 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:17:15.718Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"Bench press 135 x 8" (difficulty —)0.1s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 8 reps @ 135 lb (Bench Press).
Why verdict Workout set logged (write-truth): 8 reps @ 135 lb (Bench Press).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Logged bench press: 135 lb for 8 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:17:26.979Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"Lat pulldown 90 pounds for 12" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 12 reps @ 90 lb (Lat Pulldown).
Why verdict Workout set logged (write-truth): 12 reps @ 90 lb (Lat Pulldown).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged lat pulldown on Functional Trainer: 90 lb for 12 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:17:38.284Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I just did 20 flies on the FT2 at 60 lb" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 20 reps @ 60 lb (Chest Fly).
Why verdict Workout set logged (write-truth): 20 reps @ 60 lb (Chest Fly).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged flies on FT2: 60 lb for 20 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:17:49.575Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"12" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 12 reps @ 60 lb (Chest Fly).
Why verdict Workout set logged (write-truth): 12 reps @ 60 lb (Chest Fly).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged Chest Fly: 60 lb for 12 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:18:00.893Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"same weight, 8 reps" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 8 reps @ 60 lb (Chest Fly).
Why verdict Workout set logged (write-truth): 8 reps @ 60 lb (Chest Fly).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged Chest Fly: 60 lb for 8 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:18:12.275Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"What set am I on" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown You are after set 2 of Chest Fly; next is set 3.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:18:23.455Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"What weight should I use" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Your current Chest Fly weight is 60 lb. Use that unless you want to change it.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:18:34.630Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould toggle state"Start incline dumbbell press on the FT2" (difficulty —)0.1s
Verdict Expected STATE_TOGGLE — should toggle state. PASS: Toggled state as asked.
Why verdict Toggled state as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Started the exercise incline dumbbell press on FT2.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:18:57.309Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould toggle state"Start an exercise on the Quantum Free Trainer" (difficulty —)0.1s
Verdict Expected STATE_TOGGLE — should toggle state. PASS: Toggled state as asked.
Why verdict Toggled state as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Started exercise on Quantum Free Trainer.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:19:08.552Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould toggle state"Use the cable tower for straight arm pulldown" (difficulty —)0.1s
Verdict Expected STATE_TOGGLE — should toggle state. PASS: Toggled state as asked.
Why verdict Toggled state as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Started the exercise straight arm pulldown on Cable Tower.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:19:19.762Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I did 10 hammer curls with 25 pound dumbbells" (difficulty —)0.3s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 10 reps @ 25 lb (One-arm Dumbbell Hammer Curls).
Why verdict Workout set logged (write-truth): 10 reps @ 25 lb (One-arm Dumbbell Hammer Curls).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 · TTS said no speech captured
2 · Card shown Logged hammer curls on Dumbbells: 25 lb for 10 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:20:05.457Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I did 8 single arm cable rows with 50 lb" (difficulty —)0.3s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 8 reps @ 50 lb (One-arm Cable Single Arm Row).
Why verdict Workout set logged (write-truth): 8 reps @ 50 lb (One-arm Cable Single Arm Row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 · TTS said no speech captured
2 · Card shown Logged single arm cable rows: 50 lb for 8 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:20:16.901Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I did 12 reps on leg press at 180 lb" (difficulty —)0.3s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 12 reps @ 180 lb (Leg Press).
Why verdict Workout set logged (write-truth): 12 reps @ 180 lb (Leg Press).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 · TTS said no speech captured
2 · Card shown Logged leg press: 180 lb for 12 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:20:28.406Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I got 9 reps on lat pulldown at 90 pounds" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 9 reps @ 90 lb (Lat Pulldown).
Why verdict Workout set logged (write-truth): 9 reps @ 90 lb (Lat Pulldown).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged lat pulldown on Functional Trainer: 90 lb for 9 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:20:39.759Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould log the entry"I did 10 lat pulldown at 100 pounds" (difficulty —)0.2s
Verdict Expected LOG — should log the entry. PASS: Workout set logged (write-truth): 10 reps @ 100 lb (Lat Pulldown).
Why verdict Workout set logged (write-truth): 10 reps @ 100 lb (Lat Pulldown).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 · TTS said no speech captured
2 · Card shown Logged lat pulldown: 100 lb for 10 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:20:51.118Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"another 10" (difficulty —)0.3s
Verdict Expected LOG — should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 · TTS said no speech captured
2 · Card shown Logged Lat Pulldown: 100 lb for 10 reps.
3 · App data rows written created workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:21:14.084Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"what settings did I use last time" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown I do not have saved settings for Functional Trainer yet.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:21:25.248Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
FAILshould toggle state"that set was 2 RIR" (difficulty —)0.1s
Verdict Expected STATE_TOGGLE — should toggle state. FAIL: Did not toggle state — no confirmation of the state change (unconfirmed action).
Why verdict Did not toggle state — no confirmation of the state change (unconfirmed action).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Updated that workout set.
3 · App data rows written updated workout_set:
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:21:36.588Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould toggle state"finished" (difficulty —)0.1s
Verdict Expected STATE_TOGGLE — should toggle state. PASS: Toggled state as asked.
Why verdict Toggled state as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Ended your workout.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:21:47.877Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
FAILshould log the entry"I got 10 seat 5" (difficulty —)0.1s
Verdict Expected LOG — should log the entry. FAIL: WRITE-TRUTH FAIL — expected workout write missing — local workoutSets delta is 0 for this turn (proven no workout write, not a capture gap)
Why verdict WRITE-TRUTH FAIL — expected workout write missing — local workoutSets delta is 0 for this turn (proven no workout write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown I understood that workout request, but I am not treating it as a set to log.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:23:41.658Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"show chest press history" (difficulty —)1.2s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 · TTS said no speech captured
2 · Card shown Let me show your chest press history. It looks like your most recent entry was 80 lb for 10 reps. You can also ask me to show your "chest press PR" or compare by equipment if you log consistently.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did no screen events captured
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:25:25.295Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"show my chest press progress" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Latest Chest Press: 80 lb for 10 reps. You have 1 logged set on file.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:25:48.071Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"did I do lat pulldown this week" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown I do not see Lat Pulldown logged for that period yet.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:25:59.189Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"what did I lift on the cable tower" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown I heard a question about equipment (what did I lift on the cable tower), not a setting to save. Ask me about last weight or tell me a clear setting like "set the seat to 5".
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:26:10.377Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"show exercises for back" (difficulty —)0.1s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 · TTS said no speech captured
2 · Card shown Opening Workouts.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:26:21.600Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)
PASSshould answer from app data"what does RPE mean" (difficulty —)0.0s
Verdict Expected INTERNAL_QUERY — should answer from app data. PASS: Answered.
Why verdict Answered.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 · TTS said no speech captured
2 · Card shown I do not have a definition for that term yet.
3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 · UI did navigated to "workouts" screen
5 · Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T13:26:32.710Z
6 · Why this food No food-decision explanation was captured for this path.
7 · Lookup method No lookup method was captured for this path.
8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)