πŸ“Š Status Dashboard ↑ all runs

food-corpus-mixed-E-7c039dd0-c16-2…

food-corpus-mixed-E Β· preserved partial run Β· 2083s elapsed Β· iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
150
Pass
82 (55%)
Fail
64 (43%)
Unverified
4 (3%)
Pass rate
56%
Avg difficulty
β€”
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β€” needs a human look (that's you πŸ‘/πŸ‘Ž-ing it). "Pass rate" = pass Γ· (pass + fail) β€” it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 4 unclassified β€” the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened β€” comprehension vs execution vs cosmetic

Comprehension β€” picked the wrong action/target (the hard problem)
58 (91%)
Execution β€” right decision, output broke (plumbing)
6 (9%)
Of 64 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? β€” by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
β–Έ LOG β€” log the food 10452 (50%) 51 (49%) 1 (1%)
β–Έ CLARIFY β€” ask a clarifying question 2927 (93%) 2 (7%) 0 (0%)
β–Έ CLARIFY_ANSWER β€” complete the pending action 132 (15%) 8 (62%) 3 (23%)
β–Έ DELETE β€” delete the entry 30 (0%) 3 (100%) 0 (0%)
β–Έ DECLINE β€” decline 11 (100%) 0 (0%) 0 (0%)
Total15082 (56%)644

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) β€” this bar chart lights up once that lands.

Clarification follow-ups β€” scored separately

Second turn: app asked, we replied β€” did it resolve correctly?
Follow-ups
13
Resolved
2 (15%)
Mishandled
8 (62%)
Unverified
3

Cosmetic only

Not yet classified β€” pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified β€” pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
1.4s
p90
5.0s
Max
8.3s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β€” click any dot to jump to its detail.
0s
1s
2s
5s
9s
Response path β€” quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
121
Sync clarification
29
Slowest 8 utterances (click to jump to detail):
"Finished one Fairlife Core Power strawberry banana bottle."8.3s
"Log a bowl of gazpacho."8.0s
"I made curry with chicken, cauliflower, coconut milk, and oil."7.3s
"Dinner side was one cup sauteed zucchini."6.0s
"Wrong item. Pick the grilled mahi."5.8s
"Not those pecans β€” the raw ones."5.8s
"Add two poached eggs for lunch."5.7s
"Log my usual coffee size."5.5s

Filter β€” controls the list below

Pass / Fail / Unverified
PASS 82 FAIL 64 UNVERIFIED 4
Module (intended for)
Food (150)
Utterance sub-type (within module)
150 shown β€” 82 pass, 64 fail, 4 unverified

Per-utterance detail

PASSshould log the food"Log one medium mango for the sequence." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Mango β€” card not captured.
Why verdict Logged (write-truth verified): Mango β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one medium mango for the sequence. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:22:45.100Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track one Built puff chocolate bar." (difficulty β€”)1.9s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Track One Built Puff Chocolate Snack Bar in my nutrition database, so I haven't logged it β€” I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic snack bar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:22:58.116Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had one cup cream of wheat with water only." (difficulty β€”)4.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.4s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. my normal cream of wheat, 2. Cream of wheat (100 g), 3. cream of wheat (serving), 4. Cream of Wheat (cup)
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:23:13.750Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Add two poached eggs for lunch." (difficulty β€”)5.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:23:30.667Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log one cup blackberries as a snack." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Blackberries β€” card not captured.
Why verdict Logged (write-truth verified): Blackberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup blackberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blackberries Γ—1 (1 cup) 62 cal Β· 2g P Β· 14.7g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:23:42.136Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Record five ounces grilled mahi." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): mahi β€” card not captured.
Why verdict Logged (write-truth verified): mahi β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown I logged mahi β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: mahi Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:23:54.217Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track one tablespoon sunflower butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "sunflower butter": logged 180 kcal vs expected ~99 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "sunflower butter": logged 180 kcal vs expected ~99 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I logged sunflower butter β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: sunflower butter Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:05.518Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I drank one cup unsweetened soy milk." (difficulty β€”)3.9s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. my default soy milk, 2. Unsweetened Soy Milk
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:20.600Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had one medium mango." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Mango β€” card not captured.
Why verdict Logged (write-truth verified): Mango β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one medium mango. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:31.916Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Breakfast was two poached eggs." (difficulty β€”)5.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:48.401Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Put down five ounces grilled mahi mahi." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said no speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:01.234Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Record one cup cooked basmati rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cooked Basmati Rice, Cooked Basmati Rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Basmati Rice, Cooked Basmati Rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Cooked Basmati Rice (one cup (158 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Cooked Basmati Rice Γ—1 (one cup (158 g)) 205 cal Β· 4.3g P Β· 44.2g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:12.550Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Snack was two clementines." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Clementine β€” card not captured.
Why verdict Logged (write-truth verified): Clementine β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged two clementines.
3 Β· App data rows written created food_log_entry: Clementine Γ—1 (2 clementines) 70 cal Β· 1.3g P Β· 17.8g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:23.833Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate four ounces baked trout." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Trout β€” card not captured.
Why verdict Logged (write-truth verified): Trout β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged four ounces baked trout.
3 Β· App data rows written created food_log_entry: Trout Γ—1 (4 oz) 191 cal Β· 27g P Β· 0g C Β· 8.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:35.100Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Track one cup blackberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Blackberries β€” card not captured.
Why verdict Logged (write-truth verified): Blackberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup blackberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blackberries Γ—1 (1 cup) 62 cal Β· 2g P Β· 14.7g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:46.417Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Count fourteen pecans." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. my usual pecans, 2. Pecans
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:58.901Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Lunch included three ounces smoked turkey." (difficulty β€”)2.9s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "smoked turkey" β€” no saved row with matching identity (rows: Turkey breast)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "smoked turkey" β€” no saved row with matching identity (rows: Turkey breast)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.9s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Turkey breast (three ounces (85 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Turkey breast Γ—1 (three ounces (85 g)) 115 cal Β· 24.7g P Β· 0g C Β· 1.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:26:12.984Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Save one cup roasted cauliflower." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cauliflower β€” card not captured.
Why verdict Logged (write-truth verified): Cauliflower β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup roasted cauliflower. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cauliflower Γ—1 (1 cup) 31 cal Β· 2.4g P Β· 6.2g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:26:24.265Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I drank eight ounces cranberry juice." (difficulty β€”)1.5s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:26:36.918Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Note two turkey sausage links." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Turkey sausage links β€” card not captured.
Why verdict Logged (write-truth verified): Turkey sausage links β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged note two turkey sausage links.
3 Β· App data rows written created food_log_entry: Turkey sausage links Γ—1 (2 turkey sausage links) 150 cal Β· 13g P Β· 3g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:26:48.367Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Supper was one cup white beans." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for one cup white beans? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:18.001Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Enter one medium plum." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Plum β€” card not captured.
Why verdict Logged (write-truth verified): Plum β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one medium plum. Assumed 1 plum as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Plum Γ—1 (1 plum) 30 cal Β· 0.5g P Β· 7.5g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:29.334Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Ate a quarter cup dried apricots." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "dried apricots": logged 145 kcal vs expected ~78 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "dried apricots": logged 145 kcal vs expected ~78 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged ate a quarter cup dried apricots. Assumed 0.25 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Dried apricots Γ—1 (0.25 cup) 145 cal Β· 2g P Β· 37.8g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:40.817Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track one tablespoon sunflower butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "sunflower butter": logged 180 kcal vs expected ~99 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "sunflower butter": logged 180 kcal vs expected ~99 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I logged sunflower butter β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: sunflower butter Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:52.134Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Dinner side was one cup sauteed zucchini." (difficulty β€”)6.0s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.0s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Zucchini? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:09.217Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had one and a half cups cantaloupe." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cantaloupe β€” card not captured.
Why verdict Logged (write-truth verified): Cantaloupe β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one and a half cups cantaloupe. Assumed 1.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cantaloupe Γ—1 (1.5 cup) 82 cal Β· 1.9g P Β· 19.7g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:20.800Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Put in two hundred grams quark." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Quark β€” card not captured.
Why verdict Logged (write-truth verified): Quark β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged two hundred grams quark.
3 Β· App data rows written created food_log_entry: Quark Γ—1 (200 g) 134 cal Β· 24g P Β· 8g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:32.151Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log one cup unsweetened soy milk." (difficulty β€”)5.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Milk? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:48.634Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Breakfast was three quarters cup paneer." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "paneer": logged 336 kcal vs expected ~260 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "paneer": logged 336 kcal vs expected ~260 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged three quarters cup paneer.
3 Β· App data rows written created food_log_entry: Paneer Γ—1 (0.75 cup) 336 cal Β· 17.9g P Β· 25.3g C Β· 17.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:59.934Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Count one whole wheat pita." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Whole Wheat Pita β€” card not captured.
Why verdict Logged (write-truth verified): Whole Wheat Pita β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Whole Wheat Pita β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Whole Wheat Pita Γ—1 (pita) 140 cal Β· 6g P Β· 28g C Β· 1.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:11.235Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had five ounces bison steak." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "bison steak": logged 554 kcal vs expected ~180 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "bison steak": logged 554 kcal vs expected ~180 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Bison Steak Uncured Bacon + Chia Strip β€” EPIC β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Bison Steak Uncured Bacon + Chia Strip Γ—1 (five ounces (141.7 g)) 554 cal Β· 37g P Β· 30.8g C Β· 30.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:22.749Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Add one cup navy beans." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Add One Packaged Food in my nutrition database, so I haven't logged it β€” I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:36.150Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track half a cup mango salsa." (difficulty β€”)4.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.7s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Track Half A Packaged Food in my nutrition database, so I haven't logged it β€” I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:51.984Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log two Kodiak power cakes." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. Blueberry Power Cakes Flapjack & Waffle Mix β€” KODIAK, 2. KODIAK Almond Poppy Seed Power Cakes Flapjack & Waffle Mix, Almond Poppy Seed
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:03.500Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate one whole wheat English muffin." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Whole wheat English muffin β€” card not captured.
Why verdict Logged (write-truth verified): Whole wheat English muffin β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Whole wheat English muffin β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Whole wheat English muffin Γ—1 (57 g) 128 cal Β· 5.6g P Β· 24.8g C Β· 1.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:15.151Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Record four ounces bay scallops." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:27.251Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Snack was one Laughing Cow wedge." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Laughing Cow β€” card not captured.
Why verdict Logged (write-truth verified): Laughing Cow β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one laughing cow wedge. Assumed 1 laughing cow wedge as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Laughing Cow Γ—1 (1 laughing cow wedge) 35 cal Β· 2g P Β· 1g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:38.533Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add one teaspoon sesame oil." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Sesame oil β€” card not captured.
Why verdict Logged (write-truth verified): Sesame oil β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one teaspoon sesame oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Sesame oil Γ—1 (1 tsp) 40 cal Β· 0g P Β· 0g C Β· 4.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:49.917Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had one cup wild rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cooked wild rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked wild rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup wild rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked wild rice Γ—1 (1 cup) 166 cal Β· 6.6g P Β· 34.9g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:31:01.267Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log one medium plantain." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for one medium plantain? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:31:15.100Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track ten ounces barley tea." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "barley tea" β€” no saved row with matching identity (rows: Chamomile Tea)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "barley tea" β€” no saved row with matching identity (rows: Chamomile Tea)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Chamomile Tea β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Chamomile Tea Γ—1.25 (cup) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:31:41.783Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Count twelve cherry tomatoes." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cherry tomatoes β€” card not captured.
Why verdict Logged (write-truth verified): Cherry tomatoes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged twelve cherry tomatoes.
3 Β· App data rows written created food_log_entry: Cherry tomatoes Γ—1 (12 cherry tomatoes) 37 cal Β· 1.8g P Β· 8g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:31:53.084Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Dinner was five ounces pork loin." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Pork loin β€” card not captured.
Why verdict Logged (write-truth verified): Pork loin β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged five ounces pork loin.
3 Β· App data rows written created food_log_entry: Pork loin Γ—1 (5 oz) 224 cal Β· 39.1g P Β· 0g C Β· 6.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:32:04.534Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had one cup gazpacho." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Gazpacho β€” card not captured.
Why verdict Logged (write-truth verified): Gazpacho β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup gazpacho. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Gazpacho Γ—1 (1 cup) 64 cal Β· 2g P Β· 11g C Β· 1.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:32:15.884Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Add two brown rice cakes." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Plain rice cakes? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:32:32.417Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log one cup honeydew." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Honeydew β€” card not captured.
Why verdict Logged (write-truth verified): Honeydew β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup honeydew. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Honeydew Γ—1 (1 cup) 61 cal Β· 0.9g P Β· 15.5g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:32:43.721Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track two tablespoons baba ganoush." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for two tablespoons baba ganoush? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:32:57.550Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I ate one medium persimmon." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for one medium persimmon? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:33:11.385Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Put down one cup freekeh." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "freekeh": logged 520 kcal vs expected ~200 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "freekeh": logged 520 kcal vs expected ~200 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Organic Roasted Green Wheat, Cracked Whole Grains, Rosemary Sage β€” FREEKEH FOODS (one cup (160 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Organic Roasted Green Wheat, Cracked Whole Grains, Rosemary Sage Γ—1 (one cup (160 g)) 520 cal Β· 24g P Β· 112g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:33:22.884Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Record four ounces chicken thigh meat only." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Chicken thigh? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:33:39.401Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add my usual Built bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Built Puff Bar β€” card not captured.
Why verdict Logged (write-truth verified): Built Puff Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Built Built Puff Bar. Using your saved "my usual built bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Built Puff Bar Γ—1 (bar) 150 cal Β· 17g P Β· 15g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Built Built Puff Bar
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-built",
        "name": "Built Puff Bar",
        "brand": "Built",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 17,
          "fatGrams": 4,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual Built bar",
      "foodItemId": "seed-e-built",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bar",
        "displayLabel": "my usual Built bar",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:33:50.618Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had my usual quark." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Plain Quark β€” card not captured.
Why verdict Logged (write-truth verified): Plain Quark β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Codex Test Dairy Plain Quark. Using your saved "my usual quark". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Plain Quark Γ—1 (cup) 140 cal Β· 24g P Β· 8g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Plain Quark
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-quark",
        "name": "Plain Quark",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 24,
          "fatGrams": 0.5,
          "carbsGrams": 8
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual quark",
      "foodItemId": "seed-e-quark",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual quark",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:01.851Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Lunch was my usual sardine tin." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for my usual sardine tin? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Pantry Sardines in Water
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-sardine",
        "name": "Sardines in Water",
        "brand": "Codex Test Pantry",
        "source": "manual",
        "servingLabel": "tin",
        "servingQuantity": 1,
        "servingUnit": "tin",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 18,
          "fatGrams": 8,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual sardine tin",
      "foodItemId": "seed-e-sardine",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "tin",
        "displayLabel": "my usual sardine tin",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:13.151Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Dinner side was my usual rice." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cooked Basmati Rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Basmati Rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked Basmati Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Basmati Rice Γ—1 (cup) 190 cal Β· 4g P Β· 41g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Basmati Rice
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-rice",
        "name": "Cooked Basmati Rice",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 190,
          "proteinGrams": 4,
          "fatGrams": 0.4,
          "carbsGrams": 41
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual rice",
      "foodItemId": "seed-e-rice",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual rice",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:24.385Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Track my usual pecans." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Pecans β€” card not captured.
Why verdict Logged (write-truth verified): Pecans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Pecans. Using your saved "my usual pecans". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Pecans Γ—1 (ounce) 196 cal Β· 2.6g P Β· 4g C Β· 20g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pecans
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-pecans",
        "name": "Pecans",
        "brand": null,
        "source": "manual",
        "servingLabel": "ounce",
        "servingQuantity": 1,
        "servingUnit": "oz",
        "macrosPerServing": {
          "calories": 196,
          "proteinGrams": 2.6,
          "fatGrams": 20,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual pecans",
      "foodItemId": "seed-e-pecans",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "ounce",
        "displayLabel": "my usual pecans",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:35.616Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log my default soy milk." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Unsweetened Soy Milk β€” card not captured.
Why verdict Logged (write-truth verified): Unsweetened Soy Milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Unsweetened Soy Milk. Using your saved "my default soy milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Unsweetened Soy Milk Γ—1 (cup) 80 cal Β· 7g P Β· 4g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Unsweetened Soy Milk
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-soymilk",
        "name": "Unsweetened Soy Milk",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 80,
          "proteinGrams": 7,
          "fatGrams": 4,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my default soy milk",
      "foodItemId": "seed-e-soymilk",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my default soy milk",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:46.855Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add my usual morning matcha." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Matcha Latte, Matcha Latte β€” card not captured.
Why verdict Logged (write-truth verified): Matcha Latte, Matcha Latte β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Codex Test Cafe Matcha Latte. Using your saved "my usual morning matcha". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Matcha Latte Γ—1 (cup) 90 cal Β· 4g P Β· 12g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Cafe Matcha Latte
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-matcha",
        "name": "Matcha Latte",
        "brand": "Codex Test Cafe",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 90,
          "proteinGrams": 4,
          "fatGrams": 3,
          "carbsGrams": 12
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual morning matcha",
      "foodItemId": "seed-e-matcha",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual morning matcha",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:34:58.065Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had my normal cream of wheat." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cream of Wheat. Using your saved "my normal cream of wheat". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cream of Wheat Γ—1 (cup) 130 cal Β· 4g P Β· 28g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cream of Wheat
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-cow",
        "name": "Cream of Wheat",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 130,
          "proteinGrams": 4,
          "fatGrams": 0.5,
          "carbsGrams": 28
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my normal cream of wheat",
      "foodItemId": "seed-e-cow",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my normal cream of wheat",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:35:09.278Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Track my go-to bone broth." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Chicken Bone Broth β€” card not captured.
Why verdict Logged (write-truth verified): Chicken Bone Broth β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Codex Test Kitchen Chicken Bone Broth. Using your saved "my go to bone broth". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Bone Broth Γ—1 (cup) 45 cal Β· 9g P Β· 1g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Chicken Bone Broth
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-broth",
        "name": "Chicken Bone Broth",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 45,
          "proteinGrams": 9,
          "fatGrams": 0.5,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my go-to bone broth",
      "foodItemId": "seed-e-broth",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my go-to bone broth",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:35:20.476Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log my usual evening chamomile." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Chamomile Tea β€” card not captured.
Why verdict Logged (write-truth verified): Chamomile Tea β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Chamomile Tea. Using your saved "my usual evening chamomile". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chamomile Tea Γ—1 (cup) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Chamomile Tea
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-chamomile",
        "name": "Chamomile Tea",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 0,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual evening chamomile",
      "foodItemId": "seed-e-chamomile",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual evening chamomile",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:35:31.676Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Add the same paneer as yesterday." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown I hear more than one saved version that could match "the same paneer as yesterday". Which exact food and amount should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Paneer Cubes
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-paneer",
        "name": "Paneer Cubes",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 260,
          "proteinGrams": 18,
          "fatGrams": 20,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 0.75 for seed-e-hist-paneer at 2026-07-17T13:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-paneer",
      "quantity": 0.75,
      "loggedAt": "2026-07-17T13:00:00.000Z"
    }
snapshot captured 2026-07-30T20:35:59.541Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Same Built bar as yesterday." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Built Puff Bar β€” card not captured.
Why verdict Logged (write-truth verified): Built Puff Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Built Built Puff Bar. Using your saved "my usual built bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Built Puff Bar Γ—1 (bar) 150 cal Β· 17g P Β· 15g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Built Built Bar Chocolate
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-built",
        "name": "Built Bar Chocolate",
        "brand": "Built",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 17,
          "fatGrams": 4,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-built at 2026-07-17T16:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-built",
      "quantity": 1,
      "loggedAt": "2026-07-17T16:00:00.000Z"
    }
snapshot captured 2026-07-30T20:36:10.758Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log the same gazpacho I had last night." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown I heard you want the same the same gazpacho i had last night as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Gazpacho Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-gaz",
        "name": "Gazpacho Bowl",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 90,
          "proteinGrams": 2,
          "fatGrams": 3,
          "carbsGrams": 14
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-gaz at 2026-07-17T19:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-gaz",
      "quantity": 1,
      "loggedAt": "2026-07-17T19:30:00.000Z"
    }
snapshot captured 2026-07-30T20:36:22.759Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Same oatmeal as this morning." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oatmeal Bowl Γ—1 (bowl) 150 cal Β· 5g P Β· 27g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Oatmeal Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-oats",
        "name": "Oatmeal Bowl",
        "brand": null,
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 5,
          "fatGrams": 2.5,
          "carbsGrams": 27
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-oats at 2026-07-18T07:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-oats",
      "quantity": 1,
      "loggedAt": "2026-07-18T07:30:00.000Z"
    }
snapshot captured 2026-07-30T20:36:34.058Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add the same trout I had earlier." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Trout β€” card not captured.
Why verdict Logged (write-truth verified): Trout β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Trout. Using your recent Trout history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Trout Γ—1 (4 oz) 191 cal Β· 27g P Β· 0g C Β· 8.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Baked Trout Fillet
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-trout",
        "name": "Baked Trout Fillet",
        "brand": null,
        "source": "manual",
        "servingLabel": "fillet",
        "servingQuantity": 1,
        "servingUnit": "fillet",
        "macrosPerServing": {
          "calories": 190,
          "proteinGrams": 28,
          "fatGrams": 8,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-trout at 2026-07-18T12:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-trout",
      "quantity": 1,
      "loggedAt": "2026-07-18T12:00:00.000Z"
    }
snapshot captured 2026-07-30T20:36:45.374Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the food"Same smoothie as yesterday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. UNVERIFIED: CONTEXT-FRAGMENT β€” app asked for missing context; needs multi-turn replay (not a single-shot fail).
Why verdict CONTEXT-FRAGMENT β€” app asked for missing context; needs multi-turn replay (not a single-shot fail).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown I hear more than one saved version that could match "same smoothie as yesterday". Which exact food and amount should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Recipe Mango Protein Smoothie
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-smooth",
        "name": "Mango Protein Smoothie",
        "brand": "Codex Test Recipe",
        "source": "manual",
        "servingLabel": "smoothie",
        "servingQuantity": 1,
        "servingUnit": "smoothie",
        "macrosPerServing": {
          "calories": 290,
          "proteinGrams": 24,
          "fatGrams": 5,
          "carbsGrams": 36
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-smooth at 2026-07-17T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-smooth",
      "quantity": 1,
      "loggedAt": "2026-07-17T10:00:00.000Z"
    }
snapshot captured 2026-07-30T20:36:56.708Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log the mahi I had last time." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): mahi β€” card not captured.
Why verdict Logged (write-truth verified): mahi β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged mahi. Using your saved "mahi". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: mahi Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Grilled Mahi Mahi
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-mahi",
        "name": "Grilled Mahi Mahi",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 30,
          "fatGrams": 1.5,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-mahi at 2026-07-16T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-mahi",
      "quantity": 1,
      "loggedAt": "2026-07-16T18:00:00.000Z"
    }
snapshot captured 2026-07-30T20:37:07.924Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Same pita as earlier today." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Whole Wheat Pita β€” card not captured.
Why verdict Logged (write-truth verified): Whole Wheat Pita β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Whole Wheat Pita. Using your recent Whole Wheat Pita history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Whole Wheat Pita Γ—1 (pita) 140 cal Β· 6g P Β· 28g C Β· 1.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Whole Wheat Pita
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-hist-pita",
        "name": "Whole Wheat Pita",
        "brand": null,
        "source": "manual",
        "servingLabel": "pita",
        "servingQuantity": 1,
        "servingUnit": "pita",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 6,
          "fatGrams": 1.5,
          "carbsGrams": 28
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-hist-pita at 2026-07-18T07:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-hist-pita",
      "quantity": 1,
      "loggedAt": "2026-07-18T07:00:00.000Z"
    }
snapshot captured 2026-07-30T20:37:19.307Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Snack was one Perfect Bar peanut butter." (difficulty β€”)2.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. Peanut Butter Bar β€” Perfect Bar, 2. Dark Chocolate Chip Peanut Butter β€” PERFECT BAR
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:37:32.824Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Finished one Fairlife Core Power strawberry banana bottle." (difficulty β€”)8.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.3s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Fairlife Core Power Strawberry Banana Protein Shake in my nutrition database, so I haven't logged it β€” I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic protein shake.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:37:52.240Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track one Siggi's plain 4 percent cup." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Track One Siggi's Plain 4 Percent Packaged Food in my nutrition database, so I haven't logged it β€” I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:38:04.374Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Save one Built puff coconut bar." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG item/product identity "built puff coconut" β€” saved row does not hit product alias (rows: Puff Bar)
Why verdict WRITE-TRUTH FAIL β€” WRONG item/product identity "built puff coconut" β€” saved row does not hit product alias (rows: Puff Bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Built Puff Bar β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Puff Bar Γ—1 (bar) 150 cal Β· 17g P Β· 15g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:38:17.657Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate one RXBAR peanut butter." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Rxbar Peanut Butter Chocolate Bar β€” card not captured.
Why verdict Logged (write-truth verified): Rxbar Peanut Butter Chocolate Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Rxbar Peanut Butter Chocolate Bar β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Rxbar Peanut Butter Chocolate Bar Γ—1 (1 bar) 210 cal Β· 12g P Β· 23g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:38:29.424Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log a medium mango and one Built bar." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "one built bar" β€” no saved row with matching identity (rows: Mango, Rxbar Peanut Butter Chocolate Bar)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "one built bar" β€” no saved row with matching identity (rows: Mango, Rxbar Peanut Butter Chocolate Bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a medium mango and rxbar peanut butter chocolate bar. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
created food_log_entry: Rxbar Peanut Butter Chocolate Bar Γ—1 (1 bar) 210 cal Β· 12g P Β· 23g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:38:41.424Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had oatmeal and black coffee." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Coffee, Cooked oatmeal β€” card not captured.
Why verdict Logged (write-truth verified): Coffee, Cooked oatmeal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked oatmeal and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F
created food_log_entry: Coffee Γ—1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:38:52.906Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Breakfast was two poached eggs and a pita." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Egg, Pita bread β€” card not captured.
Why verdict Logged (write-truth verified): Egg, Pita bread β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Egg and Pita bread. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—2 (50 g) 144 cal Β· 12.6g P Β· 0.8g C Β· 9.6g F
created food_log_entry: Pita bread Γ—1 (1 pita) 165 cal Β· 5.5g P Β· 33.4g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:39:04.574Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Lunch was a falafel wrap and a clementine." (difficulty β€”)2.2s
Verdict Expected LOG β€” should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS said no speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:39:17.907Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Snack was pecans and a plum." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Plum, Pecans β€” card not captured.
Why verdict Logged (write-truth verified): Plum, Pecans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown Logged pecans and a plum. Assumed 1 plum as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Pecans Γ—1 (ounce) 196 cal Β· 2.6g P Β· 4g C Β· 20g F
created food_log_entry: Plum Γ—1 (1 plum) 30 cal Β· 0.5g P Β· 7.5g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:39:30.007Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Dinner was trout and roasted cauliflower." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Trout, Cauliflower β€” card not captured.
Why verdict Logged (write-truth verified): Trout, Cauliflower β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Trout and Cauliflower. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Trout Γ—1 (100 g) 168 cal Β· 23.8g P Β· 0g C Β· 7.4g F
created food_log_entry: Cauliflower Γ—1 (100 g) 25 cal Β· 1.9g P Β· 5g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:39:41.390Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate quark and blackberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Blackberries, Quark β€” card not captured.
Why verdict Logged (write-truth verified): Blackberries, Quark β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Quark and Blackberries. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Quark Γ—1 (170 g) 114 cal Β· 20.4g P Β· 6.8g C Β· 0.3g F
created food_log_entry: Blackberries Γ—1 (100 g) 43 cal Β· 1.4g P Β· 10.2g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:39:52.807Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Track mahi and basmati rice." (difficulty β€”)1.1s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "basmati rice" β€” no saved row with matching identity (rows: Cooked white rice, mahi)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "basmati rice" β€” no saved row with matching identity (rows: Cooked white rice, mahi)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged mahi and Cooked white rice. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: mahi Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
created food_log_entry: Cooked white rice Γ—1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:40:20.389Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add paneer and cucumber." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Paneer, Cucumber β€” card not captured.
Why verdict Logged (write-truth verified): Paneer, Cucumber β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Paneer and Cucumber. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Paneer Γ—1 (100 g) 299 cal Β· 15.9g P Β· 22.5g C Β· 15.5g F
created food_log_entry: Cucumber Γ—1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:40:31.757Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I had a Perfect Bar and mineral water." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Water, Water, Perfect Bar Peanut Butter Bar, Perfect Bar Peanut Butter Bar β€” card not captured.
Why verdict Logged (write-truth verified): Water, Water, Perfect Bar Peanut Butter Bar, Perfect Bar Peanut Butter Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Perfect Bar Peanut Butter Bar β€” Perfect Bar and Water. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Perfect Bar Peanut Butter Bar Γ—1 (1 serving (65 g)) 311 cal Β· 15g P Β· 24g C Β· 20g F
created food_log_entry: Water Γ—1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:40:43.406Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from open food facts.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log gazpacho and arugula." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Gazpacho, Arugula β€” card not captured.
Why verdict Logged (write-truth verified): Gazpacho, Arugula β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Gazpacho and Arugula. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Gazpacho Γ—1 (245 g) 64 cal Β· 2g P Β· 11g C Β· 1.5g F
created food_log_entry: Arugula Γ—1 (40 g) 10 cal Β· 1g P Β· 1.5g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:40:54.807Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Breakfast was oatmeal, mango, and coffee." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Coffee, Cooked oatmeal, Mango β€” card not captured.
Why verdict Logged (write-truth verified): Coffee, Cooked oatmeal, Mango β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked oatmeal, Mango, and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F
created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
created food_log_entry: Coffee Γ—1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:41:06.407Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate a plum, Laughing Cow, and rice cakes." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Plum, Laughing Cow, Plain rice cakes β€” card not captured.
Why verdict Logged (write-truth verified): Plum, Laughing Cow, Plain rice cakes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a plum, Laughing Cow, and Plain rice cakes. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Plum Γ—1 (1 plum) 30 cal Β· 0.5g P Β· 7.5g C Β· 0.2g F
created food_log_entry: Laughing Cow Γ—1 (21 g) 35 cal Β· 2g P Β· 1g C Β· 2.5g F
created food_log_entry: Plain rice cakes Γ—1 (1 oz) 108 cal Β· 2.2g P Β· 22.8g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:41:17.806Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Dinner was pork loin, wild rice, and zucchini." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Zucchini, Pork loin, Cooked wild rice β€” card not captured.
Why verdict Logged (write-truth verified): Zucchini, Pork loin, Cooked wild rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Pork loin, Cooked wild rice, and Zucchini. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Pork loin Γ—1 (85 g) 134 cal Β· 23.5g P Β· 0g C Β· 3.7g F
created food_log_entry: Cooked wild rice Γ—1 (164 g) 166 cal Β· 6.6g P Β· 34.9g C Β· 0.5g F
created food_log_entry: Zucchini Γ—1 (100 g) 17 cal Β· 1.2g P Β· 3.1g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:41:29.207Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Snack was cucumber and baba ganoush." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Baba Ganoush Smoked Eggplant Dip, Cucumber β€” card not captured.
Why verdict Logged (write-truth verified): Baba Ganoush Smoked Eggplant Dip, Cucumber β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cucumber and Baba Ganoush Smoked Eggplant Dip β€” MAMNOON. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cucumber Γ—1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
created food_log_entry: Baba Ganoush Smoked Eggplant Dip Γ—1 (2 Tbsp) 25 cal Β· 1g P Β· 2g C Β· 2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:41:40.772Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Lunch was a salad and whole wheat pita." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve a salad before I log this meal. What should I use for a salad?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:41:53.973Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had rice, white beans, and smoked turkey." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "smoked turkey" β€” no saved row with matching identity (rows: Turkey breast, Beans, Cooked white rice)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "smoked turkey" β€” no saved row with matching identity (rows: Turkey breast, Beans, Cooked white rice)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked white rice, Beans, and Turkey breast. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ—1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F
created food_log_entry: Beans Γ—1 (86 g) 109 cal Β· 7.5g P Β· 19.6g C Β· 0.4g F
created food_log_entry: Turkey breast Γ—1 (100 g) 135 cal Β· 29g P Β· 0g C Β· 1.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:42:05.573Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Track quark, tahini, and honeydew." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Quark, Honeydew, Tahini β€” card not captured.
Why verdict Logged (write-truth verified): Quark, Honeydew, Tahini β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Quark, Tahini, and Honeydew. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Quark Γ—1 (170 g) 114 cal Β· 20.4g P Β· 6.8g C Β· 0.3g F
created food_log_entry: Tahini Γ—1 (15 g) 89 cal Β· 2.6g P Β· 3.2g C Β· 8.1g F
created food_log_entry: Honeydew Γ—1 (100 g) 36 cal Β· 0.5g P Β· 9.1g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:42:17.156Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Add eggs, turkey sausage, and cranberry juice." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Turkey sausage links, Egg, Cranberry Juice Blend, 100% Juice β€” card not captured.
Why verdict Logged (write-truth verified): Turkey sausage links, Egg, Cranberry Juice Blend, 100% Juice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged two eggs, Turkey sausage links, and Cranberry Juice Blend, 100% Juice. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F
created food_log_entry: Turkey sausage links Γ—1 (50 g) 75 cal Β· 6.5g P Β· 1.5g C Β· 4.5g F
created food_log_entry: Cranberry Juice Blend, 100% Juice Γ—1 (1 fl oz (no ice)) 14 cal Β· 0g P Β· 3.5g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:42:29.007Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"I ate pasta and a side of snow peas." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Cooked pasta, Snow peas, Cooked pasta, Snow peas β€” card not captured.
Why verdict Logged (write-truth verified): Cooked pasta, Snow peas, Cooked pasta, Snow peas β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked pasta and Snow peas. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ—1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
created food_log_entry: Snow peas Γ—1 (98 g) 41 cal Β· 2.7g P Β· 7.4g C Β· 0.2g F
created food_log_entry: Cooked pasta Γ—1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
created food_log_entry: Snow peas Γ—1 (98 g) 41 cal Β· 2.7g P Β· 7.4g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:42:40.873Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the food"Log a fig and sunflower butter." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. PASS: Logged (write-truth verified): Butter, Dried figs β€” card not captured.
Why verdict Logged (write-truth verified): Butter, Dried figs β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a fig and Butter. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Dried figs Γ—1 (1 fig) 20 cal Β· 0.3g P Β· 5.1g C Β· 0.1g F
created food_log_entry: Butter Γ—1 (5 g) 36 cal Β· 0g P Β· 0g C Β· 4.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:42:52.423Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Breakfast was cereal and soy milk." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said no speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:43:05.223Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had a shakshuka with three eggs, tomatoes, and feta" (difficulty β€”)3.6s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for tomatoes?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:43:19.939Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log a smoothie with mango, spinach, and whey protein." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for mango?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:43:31.756Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had a grain bowl with freekeh, chickpeas, and tahini." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for freekeh?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:43:44.872Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Breakfast was avocado toast with tomato and everything seasoning." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact ingredient should I use for everything seasoning?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:43:56.673Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I made curry with chicken, cauliflower, coconut milk, and oil." (difficulty β€”)7.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 7.3s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for coconut milk?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:44:15.088Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Dinner was a falafel plate with pita, hummus, and cucumber salad." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown What exact ingredient should I use for falafel plate with pita hummus?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:44:42.357Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I had udon with shrimp and scallions." (difficulty β€”)2.6s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for scallions?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:44:56.122Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Log a tuna sandwich with avocado and mustard." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact ingredient should I use for mustard?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:45:07.638Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"I built a yogurt bowl with freekeh, honey, and blackberries." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the food. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for freekeh?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:45:20.089Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the food"Dinner was fish tacos with cabbage, mango salsa, and crema." (difficulty β€”)5.1s
Verdict Expected LOG β€” should log the food. FAIL: WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.1s
1 Β· TTS said no speech captured
2 Β· Card shown I’ve logged fish tacos with cabbage, mango salsa, and crema. Let me know if the servings or ingredients don’t match what you had.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:45:36.271Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add some freekeh." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for some freekeh? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:45:50.104Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had cream of wheat." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Cream of wheat? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:46:01.338Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log basmati for dinner." (difficulty β€”)2.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:46:14.522Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track udon." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Udon β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Udon Γ—1 (serving) 60 cal Β· 8.5g P Β· 7.4g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:46:25.939Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I ate plantain chips." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Plantain Chips β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Plantain Chips Γ—1 (1 cup) 202 cal Β· 0.9g P Β· 24.2g C Β· 11.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:46:37.388Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add pecans." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. my usual pecans, 2. pecans
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:46:49.590Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of gazpacho." (difficulty β€”)8.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.0s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Gazpacho? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:47:08.755Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of freekeh." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a plate of freekeh? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:47:22.604Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track cranberry juice." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:47:35.138Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add matcha." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. my usual morning matcha, 2. codex test cafe matcha latte, 3. Matcha Latte β€” Codex Test Cafe
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:47:47.038Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I drank sake." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I logged sake β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: sake Γ—1 (serving) 200 cal Β· 5g P Β· 20g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:47:58.303Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log sorbet." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Sorbet β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Sorbet Γ—1 (1 cup) 220 cal Β· 1.6g P Β· 54.2g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:48:09.770Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Had some sunflower seeds." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Sunflower seeds? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:48:21.004Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add rice cakes." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Plain rice cakes? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:48:32.238Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had a Built bar." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: WRONG item vs seeded default/key β€” WRONG/MISSING item "built bar" β€” no saved row with matching identity (rows: Peanut Butter Bar)
Why verdict WRONG item vs seeded default/key β€” WRONG/MISSING item "built bar" β€” no saved row with matching identity (rows: Peanut Butter Bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Perfect Bar Peanut Butter Bar β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Peanut Butter Bar Γ—1 (1 serving (65 g)) 311 cal Β· 15g P Β· 24g C Β· 20g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:48:43.906Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a quark cup." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a quark cup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Quark Γ—1 (1 cup) 151 cal Β· 27.1g P Β· 9g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:49:10.621Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a plant milk." (difficulty β€”)5.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said no speech captured
2 Β· Card shown What fat level or type of milk should I use? I did not log it yet because milk fat level can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:49:27.003Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a wrap." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a wrap? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:49:40.820Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a recovery shake." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a recovery shake? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:49:54.653Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had matcha with milk." (difficulty β€”)2.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.9s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Matcha latte with skim milk and honey β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Matcha latte with skim milk and honey Γ—1 (oz) 8 cal Β· 0.4g P Β· 1.2g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:50:08.770Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log pita." (difficulty β€”)3.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.3s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:50:23.186Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a fish sandwich." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a fish sandwich? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:50:37.020Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had flatbread." (difficulty β€”)0.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:50:48.769Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a scone with jam." (difficulty β€”)2.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a scone with jam? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:51:02.670Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual coffee size." (difficulty β€”)5.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.5s
1 Β· TTS said no speech captured
2 Β· Card shown I found a likely match for i had the usual lunch size, but I still need a clearer amount or product detail before I can log it. What exact food and amount should I use? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: coffee
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-coffee-confirm",
        "name": "coffee",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "log my usual coffee size",
      "foodItemId": "seed-e-coffee-confirm",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "log my usual coffee size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:51:19.420Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add the regular breakfast portion." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged breakfast portion. Using your saved "add the regular breakfast portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast portion Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: breakfast portion
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-bfast-portion",
        "name": "breakfast portion",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "add the regular breakfast portion",
      "foodItemId": "seed-e-bfast-portion",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "add the regular breakfast portion",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:51:30.669Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track my default snack amount." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged snack. Using your saved "track my default snack amount". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: snack
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-snack-amt",
        "name": "snack",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "track my default snack amount",
      "foodItemId": "seed-e-snack-amt",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "track my default snack amount",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:51:41.901Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had the usual lunch size." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged lunch. Using your saved "i had the usual lunch size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: lunch Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: lunch
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-lunch-size",
        "name": "lunch",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "i had the usual lunch size",
      "foodItemId": "seed-e-lunch-size",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "i had the usual lunch size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-07-30T20:51:53.153Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Half a cup." (difficulty β€”)0.4s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown I found a likely match for one and a half cups cantaloupe, but I still need a clearer amount or product detail before I can log it. What exact food and amount should I use? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:52:04.736Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One cup, plain." (difficulty β€”)0.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:52:15.919Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"The Built puff coconut." (difficulty β€”)2.4s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown Got it. For "The Built puff coconut," please specify the exact amount or serving you had β€” for example: "one bar," "a single serving," or "half a bar." Once you provide that, you can use the app's food logging command to log it.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:52:29.469Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Unsweetened soy milk." (difficulty β€”)1.9s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Soy Milk, Unsweetened β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Soy Milk, Unsweetened Γ—1 (1 cup) 93 cal Β· 8.8g P Β· 3.2g C Β· 5.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:52:42.503Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"No, that's not it β€” the unsweetened one." (difficulty β€”)5.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.0s
1 Β· TTS said no speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:52:58.669Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Wrong one. The mango, not pineapple." (difficulty β€”)0.6s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Mango and Pineapple. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
created food_log_entry: Pineapple Γ—1 (100 g) 50 cal Β· 0.5g P Β· 13.1g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:53:10.369Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"No, not the flavored quark." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:53:21.584Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Cancel that." (difficulty β€”)0.0s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pending Food Item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-e-corr-pending-3",
        "name": "Pending Food Item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-e-corr-pending-3 at 2026-07-18T11:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-e-corr-pending-3",
      "quantity": 1,
      "loggedAt": "2026-07-18T11:00:00.000Z"
    }
snapshot captured 2026-07-30T20:53:48.185Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"No, that's not the bar I meant." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:54:10.618Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not the large β€” the medium mango." (difficulty β€”)5.3s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Mango? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:54:27.016Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"Wrong item. Pick the grilled mahi." (difficulty β€”)5.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:54:43.983Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"That's not it; the plain one." (difficulty β€”)3.9s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said no speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:55:10.184Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"No, the other pita." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:55:21.402Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"Not those pecans β€” the raw ones." (difficulty β€”)5.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:55:49.501Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the mango from earlier." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not find a list matching earlier. Which list has mango?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:56:11.851Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove that Built bar." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. FAIL: WRONG ACTION β€” created/logged a NEW entry on a DELETE request.
Why verdict WRONG ACTION β€” created/logged a NEW entry on a DELETE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Deleted Built Bar Chocolate.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:56:30.315Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the cream of wheat entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:56:34.517Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)