πŸ“Š Status Dashboard ↑ all runs

food-corpus-b-FROZEN-20260712-57288df3-c49-20260801

food-corpus-b-FROZEN-20260712 Β· 5 minutes ago Β· iOS sim
Rows
300
Pass
154 (51%)
Fail
88 (29%)
Unverified
58 (19%)
Pass rate
64%
Avg difficulty
β€”
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β€” needs a human look (that's you πŸ‘/πŸ‘Ž-ing it). "Pass rate" = pass Γ· (pass + fail) β€” it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 58 unclassified β€” the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened β€” comprehension vs execution vs cosmetic

Comprehension β€” picked the wrong action/target (the hard problem)
88 (100%)
Of 88 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? β€” by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
β–Έ LOG β€” log the entry 18096 (53%) 62 (34%) 22 (12%)
β–Έ CLARIFY β€” ask a clarifying question 2522 (88%) 3 (12%) 0 (0%)
β–Έ QUERY β€” answer the query 202 (10%) 3 (15%) 15 (75%)
β–Έ UPDATE β€” update the entry 156 (40%) 9 (60%) 0 (0%)
β–Έ CLARIFY_ANSWER β€” complete the pending action 126 (50%) 0 (0%) 6 (50%)
β–Έ DELETE β€” delete the entry 100 (0%) 10 (100%) 0 (0%)
β–Έ SETTINGS β€” apply the setting 104 (40%) 1 (10%) 5 (50%)
β–Έ OTHER β€” handle appropriately 104 (40%) 0 (0%) 6 (60%)
β–Έ NAVIGATE β€” navigate 106 (60%) 0 (0%) 4 (40%)
β–Έ DECLINE β€” decline 88 (100%) 0 (0%) 0 (0%)
Total300154 (64%)8858

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) β€” this bar chart lights up once that lands.

Clarification follow-ups β€” scored separately

Second turn: app asked, we replied β€” did it resolve correctly?
Follow-ups
12
Resolved
6 (50%)
Mishandled
0 (0%)
Unverified
6

Cosmetic only

Not yet classified β€” pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified β€” pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
1.3s
p90
3.7s
Max
11.9s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β€” click any dot to jump to its detail.
0s
1s
2s
5s
10s
12s
Response path β€” quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
275
Sync clarification
25
Slowest 8 utterances (click to jump to detail):
"Update the pasta sauce to pesto instead of marinara."11.9s
"I had sushi: 6 salmon avocado pieces and miso soup."6.8s
"Log one Blue Diamond 100 calorie almond pack."6.7s
"Add Greek plate: chicken souvlaki, pita, tzatziki, rice, and Greek salad."6.6s
"Add 2 tablespoons powdered creamer to my coffee."6.3s
"Correction: those were turkey meatballs, not beef."6.3s
"Log acai bowl: acai base, banana, granola, almond butter, coconut."6.2s
"Add olive oil to that salad, one tablespoon."6.1s

Filter β€” controls the list below

Pass / Fail / Unverified
PASS 154 FAIL 88 UNVERIFIED 58
Module (intended for)
Food (300)
Utterance sub-type (within module)
300 shown β€” 154 pass, 88 fail, 58 unverified

Per-utterance detail

PASSshould log the entry"Log 170 grams plain nonfat Greek yogurt." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Nonfat Greek yogurt, Nonfat Greek yogurt β€” card not captured.
Why verdict Logged (write-truth verified): Nonfat Greek yogurt, Nonfat Greek yogurt β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 170 grams plain nonfat greek yogurt.
3 Β· App data rows written created food_log_entry: Nonfat Greek yogurt Γ—1 (170 g) 100 cal Β· 17.5g P Β· 6.1g C Β· 0.7g F
created food_log_entry: Nonfat Greek yogurt Γ—1 (170 g) 100 cal Β· 17.5g P Β· 6.1g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:27:49.331Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate 2 slices sourdough toast with 14 grams butter." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 530 kcal is implausibly HIGH for 2 count of Toast (typical 160-260 kcal [per-serving])
Why verdict WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 530 kcal is implausibly HIGH for 2 count of Toast (typical 160-260 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Toast and 14 grams butter. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Toast Γ—2 (100 g) 530 cal Β· 18g P Β· 98g C Β· 6.4g F
created food_log_entry: Butter Γ—1 (14 g) 100 cal Β· 0.1g P Β· 0g C Β· 11.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:28:00.911Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 3.5 ounces roasted turkey breast." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey breast β€” card not captured.
Why verdict Logged (write-truth verified): Turkey breast β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 3.5 ounces roasted turkey breast.
3 Β· App data rows written created food_log_entry: Turkey breast Γ—1 (3.5 oz) 134 cal Β· 28.8g P Β· 0g C Β· 1.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:28:12.191Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was 45 grams dry rolled oats cooked with water." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Dry oats? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:28:25.655Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add one large navel orange." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Orange? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:28:42.193Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 220 grams cooked jasmine rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked jasmine rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked jasmine rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 220 grams cooked jasmine rice.
3 Β· App data rows written created food_log_entry: Cooked jasmine rice Γ—1 (220 g) 286 cal Β· 5.3g P Β· 62g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:28:53.529Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"For lunch I had 6 ounces grilled flank steak." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Grilled Steak β€” card not captured.
Why verdict Logged (write-truth verified): Grilled Steak β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Grilled Steak. Using your recent Grilled Steak history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Grilled Steak Γ—1 (ounce) 340 cal Β· 42g P Β· 0g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:29:05.024Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down 85 grams avocado." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Avocado β€” card not captured.
Why verdict Logged (write-truth verified): Avocado β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 85 grams avocado.
3 Β· App data rows written created food_log_entry: Avocado Γ—1 (85 g) 136 cal Β· 1.7g P Β· 7.2g C Β· 12.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:29:16.330Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had a cup and a half of cooked lentils." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Lentils β€” card not captured.
Why verdict Logged (write-truth verified): Lentils β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a cup and a half of cooked lentils. Assumed 1.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Lentils Γ—1 (1.5 cup) 345 cal Β· 26.7g P Β· 59.7g C Β· 1.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:29:27.861Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 28 grams cheddar cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cheddar cheese, Cheddar cheese β€” card not captured.
Why verdict Logged (write-truth verified): Cheddar cheese, Cheddar cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 28 grams cheddar cheese.
3 Β· App data rows written created food_log_entry: Cheddar cheese Γ—1 (28 g) 113 cal Β· 6.4g P Β· 1g C Β· 9.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:29:39.177Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 12 baby carrots and 2 tablespoons hummus." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Baby carrots, Hummus, Plain β€” card not captured.
Why verdict Logged (write-truth verified): Baby carrots, Hummus, Plain β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 12 baby carrots and Hummus, Plain.
3 Β· App data rows written created food_log_entry: Baby carrots Γ—1 (12 baby carrots) 42 cal Β· 0.7g P Β· 9.8g C Β· 0.1g F
created food_log_entry: Hummus, Plain Γ—1 (2 tablespoons (30 g)) 73 cal Β· 2.2g P Β· 4.5g C Β· 5.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:29:52.410Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track a 9 ounce baked potato, plain." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Potato β€” card not captured.
Why verdict Logged (write-truth verified): Potato β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a 9 ounce baked potato plain.
3 Β· App data rows written created food_log_entry: Potato Γ—1 (9 oz) 222 cal Β· 4.8g P Β· 51.3g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:30:04.340Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was 5 ounces cod plus 160 grams roasted potatoes." (difficulty β€”)6.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.0s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Cod? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:30:21.535Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup cooked quinoa." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked quinoa β€” card not captured.
Why verdict Logged (write-truth verified): Cooked quinoa β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup cooked quinoa. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked quinoa Γ—1 (1 cup) 222 cal Β· 8.1g P Β· 39.4g C Β· 3.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:30:32.788Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 2 cups romaine and 30 grams parmesan." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Romaine lettuce, Parmesan cheese β€” card not captured.
Why verdict Logged (write-truth verified): Romaine lettuce, Parmesan cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 cups romaine and 30 grams parmesan.
3 Β· App data rows written created food_log_entry: Romaine lettuce Γ—1 (2 cup) 16 cal Β· 1.1g P Β· 3.1g C Β· 0.3g F
created food_log_entry: Parmesan cheese Γ—1 (30 g) 124 cal Β· 9g P Β· 2.5g C Β· 8.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:30:44.197Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 150 grams blueberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blueberries β€” card not captured.
Why verdict Logged (write-truth verified): Blueberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 150 grams blueberries.
3 Β· App data rows written created food_log_entry: Blueberries Γ—1 (150 g) 86 cal Β· 1g P Β· 21.8g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:30:55.481Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record three scrambled eggs cooked with a teaspoon olive oil." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Olive oil, Egg β€” card not captured.
Why verdict Logged (write-truth verified): Olive oil, Egg β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged three scrambled eggs cooked and a teaspoon olive oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F
created food_log_entry: Olive oil Γ—1 (1 tsp) 40 cal Β· 0g P Β· 0g C Β· 4.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:31:07.155Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track 7 ounces rotisserie chicken, meat only." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "7 ounces rotisserie chicken meat only" β€” no saved row with matching identity (rows: Pork, Cured, Ham with Natural Juices, Spiral Slice, Meat Only, Boneless, Separable Lean Only, Heated, Roasted, Chicken breast)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "7 ounces rotisserie chicken meat only" β€” no saved row with matching identity (rows: Pork, Cured, Ham with Natural Juices, Spiral Slice, Meat Only, Boneless, Separable Lean Only, Heated, Roasted, Chicken breast)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Chicken breast and Pork, Cured, Ham with Natural Juices, Spiral Slice, Meat Only, Boneless, Separable Lean Only, Heated, Roasted. Assumed a typical serving of Pork, Cured, Ham with Natural Juices, Spiral Slice, Meat Only, Boneless, Separable Lean Only, Heated, Roasted while logging the rest of this meal. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Chicken breast Γ—1 (7 ounces (198.4 g)) 327 cal Β· 61.5g P Β· 0g C Β· 7.1g F
created food_log_entry: Pork, Cured, Ham with Natural Juices, Spiral Slice, Meat Only, Boneless, Separable Lean Only, Heated, Roasted Γ—1 (3 serving) 107 cal Β· 19.2g P Β· 0.9g C Β· 3.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:31:18.970Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was 32 grams almonds." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Almonds β€” card not captured.
Why verdict Logged (write-truth verified): Almonds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 32 grams almonds.
3 Β· App data rows written created food_log_entry: Almonds Γ—1 (32 g) 185 cal Β· 6.8g P Β· 6.9g C Β· 16g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:31:30.298Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log 250 milliliters whole milk." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't convert 250 milliliters of Whole milk from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:31:41.582Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had 1 tablespoon peanut butter on a medium banana." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Banana, Peanut butter β€” card not captured.
Why verdict Logged (write-truth verified): Banana, Peanut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 tablespoon peanut butter and a medium banana. Assumed 1 medium banana as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Peanut butter Γ—1 (1 tbsp) 88 cal Β· 3.8g P Β· 2.9g C Β· 7.6g F
created food_log_entry: Banana Γ—1 (1 medium banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:32:04.582Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record 100 grams cooked pasta with 125 grams marinara." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown I found Cooked pasta, but I also heard 125 marinara. Should I log those separately too?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:32:16.743Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 4 ounces tofu and 2 cups broccoli." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Broccoli, Firm tofu β€” card not captured.
Why verdict Logged (write-truth verified): Broccoli, Firm tofu β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 4 ounces tofu and 2 cups broccoli.
3 Β· App data rows written created food_log_entry: Firm tofu Γ—1 (4 oz) 163 cal Β· 19.3g P Β· 3.2g C Β· 9.9g F
created food_log_entry: Broccoli Γ—1 (2 cup) 64 cal Β· 4.4g P Β· 13.1g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:32:28.124Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 1 cup black beans drained." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Black beans, Black beans β€” card not captured.
Why verdict Logged (write-truth verified): Black beans, Black beans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup black beans drained.
3 Β· App data rows written created food_log_entry: Black beans Γ—1 (1 cup) 227 cal Β· 15.3g P Β· 40.8g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:32:39.455Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down 60 grams granola." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Granola β€” card not captured.
Why verdict Logged (write-truth verified): Granola β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 60 grams granola.
3 Β· App data rows written created food_log_entry: Granola Γ—1 (60 g) 283 cal Β· 6g P Β· 38.4g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:32:50.739Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 180 grams cottage cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cottage cheese β€” card not captured.
Why verdict Logged (write-truth verified): Cottage cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 180 grams cottage cheese.
3 Β· App data rows written created food_log_entry: Cottage cheese Γ—1 (180 g) 176 cal Β· 20g P Β· 6.1g C Β· 7.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:02.060Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one medium pear and 18 grams walnuts." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pear, Walnuts β€” card not captured.
Why verdict Logged (write-truth verified): Pear, Walnuts β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one medium pear and 18 grams walnuts. Assumed 1 pear as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Pear Γ—1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
created food_log_entry: Walnuts Γ—1 (18 g) 118 cal Β· 2.7g P Β· 2.5g C Β· 11.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:13.456Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 2 ounces smoked salmon." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Smoked salmon β€” card not captured.
Why verdict Logged (write-truth verified): Smoked salmon β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 ounces smoked salmon.
3 Β· App data rows written created food_log_entry: Smoked salmon Γ—1 (2 oz) 66 cal Β· 10.4g P Β· 0g C Β· 2.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:24.787Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 1 cup cooked farro." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked farro β€” card not captured.
Why verdict Logged (write-truth verified): Cooked farro β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup cooked farro.
3 Β· App data rows written created food_log_entry: Cooked farro Γ—1 (1 cup) 240 cal Β· 8.6g P Β· 50.7g C Β· 1.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:36.072Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 90 grams cucumber and 90 grams tomato." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Tomato, Cucumber β€” card not captured.
Why verdict Logged (write-truth verified): Tomato, Cucumber β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 90 grams cucumber and 90 grams tomato.
3 Β· App data rows written created food_log_entry: Cucumber Γ—1 (90 g) 14 cal Β· 0.6g P Β· 3.2g C Β· 0.1g F
created food_log_entry: Tomato Γ—1 (90 g) 16 cal Β· 0.8g P Β· 3.5g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:47.480Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 6 ounces pork tenderloin." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pork tenderloin β€” card not captured.
Why verdict Logged (write-truth verified): Pork tenderloin β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 6 ounces pork tenderloin.
3 Β· App data rows written created food_log_entry: Pork tenderloin Γ—1 (6 oz) 243 cal Β· 44.2g P Β· 0g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:33:58.775Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 1 cup edamame shelled." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Edamame β€” card not captured.
Why verdict Logged (write-truth verified): Edamame β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup edamame shelled.
3 Β· App data rows written created food_log_entry: Edamame Γ—1 (1 cup) 188 cal Β· 18.4g P Β· 13.8g C Β· 8.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:34:10.079Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add a small flour tortilla with 50 grams grilled chicken." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chicken breast, Flour tortilla β€” card not captured.
Why verdict Logged (write-truth verified): Chicken breast, Flour tortilla β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged a small flour tortilla and 50 grams grilled chicken. Assumed 1 small flour tortilla as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Flour tortilla Γ—1 (1 small flour tortilla) 74 cal Β· 2g P Β· 12g C Β· 1.9g F
created food_log_entry: Chicken breast Γ—1 (50 g) 83 cal Β· 15.5g P Β· 0g C Β· 1.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:34:21.779Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had 40 grams raisins." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Raisins β€” card not captured.
Why verdict Logged (write-truth verified): Raisins β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 40 grams raisins.
3 Β· App data rows written created food_log_entry: Raisins Γ—1 (40 g) 120 cal Β· 1.2g P Β· 31.7g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:34:33.085Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 2 tablespoons chia seeds." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chia seeds β€” card not captured.
Why verdict Logged (write-truth verified): Chia seeds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 tablespoons chia seeds.
3 Β· App data rows written created food_log_entry: Chia seeds Γ—1 (2 tbsp) 102 cal Β· 3.5g P Β· 8.8g C Β· 6.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:34:44.376Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 5 ounces shrimp cooked." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Shrimp β€” card not captured.
Why verdict Logged (write-truth verified): Shrimp β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 5 ounces shrimp cooked.
3 Β· App data rows written created food_log_entry: Shrimp Γ—1 (5 oz) 140 cal Β· 34g P Β· 0.3g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:34:55.674Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 1 cup unsweetened applesauce." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Unsweetened applesauce β€” card not captured.
Why verdict Logged (write-truth verified): Unsweetened applesauce β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup unsweetened applesauce.
3 Β· App data rows written created food_log_entry: Unsweetened applesauce Γ—1 (1 cup) 102 cal Β· 0.5g P Β· 27.6g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:35:06.990Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add 140 grams sweet potato mash." (difficulty β€”)3.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which one did you mean? 1. Sweet Potato Mash β€” T.G.I. FRIDAY'S, 2. Sweet Potato Mash β€” HUNGRY JACK, 3. Sweet Potato Mash β€” Basic American Foods, Inc.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:35:22.038Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 25 grams dark chocolate." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Dark chocolate β€” card not captured.
Why verdict Logged (write-truth verified): Dark chocolate β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 25 grams dark chocolate.
3 Β· App data rows written created food_log_entry: Dark chocolate Γ—1 (25 g) 138 cal Β· 1.3g P Β· 15g C Β· 8.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:35:33.345Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 2 cups air-popped popcorn." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Air-popped popcorn β€” card not captured.
Why verdict Logged (write-truth verified): Air-popped popcorn β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 cups air popped popcorn.
3 Β· App data rows written created food_log_entry: Air-popped popcorn Γ—1 (2 cup) 62 cal Β· 2.1g P Β· 12.5g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:35:44.651Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 1.25 cups low fat kefir." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Kefir β€” card not captured.
Why verdict Logged (write-truth verified): Kefir β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1.25 cups low fat kefir.
3 Β· App data rows written created food_log_entry: Kefir Γ—1 (1.25 cup) 126 cal Β· 10.1g P Β· 13.8g C Β· 3.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:36:07.449Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 4 ounces tempeh." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Tempeh β€” card not captured.
Why verdict Logged (write-truth verified): Tempeh β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 4 ounces tempeh.
3 Β· App data rows written created food_log_entry: Tempeh Γ—1 (4 oz) 218 cal Β· 23g P Β· 8.6g C Β· 12.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:36:18.729Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add 1 cup canned corn drained." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for 1 cup canned corn drained? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:36:35.273Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had 70 grams turkey pepperoni." (difficulty β€”)1.8s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): APPLEGATE NATURALS* Uncured Turkey Pepperoni β€” card not captured.
Why verdict Logged (write-truth verified): APPLEGATE NATURALS* Uncured Turkey Pepperoni β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said no speech captured
2 Β· Card shown I logged APPLEGATE NATURALS Uncured Turkey Pepperoni (70 grams (70 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: APPLEGATE NATURALS* Uncured Turkey Pepperoni Γ—1 (70 grams (70 g)) 187 cal Β· 23.3g P Β· 0g C Β· 9.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:36:48.179Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 3 cups spinach cooked down." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Spinach β€” card not captured.
Why verdict Logged (write-truth verified): Spinach β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 3 cups spinach cooked down.
3 Β· App data rows written created food_log_entry: Spinach Γ—1 (3 cup) 21 cal Β· 2.6g P Β· 3.2g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:36:59.506Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 2 rice cakes with 1 tablespoon almond butter." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Almond butter, Plain rice cakes β€” card not captured.
Why verdict Logged (write-truth verified): Almond butter, Plain rice cakes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 rice cakes and 1 tablespoon almond butter.
3 Β· App data rows written created food_log_entry: Plain rice cakes Γ—1 (2 rice cakes) 70 cal Β· 1.4g P Β· 14.7g C Β· 0.5g F
created food_log_entry: Almond butter Γ—1 (1 tbsp) 98 cal Β· 3.4g P Β· 3g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:37:11.173Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 120 grams grilled zucchini." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Zucchini β€” card not captured.
Why verdict Logged (write-truth verified): Zucchini β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 120 grams grilled zucchini.
3 Β· App data rows written created food_log_entry: Zucchini Γ—1 (120 g) 20 cal Β· 1.4g P Β· 3.7g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:37:22.506Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add 1 cup beef chili." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:37:33.850Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 4 ounces turkey meatballs." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey meatballs β€” card not captured.
Why verdict Logged (write-truth verified): Turkey meatballs β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 4 ounces turkey meatballs.
3 Β· App data rows written created food_log_entry: Turkey meatballs Γ—1 (4 oz) 210 cal Β· 20.4g P Β· 6.8g C Β· 11.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:37:45.129Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 125 grams mango." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mango β€” card not captured.
Why verdict Logged (write-truth verified): Mango β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 125 grams mango.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (125 g) 75 cal Β· 1g P Β· 18.8g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:37:56.557Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup split pea soup." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Split Pea Soup, Canned, Reduced Sodium, Prepared with Water or Ready-To Serve β€” card not captured.
Why verdict Logged (write-truth verified): Split Pea Soup, Canned, Reduced Sodium, Prepared with Water or Ready-To Serve β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Split Pea Soup, Canned, Reduced Sodium, Prepared with Water or Ready-To Serve (one cup (245 g)) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Split Pea Soup, Canned, Reduced Sodium, Prepared with Water or Ready-To Serve Γ—1 (one cup (245 g)) 174 cal Β· 9.6g P Β· 28.9g C Β· 2.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:38:09.833Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 3 ounces goat cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Goat cheese β€” card not captured.
Why verdict Logged (write-truth verified): Goat cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 3 ounces goat cheese.
3 Β· App data rows written created food_log_entry: Goat cheese Γ—1 (3 oz) 310 cal Β· 18.4g P Β· 0.1g C Β· 25.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:38:21.138Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 2 cups watermelon cubes." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Watermelon β€” card not captured.
Why verdict Logged (write-truth verified): Watermelon β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 cups watermelon cubes.
3 Β· App data rows written created food_log_entry: Watermelon Γ—1 (2 cup) 91 cal Β· 1.8g P Β· 23.1g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:38:32.424Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had 1 cup cooked couscous." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for 1 cup cooked couscous? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:38:46.262Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track 6 ounces tilapia with lemon, no oil." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:38:57.457Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 75 grams sour cream." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sour cream β€” card not captured.
Why verdict Logged (write-truth verified): Sour cream β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 75 grams sour cream.
3 Β· App data rows written created food_log_entry: Sour cream Γ—1 (75 g) 147 cal Β· 2.3g P Β· 4.2g C Β· 13.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:39:08.769Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record 1 cup roasted Brussels sprouts." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Brussels sprouts β€” card not captured.
Why verdict Logged (write-truth verified): Brussels sprouts β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup roasted brussels sprouts.
3 Β· App data rows written created food_log_entry: Brussels sprouts Γ—1 (1 cup) 70 cal Β· 5.4g P Β· 14.4g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:39:20.089Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add half cup ricotta." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Ricotta cheese β€” card not captured.
Why verdict Logged (write-truth verified): Ricotta cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged half cup ricotta. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ—1 (0.5 cup) 182 cal Β· 11.8g P Β· 7.4g C Β· 11.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:39:31.336Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 95 grams grapes." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Grapes β€” card not captured.
Why verdict Logged (write-truth verified): Grapes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 95 grams grapes.
3 Β· App data rows written created food_log_entry: Grapes Γ—1 (95 g) 66 cal Β· 0.7g P Β· 17.2g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:39:42.672Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 4 ounces seitan." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Seitan β€” card not captured.
Why verdict Logged (write-truth verified): Seitan β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 4 ounces seitan.
3 Β· App data rows written created food_log_entry: Seitan Γ—1 (4 oz) 160 cal Β· 28g P Β· 6.7g C Β· 2.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:39:53.979Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 2 cups minestrone soup." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Minestrone soup β€” card not captured.
Why verdict Logged (write-truth verified): Minestrone soup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 cups minestrone soup.
3 Β· App data rows written created food_log_entry: Minestrone soup Γ—1 (2 cup) 191 cal Β· 8.8g P Β· 27.4g C Β· 5.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:40:16.756Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record 45 grams pita chips." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "45 grams pita chips" β€” no saved row with matching identity (rows: Potato Chips)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "45 grams pita chips" β€” no saved row with matching identity (rows: Potato Chips)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Potato Chips (45 grams (45 g)) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Potato Chips Γ—1 (45 grams (45 g)) 241 cal Β· 3.2g P Β· 23.9g C Β· 15.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:40:28.179Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 1 large kiwi." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Kiwi β€” card not captured.
Why verdict Logged (write-truth verified): Kiwi β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 large kiwi.
3 Β· App data rows written created food_log_entry: Kiwi Γ—1 (1 kiwi) 42 cal Β· 0.8g P Β· 10.1g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:40:39.466Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had 3 ounces ham." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Ham β€” card not captured.
Why verdict Logged (write-truth verified): Ham β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 3 ounces ham.
3 Β· App data rows written created food_log_entry: Ham Γ—1 (3 oz) 123 cal Β· 17.9g P Β· 1.3g C Β· 4.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:40:50.763Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 1 cup egg whites." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Egg whites β€” card not captured.
Why verdict Logged (write-truth verified): Egg whites β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup egg whites.
3 Β· App data rows written created food_log_entry: Egg whites Γ—1 (1 cup) 126 cal Β· 26.5g P Β· 1.7g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:41:02.063Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 35 grams sunflower seeds." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sunflower seeds β€” card not captured.
Why verdict Logged (write-truth verified): Sunflower seeds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 35 grams sunflower seeds.
3 Β· App data rows written created food_log_entry: Sunflower seeds Γ—1 (35 g) 204 cal Β· 7.3g P Β· 7g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:41:13.394Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record 2 cups cauliflower rice." (difficulty β€”)3.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which type of cauliflower rice was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:41:28.485Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add 5 ounces lamb chop, cooked weight." (difficulty β€”)3.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve cooked weight before I log this meal. What should I use for cooked weight?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:41:42.741Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate 110 grams pineapple." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pineapple β€” card not captured.
Why verdict Logged (write-truth verified): Pineapple β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 110 grams pineapple.
3 Β· App data rows written created food_log_entry: Pineapple Γ—1 (110 g) 55 cal Β· 0.6g P Β· 14.4g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:41:54.075Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 1 cup baked beans." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Baked beans β€” card not captured.
Why verdict Logged (write-truth verified): Baked beans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup baked beans.
3 Β· App data rows written created food_log_entry: Baked beans Γ—1 (1 cup) 273 cal Β· 11.7g P Β· 56.2g C Β· 2.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:42:05.354Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a Chobani Zero Sugar vanilla cup." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG item/product identity "Chobani Zero Sugar vanilla cup" β€” saved row does not hit product alias (rows: Zero Sugar Vanilla Yogurt)
Why verdict WRITE-TRUTH FAIL β€” WRONG item/product identity "Chobani Zero Sugar vanilla cup" β€” saved row does not hit product alias (rows: Zero Sugar Vanilla Yogurt)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Zero Sugar Vanilla Yogurt β€” Chobani β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Zero Sugar Vanilla Yogurt Γ—1 (cup) 120 cal Β· 15g P Β· 9g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:42:16.994Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had a Quest chocolate chip cookie dough protein bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Quest Chocolate Chip Cookie Dough Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): Quest Chocolate Chip Cookie Dough Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Quest Chocolate Chip Cookie Dough Protein Bar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Quest Chocolate Chip Cookie Dough Protein Bar Γ—1 (one) 190 cal Β· 21g P Β· 22g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:42:28.771Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record one Fairlife Core Power 26 gram vanilla shake." (difficulty β€”)1.6s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 15 kcal is implausibly LOW for 1 count of Fairlife Core Power Elite Vanilla Protein Shake (typical 160-250 kcal [per-serving])
Why verdict WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 15 kcal is implausibly LOW for 1 count of Fairlife Core Power Elite Vanilla Protein Shake (typical 160-250 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Fairlife Core Power Elite Vanilla Protein Shake (26 gram (26 g)) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Fairlife Core Power Elite Vanilla Protein Shake Γ—1 (26 gram (26 g)) 15 cal Β· 2.6g P Β· 0.5g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:42:41.474Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Starbucks grande flat white with whole milk." (difficulty β€”)5.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.1s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Whole milk? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:42:57.717Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track a Chipotle chicken bowl: white rice, black beans, mild salsa, cheese, lettuce." (difficulty β€”)2.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for lettuce?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:43:11.713Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a McDonalds Egg McMuffin." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:43:28.284Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate a Taco Bell bean burrito." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a taco bell bean burrito? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:43:42.082Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one RXBAR blueberry protein bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): RXBAR Blueberry Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): RXBAR Blueberry Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged RXBAR Blueberry Protein Bar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: RXBAR Blueberry Protein Bar Γ—1 (1 bar) 210 cal Β· 12g P Β· 24g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:43:53.752Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add a Premier Protein caramel shake." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Caramel High Protein Shake β€” card not captured.
Why verdict Logged (write-truth verified): Caramel High Protein Shake β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Caramel High Protein Shake β€” premier protein β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Caramel High Protein Shake Γ—1 (1 portion (311.844 g)) 159 cal Β· 29.9g P Β· 1.9g C Β· 3.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:44:06.006Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one Dave’s Killer Bread thin-sliced Good Seed slice." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:44:23.170Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a Siggi’s strawberry skyr cup." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:44:46.101Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had a Panera Fuji apple salad with chicken, full size." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said no speech captured
2 Β· Card shown Which full size should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:44:59.001Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record one Celsius peach vibe can." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Record One Celsius Peach Vibe Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:45:10.864Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Kodiak Cakes protein waffle, one waffle." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG item/product identity "Kodiak Cakes protein waffle" β€” saved row does not hit product alias (rows: Waffle, Plain, Birthday Cake Power Waffles With Sprinkles)
Why verdict WRITE-TRUTH FAIL β€” WRONG item/product identity "Kodiak Cakes protein waffle" β€” saved row does not hit product alias (rows: Waffle, Plain, Birthday Cake Power Waffles With Sprinkles)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Birthday Cake Power Waffles With Sprinkles β€” KODIAK and Waffle, Plain. Assumed Birthday Cake Power Waffles With Sprinkles β€” KODIAK for "a Kodiak Cakes protein waffle" (best matching option). Tell me if that is wrong. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Birthday Cake Power Waffles With Sprinkles Γ—1 (1 waffle) 230 cal Β· 10g P Β· 27g C Β· 9g F
created food_log_entry: Waffle, Plain Γ—1 (1 small waffle) 149 cal Β· 3.5g P Β· 16.6g C Β· 7.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:45:24.328Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track a Subway six inch turkey on wheat with provolone." (difficulty β€”)3.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a subway six inch turkey on wheat with provolone? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:45:38.495Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one KIND dark chocolate nuts and sea salt bar." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG item/product identity "KIND dark chocolate nuts" β€” saved row does not hit product alias (rows: No Cow Chocolate Sea Salt Bar, Dark chocolate)
Why verdict WRITE-TRUTH FAIL β€” WRONG item/product identity "KIND dark chocolate nuts" β€” saved row does not hit product alias (rows: No Cow Chocolate Sea Salt Bar, Dark chocolate)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Dark chocolate and No Cow Chocolate Sea Salt Bar β€” No Cow. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Dark chocolate Γ—1 (100 g) 550 cal Β· 5.1g P Β· 60g C Β· 32.2g F
created food_log_entry: No Cow Chocolate Sea Salt Bar Γ—1 (1 bar (60 g)) 210 cal Β· 20g P Β· 23g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:45:50.163Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate a Trader Joe’s chicken tikka masala frozen meal." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a trader joes chicken tikka masala frozen meal? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:46:06.726Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one Oikos Triple Zero mixed berry yogurt." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mixed Berry Flavor Triple Zero Blended Greek Nonfat Yogurt β€” card not captured.
Why verdict Logged (write-truth verified): Mixed Berry Flavor Triple Zero Blended Greek Nonfat Yogurt β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Mixed Berry Flavor Triple Zero Blended Greek Nonfat Yogurt β€” OIKOS β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Mixed Berry Flavor Triple Zero Blended Greek Nonfat Yogurt Γ—1 (1 cup) 101 cal Β· 15g P Β· 10.1g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:46:18.659Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Wendy’s small chili." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a wendys small chili? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:46:32.544Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one Clif Builder chocolate mint bar." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Builder'S Protein Chocolate Mint Bar β€” card not captured.
Why verdict Logged (write-truth verified): Builder'S Protein Chocolate Mint Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Builder'S Protein Chocolate Mint Bar β€” Clif Bar and Company β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Builder'S Protein Chocolate Mint Bar Γ—1 (1 BAR) 270 cal Β· 20g P Β· 30g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:46:44.192Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a Sweetgreen harvest bowl." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a sweetgreen harvest bowl? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:46:58.036Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had one Larabar apple pie bar." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 198 kcal is implausibly HIGH for 1 count of Apple Pie Fruit & Nut Bar (typical 60-130 kcal [per-serving])
Why verdict WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 198 kcal is implausibly HIGH for 1 count of Apple Pie Fruit & Nut Bar (typical 60-130 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Apple Pie Fruit & Nut Bar β€” Larabar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Apple Pie Fruit & Nut Bar Γ—1 (1 bar (45 g)) 198 cal Β· 4.1g P Β· 24.8g C Β· 9.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:47:09.602Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record a Dunkin medium iced coffee: cream plus sugar." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a dunkin medium iced coffee cream plus sugar? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:47:23.519Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Kirkland protein bar chocolate brownie." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:47:35.022Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track a Five Guys little cheeseburger." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a five guys little cheeseburger? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:47:49.207Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one Blue Diamond 100 calorie almond pack." (difficulty β€”)6.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.7s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Blue Diamond 100 Calorie Almond Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:48:06.993Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate a Lean Cuisine herb roasted chicken meal." (difficulty β€”)3.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a lean cuisine herb roasted chicken meal? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:48:21.738Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record one Gatorade Zero 20 ounce bottle." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Record One Gatorade Zero 20 Ounce Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:48:34.845Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Shake Shack single ShackBurger." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a shake shack single shackburger? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:48:48.737Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track a Noosa lemon yogurt 8 ounce tub." (difficulty β€”)3.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:49:03.678Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a Costco rotisserie chicken breast serving, 6 ounces." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Chicken breast? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:49:31.860Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had a Jimmy Johns turkey tom unwich." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Jimmy John's #4 Turkey Tom, Unwich β€” card not captured.
Why verdict Logged (write-truth verified): Jimmy John's #4 Turkey Tom, Unwich β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said no speech captured
2 Β· Card shown I logged Jimmy John's #4 Turkey Tom, Unwich β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Jimmy John's #4 Turkey Tom, Unwich Γ—1 (a) 250 cal Β· 15g P Β· 5g C Β· 17g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:49:45.324Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one Orgain creamy chocolate protein shake." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): ORGAIN Organic Protein Shake, Creamy Chocolate, ORGAIN Organic Protein Shake, Creamy Chocolate β€” card not captured.
Why verdict Logged (write-truth verified): ORGAIN Organic Protein Shake, Creamy Chocolate, ORGAIN Organic Protein Shake, Creamy Chocolate β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged ORGAIN Organic Protein Shake, Creamy Chocolate β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: ORGAIN Organic Protein Shake, Creamy Chocolate Γ—1 (1 orgain creamy chocolate protein shake) 149 cal Β· 26.1g P Β· 14.1g C Β· 4.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:49:56.996Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Nature Valley oats and honey two-bar pack." (difficulty β€”)2.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.9s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve honey two-bar pack before I log this meal. What should I use for honey two-bar pack?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:50:11.017Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track a Whole Foods salmon avocado roll." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Avocado? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:50:27.550Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one PopCorners sea salt snack bag." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:50:39.930Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate a Chick-fil-A grilled chicken sandwich." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chick Fil A Grilled Chicken Sandwich β€” card not captured.
Why verdict Logged (write-truth verified): Chick Fil A Grilled Chicken Sandwich β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Chick Fil A Grilled Chicken Sandwich β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Chick Fil A Grilled Chicken Sandwich Γ—1 (assumed catalog serving (218 g)) 380 cal Β· 28g P Β· 43g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:50:51.570Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from restaurant menu.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record a Muscle Milk chocolate 14 ounce bottle." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Non-Dairy Protein Shake Chocolate Zero Sugar 414ml Bottle β€” card not captured.
Why verdict Logged (write-truth verified): Non-Dairy Protein Shake Chocolate Zero Sugar 414ml Bottle β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Non-Dairy Protein Shake Chocolate Zero Sugar 414ml Bottle β€” Muscle milk (1 bottle (1 bottle (414 g))) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Non-Dairy Protein Shake Chocolate Zero Sugar 414ml Bottle Γ—1 (1 bottle (1 bottle (414 g))) 170 cal Β· 24.8g P Β· 11.2g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:51:03.702Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from open food facts.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add a Banza chickpea pasta serving, 2 ounces dry." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve 2 ounces dry before I log this meal. What should I use for 2 ounces dry?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:51:16.181Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one Halo Top vanilla bean pint, half the pint." (difficulty β€”)3.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.4s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for one Halo Top vanilla bean pint? I did not log it yet because I could not match it safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:51:30.710Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log my turkey sandwich: two slices rye, 4 ounces turkey, one slice Swiss, mustard." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "rye bread" β€” no saved row with matching identity (rows: Turkey Sandwich); WRONG/MISSING item "swiss" β€” no saved row with matching identity (rows: Turkey Sandwich); WRONG/MISSING item "mustard" β€” no saved row with matching identity (rows: Turkey Sandwich)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "rye bread" β€” no saved row with matching identity (rows: Turkey Sandwich); WRONG/MISSING item "swiss" β€” no saved row with matching identity (rows: Turkey Sandwich); WRONG/MISSING item "mustard" β€” no saved row with matching identity (rows: Turkey Sandwich)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Turkey Sandwich. Using your recent Home default Turkey Sandwich history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Turkey Sandwich Γ—1 (sandwich) 380 cal Β· 26g P Β· 38g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:51:43.104Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner bowl: 150 grams rice, 120 grams chicken, 80 grams avocado, salsa, 30 grams cheese." (difficulty β€”)3.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said no speech captured
2 Β· Card shown You can log that in the app by saying: β€œLog dinner: 150 grams rice, 120 grams chicken, 80 grams avocado, salsa, 30 grams cheese.” If any of those foods aren’t recognized, the app will ask for clarification. Would you like me to help estimate the macros for that bowl before you log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:51:58.031Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add homemade smoothie: banana, 1 cup whole milk, 30 grams peanut butter, and a scoop whey." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Homemade Smoothie, Peanut butter, Whole milk, Banana, Whey protein powder β€” card not captured.
Why verdict Logged (write-truth verified): Homemade Smoothie, Peanut butter, Whole milk, Banana, Whey protein powder β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Homemade Smoothie. Includes one banana, 1 cup whole milk, 30 grams peanut butter, and a scoop whey.
3 Β· App data rows written created food_log_entry: Homemade Smoothie Γ—1 (serving) 540 cal Β· 41.5g P Β· 45.7g C Β· 24.1g F
created food_log_entry: Banana Γ—1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
created food_log_entry: Whole milk Γ—1 (1 cup) 149 cal Β· 7.8g P Β· 11.7g C Β· 8.1g F
created food_log_entry: Peanut butter Γ—1 (30 g) 176 cal Β· 7.5g P Β· 5.9g C Β· 15.1g F
created food_log_entry: Whey protein powder Γ—1 (1 scoop) 110 cal Β· 24.9g P Β· 1g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:52:09.654Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record my omelet: 2 eggs, 50 grams mushrooms, 30 grams feta, spinach." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Spinach, Egg, Omelet, Mushrooms, Feta cheese β€” card not captured.
Why verdict Logged (write-truth verified): Spinach, Egg, Omelet, Mushrooms, Feta cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Omelet. Includes 2 eggs, 50 grams mushrooms, 30 grams feta, and Spinach.
3 Β· App data rows written created food_log_entry: Omelet Γ—1 (serving) 240 cal Β· 19.4g P Β· 4.7g C Β· 16.2g F
created food_log_entry: Egg Γ—1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F
created food_log_entry: Mushrooms Γ—1 (50 g) 11 cal Β· 1.6g P Β· 1.7g C Β· 0.2g F
created food_log_entry: Feta cheese Γ—1 (30 g) 79 cal Β· 4.3g P Β· 1.2g C Β· 6.4g F
created food_log_entry: Spinach Γ—1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:52:23.864Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track tacos: three corn tortillas, 5 ounces carne asada, onions, cilantro, and salsa verde." (difficulty β€”)2.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for 5 ounces carne asada?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:52:37.575Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log salad: 4 cups arugula, 120 grams grilled shrimp, 20 grams walnuts, balsamic." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Arugula, Walnuts, Balsamic vinegar, Shrimp, Salad β€” card not captured.
Why verdict Logged (write-truth verified): Arugula, Walnuts, Balsamic vinegar, Shrimp, Salad β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Salad. Includes 4 cups arugula, 120 grams grilled shrimp, 20 grams walnuts, and Balsamic vinegar.
3 Β· App data rows written created food_log_entry: Salad Γ—1 (serving) 284 cal Β· 34g P Β· 8.6g C Β· 14g F
created food_log_entry: Arugula Γ—1 (4 cup) 20 cal Β· 2.1g P Β· 3g C Β· 0.6g F
created food_log_entry: Shrimp Γ—1 (120 g) 119 cal Β· 28.8g P Β· 0.2g C Β· 0.4g F
created food_log_entry: Walnuts Γ—1 (20 g) 131 cal Β· 3g P Β· 2.7g C Β· 13g F
created food_log_entry: Balsamic vinegar Γ—1 (16 g) 14 cal Β· 0.1g P Β· 2.7g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:52:49.196Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"I had ramen: noodles, broth, one egg, pork belly, and corn." (difficulty β€”)2.8s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for broth?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:53:03.078Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Record burrito bowl: brown rice, pinto beans, steak, guacamole, fajita veggies, and queso." (difficulty β€”)3.3s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.3s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for fajita veggies?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:53:17.571Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Add pasta dinner: 2 cups spaghetti, meat sauce, parmesan, and a side salad." (difficulty β€”)4.3s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logging your pasta dinner: 2 cups spaghetti, meat sauce, parmesan, and a side salad β€” still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: pasta dinner: 2 cups spaghetti, meat sauce, parmesan, and a side salad (pending)
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:53:39.958Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Track breakfast plate: two waffles, maple syrup, bacon, and strawberries." (difficulty β€”)4.5s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logging your Track breakfast plate: two waffles, maple syrup, bacon, and strawberries β€” still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: Track breakfast plate: two waffles, maple syrup, bacon, and strawberries (pending)
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:53:55.543Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Log poke bowl with sushi rice, tuna, edamame, cucumber, avocado, spicy mayo." (difficulty β€”)2.5s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said no speech captured
2 Β· Card shown Which tuna should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:54:13.695Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"I ate chicken curry plus 1.5 cups basmati rice plus naan." (difficulty β€”)3.1s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for chicken curry plus 1.5 cups basmati rice plus naan? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:54:27.927Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record burger night: bun, 6 ounce beef patty, cheddar, ketchup, and fries." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for bun?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:54:41.081Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Add Greek plate: chicken souvlaki, pita, tzatziki, rice, and Greek salad." (difficulty β€”)6.6s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.6s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for greek?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:54:58.831Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Track nachos: tortilla chips, black beans, chicken, queso, jalapenos, sour cream." (difficulty β€”)3.1s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for queso?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:55:13.013Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Log homemade chili: beef, kidney beans, tomato, onion, cheddar." (difficulty β€”)2.4s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown Which kidney beans should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:55:26.526Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had sushi: 6 salmon avocado pieces and miso soup." (difficulty β€”)6.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.8s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for miso?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:55:44.507Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Record breakfast burrito: tortilla, eggs, potatoes, chorizo, cheese, and salsa." (difficulty β€”)1.4s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cheese Pizza Slice. Using your recent Cheese Pizza Slice history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cheese Pizza Slice Γ—0.5 (slice) 285 cal Β· 12g P Β· 32g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:55:57.000Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Add Cobb salad: chicken, egg, bacon, avocado, blue cheese, ranch." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for ranch?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:56:10.857Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Track falafel bowl: hummus, tabbouleh, pita, cucumbers, tahini." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Falafel Bowl. Includes Hummus, Tabbouleh, Pita bread, Cucumber, and Tahini.
3 Β· App data rows written created food_log_entry: Falafel Bowl Γ—1 (serving) 638 cal Β· 19.3g P Β· 70g C Β· 34g F
created food_log_entry: Hummus Γ—1 (100 g) 166 cal Β· 7.9g P Β· 14.3g C Β· 9.6g F
created food_log_entry: Tabbouleh Γ—1 (1 cup) 203 cal Β· 2.6g P Β· 15.5g C Β· 15.5g F
created food_log_entry: Pita bread Γ—1 (60 g) 165 cal Β· 5.5g P Β· 33.4g C Β· 0.7g F
created food_log_entry: Cucumber Γ—1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
created food_log_entry: Tahini Γ—1 (15 g) 89 cal Β· 2.6g P Β· 3.2g C Β· 8.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:56:24.647Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Log pho: beef, rice noodles, broth, bean sprouts, hoisin." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for broth?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:56:38.820Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate enchiladas: two chicken enchiladas, rice, beans, and sour cream." (difficulty β€”)1.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for two chicken enchiladas?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:56:51.898Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Record Thanksgiving plate: turkey, stuffing, mashed potatoes, gravy, green beans, cranberry sauce." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for stuffing?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:57:05.038Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Add Mediterranean wrap: lavash, turkey, hummus, cucumber, tomato, feta." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Mediterranean Wrap. Includes Lavash, Turkey breast, Hummus, Cucumber, one tomato, and Feta cheese.
3 Β· App data rows written created food_log_entry: Mediterranean Wrap Γ—1 (serving) 740 cal Β· 57.4g P Β· 54.8g C Β· 33.5g F
created food_log_entry: Lavash Γ—1 (50 g) 138 cal Β· 4.5g P Β· 28g C Β· 0.6g F
created food_log_entry: Turkey breast Γ—1 (100 g) 135 cal Β· 29g P Β· 0g C Β· 1.7g F
created food_log_entry: Hummus Γ—1 (100 g) 166 cal Β· 7.9g P Β· 14.3g C Β· 9.6g F
created food_log_entry: Cucumber Γ—1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
created food_log_entry: Tomato Γ—1 (1 tomato) 22 cal Β· 1.1g P Β· 4.8g C Β· 0.2g F
created food_log_entry: Feta cheese Γ—1 (100 g) 264 cal Β· 14.2g P Β· 4.1g C Β· 21.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:57:16.868Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Track loaded baked potato: chili, cheddar, sour cream, scallions." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Which chili should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:57:29.163Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Log acai bowl: acai base, banana, granola, almond butter, coconut." (difficulty β€”)6.2s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.2s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for acai base?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:57:46.496Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"I had bibimbap: rice, beef, egg, spinach, carrots, gochujang." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Bibimbap. Includes Cooked white rice, Beef, one egg, Spinach, Baby carrots, and Gochujang.
3 Β· App data rows written created food_log_entry: Bibimbap Γ—1 (serving) 466 cal Β· 33g P Β· 38.6g C Β· 18.4g F
created food_log_entry: Cooked white rice Γ—1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F
created food_log_entry: Beef Γ—1 (85 g) 213 cal Β· 22.1g P Β· 0g C Β· 12.8g F
created food_log_entry: Egg Γ—1 (1 egg) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F
created food_log_entry: Spinach Γ—1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F
created food_log_entry: Baby carrots Γ—1 (10 g) 4 cal Β· 0.1g P Β· 0.8g C Β· 0g F
created food_log_entry: Gochujang Γ—1 (18 g) 40 cal Β· 0.9g P Β· 8.3g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:57:58.363Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Record tuna melt: sourdough, tuna salad, cheddar, tomato, and side chips." (difficulty β€”)5.7s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.7s
1 Β· TTS said no speech captured
2 Β· Card shown Which tuna salad should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:58:15.144Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Add antipasto plate: salami, mozzarella, olives, peppers, crackers." (difficulty β€”)3.3s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.3s
1 Β· TTS said no speech captured
2 Β· Card shown Which salami should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:58:29.529Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Track breakfast bowl: oats, protein powder, blueberries, chia, and honey." (difficulty β€”)1.5s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Whey protein powder. Using your recent Whey protein powder history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Whey protein powder Γ—1 (1 scoop) 110 cal Β· 24.9g P Β· 1g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:58:42.148Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of cereal." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said no speech captured
2 Β· Card shown Did you have milk, yogurt, fruit, or honey with the cereal or granola? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:59:06.041Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had some pasta." (difficulty β€”)3.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.5s
1 Β· TTS said no speech captured
2 Β· Card shown How much some pasta did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:59:20.691Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add chicken." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Chicken breast? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:59:31.887Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record a smoothie." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Which type of smoothie was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:59:44.191Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track curry." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown How much curry did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T22:59:56.148Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log coffee." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Coffee? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:00:07.422Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a sandwich." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which type of sandwich was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:00:19.481Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add soup." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown How much soup did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:00:31.487Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record a protein shake." (difficulty β€”)4.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Record A Protein Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:00:46.972Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a salad." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said no speech captured
2 Β· Card shown I logged salad β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Salad Γ—1 (serving) 101 cal Β· 2.1g P Β· 11.9g C Β· 5.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:00:59.110Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log leftovers." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for leftovers? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:01:10.979Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I ate the usual snack." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: WRONG item vs seeded default/key β€” WRONG/MISSING item "usual snack" β€” no saved row with matching identity (rows: Coffee)
Why verdict WRONG item vs seeded default/key β€” WRONG/MISSING item "usual snack" β€” no saved row with matching identity (rows: Coffee)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Coffee. Using your recent Coffee history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Coffee Γ—1 (cup) 5 cal Β· 0g P Β· 1g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:01:22.236Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add rice." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Cooked white rice? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:01:33.490Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record noodles." (difficulty β€”)2.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said no speech captured
2 Β· Card shown How much noodles did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:01:46.902Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a slice." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown I couldn't find Track A Bread Slice in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic bread.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:01:58.760Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log dip." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for dip? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:02:10.872Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a latte." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which type of latte was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:02:22.950Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Add one serving of chips." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Potato Chips β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Potato Chips Γ—1 (ounce) 150 cal Β· 2g P Β· 15g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:02:35.424Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record dinner." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for dinner? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:02:47.136Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track sauce." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown How much sauce did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:02:59.401Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl from Chipotle." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:03:23.419Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I ate my meal prep." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: WRONG item vs seeded default/key β€” WRONG/MISSING item "meal prep" β€” no saved row with matching identity (rows: Chicken Salad Meal)
Why verdict WRONG item vs seeded default/key β€” WRONG/MISSING item "meal prep" β€” no saved row with matching identity (rows: Chicken Salad Meal)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Chicken Salad Meal. Using your recent Home default Chicken Salad Meal history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Salad Meal Γ—1 (serving) 410 cal Β· 38g P Β· 16g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:03:34.886Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a scoop." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for a scoop? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:03:46.840Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record cereal with milk." (difficulty β€”)1.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said no speech captured
2 Β· Card shown How much cereal with milk did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:03:59.831Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track the rest of the pizza." (difficulty β€”)3.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:04:14.311Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Two cups, cooked." (difficulty β€”)0.7s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:04:44.711Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"It was a turkey sandwich: Swiss plus mustard." (difficulty β€”)4.7s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.7s
1 Β· TTS said no speech captured
2 Β· Card shown Which exact a turkey sandwich: swiss plus mustard should replace Chicken Salad Meal?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:05:14.805Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"A grande latte with oat milk." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown What should I use for Replay setup: Replay setup: I had? I did not log it yet because I could not match it safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:05:40.230Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"About 150 grams cooked." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked white rice.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ—1 (150 g) 195 cal Β· 4.1g P Β· 42g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:06:02.625Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"It was chicken noodle soup, one and a half cups." (difficulty β€”)0.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written update_sync_failed food_log_entry: Cooked white rice
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:06:27.146Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Use the Quest chocolate one." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve Replay setup: Replay setup: Record before I log this meal. What should I use for Replay setup: Replay setup: Record?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:06:55.451Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Half a cup dry before cooking." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked pasta.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ—1 (0.5 cup) 110 cal Β· 4.1g P Β· 21.6g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:07:23.008Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Ranch, two tablespoons." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:07:45.258Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"It was two slices of pepperoni pizza." (difficulty β€”)1.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written update_sync_failed food_log_entry: Cooked white rice
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:08:08.650Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Cinnamon Toast Crunch, 55 grams, and one cup 2 percent milk." (difficulty β€”)1.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Toast and one cup 2 percent milk. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Toast Γ—1 (100 g) 265 cal Β· 9g P Β· 49g C Β· 3.2g F
created food_log_entry: 2% milk Γ—1 (1 cup) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:08:34.210Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Chicken, rice, black beans, corn salsa, cheese, and guac." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve Replay setup: Replay setup: Log before I log this meal. What should I use for Replay setup: Replay setup: Log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:08:59.774Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Four ounces grilled chicken breast." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Chicken breast.
3 Β· App data rows written created food_log_entry: Chicken breast Γ—1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:09:22.131Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my usual breakfast." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Instant Oatmeal Packet β€” card not captured.
Why verdict Logged (write-truth verified): Instant Oatmeal Packet β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Quaker Instant Oatmeal Packet. Using your saved "my usual breakfast". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Instant Oatmeal Packet Γ—1 (packet) 150 cal Β· 4g P Β· 27g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-oatmeal-packet",
        "shared_food_id": null,
        "display_name": "Instant Oatmeal Packet",
        "brand": "Quaker",
        "serving_label": "packet",
        "serving_quantity": 1,
        "serving_unit": "packet",
        "macros_per_serving": {
          "calories": 150,
          "proteinGrams": 4,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-usual-breakfast",
        "phrase": "my usual breakfast",
        "user_food_id": "seed-oatmeal-packet",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "packet",
          "displayLabel": "my usual breakfast",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-usual-bfast-1",
        "user_food_id": "seed-oatmeal-packet",
        "food_name": "Instant Oatmeal Packet",
        "brand": "Quaker",
        "quantity": 1,
        "serving_label": "packet",
        "macros": {
          "calories": 150,
          "proteinGrams": 4,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:09:33.393Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add the same smoothie as yesterday." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Berry Protein Smoothie β€” card not captured.
Why verdict Logged (write-truth verified): Berry Protein Smoothie β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Berry Protein Smoothie. Using your recent Berry Protein Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Berry Protein Smoothie Γ—1 (serving) 280 cal Β· 18g P Β· 42g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-berry-smoothie",
        "shared_food_id": null,
        "display_name": "Berry Protein Smoothie",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 18,
          "fatGrams": 6,
          "carbsGrams": 42
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yesterday-smoothie",
        "user_food_id": "seed-berry-smoothie",
        "food_name": "Berry Protein Smoothie",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 280,
          "proteinGrams": 18,
          "fatGrams": 6,
          "carbsGrams": 42
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:09:44.909Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record my normal pre-workout snack." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-preworkout-snack",
        "shared_food_id": null,
        "display_name": "Pre-Workout Snack Pack",
        "brand": "Home default",
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 220,
          "proteinGrams": 12,
          "fatGrams": 8,
          "carbsGrams": 24
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-preworkout-snack",
        "phrase": "my normal pre-workout snack",
        "user_food_id": "seed-preworkout-snack",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "serving",
          "displayLabel": "my normal pre-workout snack",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-preworkout-1",
        "user_food_id": "seed-preworkout-snack",
        "food_name": "Pre-Workout Snack Pack",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 220,
          "proteinGrams": 12,
          "fatGrams": 8,
          "carbsGrams": 24
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeDays": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:09:57.852Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track another one of those turkey wraps." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey Wrap β€” card not captured.
Why verdict Logged (write-truth verified): Turkey Wrap β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Turkey Wrap. Using your recent Home default Turkey Wrap history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Turkey Wrap Γ—1 (wrap) 340 cal Β· 28g P Β· 31g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-turkey-wrap",
        "shared_food_id": null,
        "display_name": "Turkey Wrap",
        "brand": "Home default",
        "serving_label": "wrap",
        "serving_quantity": 1,
        "serving_unit": "wrap",
        "macros_per_serving": {
          "calories": 340,
          "proteinGrams": 28,
          "fatGrams": 11,
          "carbsGrams": 31
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-turkey-wrap-recent",
        "user_food_id": "seed-turkey-wrap",
        "food_name": "Turkey Wrap",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "wrap",
        "macros": {
          "calories": 340,
          "proteinGrams": 28,
          "fatGrams": 11,
          "carbsGrams": 31
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:10:21.010Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log the same lunch I had Monday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Chicken Rice Bowl" β€” no saved row with matching identity (rows: Sweetgreen Harvest Bowl)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Chicken Rice Bowl" β€” no saved row with matching identity (rows: Sweetgreen Harvest Bowl)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Sweetgreen Sweetgreen Harvest Bowl. Using your recent Sweetgreen Sweetgreen Harvest Bowl history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Sweetgreen Harvest Bowl Γ—1 (bowl) 540 cal Β· 28g P Β· 48g C Β· 24g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-monday-lunch-bowl",
        "shared_food_id": null,
        "display_name": "Chicken Rice Bowl",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 520,
          "proteinGrams": 42,
          "fatGrams": 14,
          "carbsGrams": 48
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-monday-lunch",
        "user_food_id": "seed-monday-lunch-bowl",
        "food_name": "Chicken Rice Bowl",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 520,
          "proteinGrams": 42,
          "fatGrams": 14,
          "carbsGrams": 48
        },
        "meal": "lunch",
        "notes": "Monday lunch",
        "logged_at": {
          "$relativeDays": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:10:32.355Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my default coffee." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Black Coffee β€” card not captured.
Why verdict Logged (write-truth verified): Black Coffee β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Black Coffee. Using your saved "my default coffee". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Black Coffee Γ—1 (cup) 5 cal Β· 0g P Β· 1g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-default-coffee",
        "shared_food_id": null,
        "display_name": "Black Coffee",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 5,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 1
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-default-coffee",
        "phrase": "my default coffee",
        "user_food_id": "seed-default-coffee",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "cup",
          "displayLabel": "my default coffee",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-default-coffee",
        "user_food_id": "seed-default-coffee",
        "food_name": "Black Coffee",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 5,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 1
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:10:43.592Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record the usual oatmeal bowl." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked Oatmeal Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Oatmeal Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Cooked Oatmeal Bowl. Using your saved "usual oatmeal bowl". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Oatmeal Bowl Γ—1 (bowl) 180 cal Β· 6g P Β· 32g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-oatmeal-bowl",
        "shared_food_id": null,
        "display_name": "Cooked Oatmeal Bowl",
        "brand": null,
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 180,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 32
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-usual-oatmeal-bowl",
        "phrase": "usual oatmeal bowl",
        "user_food_id": "seed-oatmeal-bowl",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "bowl",
          "displayLabel": "usual oatmeal bowl",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-usual-oatmeal-bowl",
        "user_food_id": "seed-oatmeal-bowl",
        "food_name": "Cooked Oatmeal Bowl",
        "brand": null,
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 180,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 32
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:10:54.873Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track half of my regular burrito bowl." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Burrito Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Burrito Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Burrito Bowl. Using your saved "my regular burrito bowl". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Burrito Bowl Γ—1 (bowl) 620 cal Β· 35g P Β· 72g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-burrito-bowl",
        "shared_food_id": null,
        "display_name": "Burrito Bowl",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-regular-burrito-bowl",
        "phrase": "my regular burrito bowl",
        "user_food_id": "seed-burrito-bowl",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "bowl",
          "displayLabel": "my regular burrito bowl",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-regular-burrito",
        "user_food_id": "seed-burrito-bowl",
        "food_name": "Burrito Bowl",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:11:06.164Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log another Fairlife shake like this morning." (difficulty β€”)3.7s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Fairlife Core Power Chocolate" β€” no saved row with matching identity (rows: Fairlife Core Power Elite Vanilla Protein Shake)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Fairlife Core Power Chocolate" β€” no saved row with matching identity (rows: Fairlife Core Power Elite Vanilla Protein Shake)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS said no speech captured
2 Β· Card shown Logged fairlife core power elite vanilla protein shake β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Fairlife Core Power Elite Vanilla Protein Shake Γ—1 (one) 230 cal Β· 42g P Β· 8g C Β· 3.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-fairlife-shake",
        "shared_food_id": null,
        "display_name": "Fairlife Core Power Chocolate",
        "brand": "Fairlife",
        "serving_label": "bottle",
        "serving_quantity": 1,
        "serving_unit": "bottle",
        "macros_per_serving": {
          "calories": 170,
          "proteinGrams": 26,
          "fatGrams": 4.5,
          "carbsGrams": 8
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-fairlife-morning",
        "user_food_id": "seed-fairlife-shake",
        "food_name": "Fairlife Core Power Chocolate",
        "brand": "Fairlife",
        "quantity": 1,
        "serving_label": "bottle",
        "macros": {
          "calories": 170,
          "proteinGrams": 26,
          "fatGrams": 4.5,
          "carbsGrams": 8
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -4
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:11:20.972Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my saved chicken salad meal." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chicken Salad Meal β€” card not captured.
Why verdict Logged (write-truth verified): Chicken Salad Meal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Chicken Salad Meal. Using your saved "my saved chicken salad meal". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Salad Meal Γ—1 (serving) 410 cal Β· 38g P Β· 16g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-chicken-salad-meal",
        "shared_food_id": null,
        "display_name": "Chicken Salad Meal",
        "brand": "Home default",
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 410,
          "proteinGrams": 38,
          "fatGrams": 18,
          "carbsGrams": 16
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-saved-chicken-salad",
        "phrase": "my saved chicken salad meal",
        "user_food_id": "seed-chicken-salad-meal",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "serving",
          "displayLabel": "my saved chicken salad meal",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-chicken-salad",
        "user_food_id": "seed-chicken-salad-meal",
        "food_name": "Chicken Salad Meal",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 410,
          "proteinGrams": 38,
          "fatGrams": 18,
          "carbsGrams": 16
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -4
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:11:32.184Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record what I normally eat after spin class." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Post-Spin Recovery Meal β€” card not captured.
Why verdict Logged (write-truth verified): Post-Spin Recovery Meal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Post-Spin Recovery Meal. Using your saved fixed default for "what i normally eat after spin class" (1 serving). Say a different amount if that is wrong.
3 Β· App data rows written created food_log_entry: Post-Spin Recovery Meal Γ—1 (serving) 450 cal Β· 30g P Β· 48g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-post-spin-meal",
        "shared_food_id": null,
        "display_name": "Post-Spin Recovery Meal",
        "brand": "Home default",
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 450,
          "proteinGrams": 30,
          "fatGrams": 12,
          "carbsGrams": 48
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-post-spin",
        "phrase": "what i normally eat after spin class",
        "user_food_id": "seed-post-spin-meal",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "serving",
          "displayLabel": "what I normally eat after spin class",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-post-spin",
        "user_food_id": "seed-post-spin-meal",
        "food_name": "Post-Spin Recovery Meal",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 450,
          "proteinGrams": 30,
          "fatGrams": 12,
          "carbsGrams": 48
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:11:43.381Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track the other half of dinner from last night." (difficulty β€”)2.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve the other before I log this meal. What should I use for the other?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-last-night-dinner",
        "shared_food_id": null,
        "display_name": "Grilled Salmon Dinner",
        "brand": "Home default",
        "serving_label": "plate",
        "serving_quantity": 1,
        "serving_unit": "plate",
        "macros_per_serving": {
          "calories": 580,
          "proteinGrams": 42,
          "fatGrams": 22,
          "carbsGrams": 38
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-last-night-dinner",
        "user_food_id": "seed-last-night-dinner",
        "food_name": "Grilled Salmon Dinner",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "plate",
        "macros": {
          "calories": 580,
          "proteinGrams": 42,
          "fatGrams": 22,
          "carbsGrams": 38
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:11:57.064Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my usual restaurant order at Sweetgreen." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sweetgreen Harvest Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Sweetgreen Harvest Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Sweetgreen Sweetgreen Harvest Bowl. Using your saved "my usual restaurant order at sweetgreen". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Sweetgreen Harvest Bowl Γ—1 (bowl) 540 cal Β· 28g P Β· 48g C Β· 24g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-sweetgreen-usual",
        "shared_food_id": null,
        "display_name": "Sweetgreen Harvest Bowl",
        "brand": "Sweetgreen",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 540,
          "proteinGrams": 28,
          "fatGrams": 24,
          "carbsGrams": 48
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-sweetgreen-usual",
        "phrase": "my usual restaurant order at sweetgreen",
        "user_food_id": "seed-sweetgreen-usual",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "bowl",
          "displayLabel": "my usual restaurant order at Sweetgreen",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-sweetgreen",
        "user_food_id": "seed-sweetgreen-usual",
        "food_name": "Sweetgreen Harvest Bowl",
        "brand": "Sweetgreen",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 540,
          "proteinGrams": 28,
          "fatGrams": 24,
          "carbsGrams": 48
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:12:08.363Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add the protein pancakes I always make." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Protein Pancakes β€” card not captured.
Why verdict Logged (write-truth verified): Protein Pancakes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Home default Protein Pancakes. Using your saved "the protein pancakes i always make". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Protein Pancakes Γ—1 (serving) 320 cal Β· 28g P Β· 34g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-protein-pancakes",
        "shared_food_id": null,
        "display_name": "Protein Pancakes",
        "brand": "Home default",
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 320,
          "proteinGrams": 28,
          "fatGrams": 8,
          "carbsGrams": 34
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "user_food_aliases",
      "record": {
        "id": "seed-alias-protein-pancakes",
        "phrase": "the protein pancakes i always make",
        "user_food_id": "seed-protein-pancakes",
        "use_count": 1,
        "is_default": true,
        "shortcut_settings": {
          "quickLogMode": "fixed",
          "defaultQuantity": 1,
          "defaultServingLabel": "serving",
          "displayLabel": "the protein pancakes I always make",
          "confirmBeforeLog": false
        },
        "updated_at": {
          "$relativeDays": -1
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-protein-pancakes",
        "user_food_id": "seed-protein-pancakes",
        "food_name": "Protein Pancakes",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 320,
          "proteinGrams": 28,
          "fatGrams": 8,
          "carbsGrams": 34
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:12:19.614Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Record the snack pack I built last week." (difficulty β€”)3.6s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said no speech captured
2 Β· Card shown Logging your snack pack I built last week β€” still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: the snack pack I built last week (pending)
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-snack-pack",
        "shared_food_id": null,
        "display_name": "Snack Pack",
        "brand": "Home default",
        "serving_label": "pack",
        "serving_quantity": 1,
        "serving_unit": "pack",
        "macros_per_serving": {
          "calories": 240,
          "proteinGrams": 10,
          "fatGrams": 12,
          "carbsGrams": 22
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-snack-pack-last-week",
        "user_food_id": "seed-snack-pack",
        "food_name": "Snack Pack",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "pack",
        "macros": {
          "calories": 240,
          "proteinGrams": 10,
          "fatGrams": 12,
          "carbsGrams": 22
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeDays": -7
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:12:41.078Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change my last chicken entry to 6 ounces, not 4." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-chicken-breast-4oz",
        "shared_food_id": null,
        "display_name": "Grilled Chicken Breast",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 4,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 185,
          "proteinGrams": 35,
          "fatGrams": 4,
          "carbsGrams": 0
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-last-chicken",
        "user_food_id": "seed-chicken-breast-4oz",
        "food_name": "Grilled Chicken Breast",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 185,
          "proteinGrams": 35,
          "fatGrams": 4,
          "carbsGrams": 0
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:12:45.589Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Actually make that latte skim milk instead of whole." (difficulty β€”)5.4s
Verdict Expected UPDATE β€” should update the entry. FAIL: WRONG ACTION β€” created a NEW entry on an UPDATE request.
Why verdict WRONG ACTION β€” created a NEW entry on an UPDATE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written update_sync_failed food_log_entry: the snack pack I built last week
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-whole-milk-latte",
        "shared_food_id": null,
        "display_name": "Whole Milk Latte",
        "brand": "Coffee shop default",
        "serving_label": "ounce",
        "serving_quantity": 12,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 180,
          "proteinGrams": 9,
          "fatGrams": 7,
          "carbsGrams": 18
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-last-latte",
        "user_food_id": "seed-whole-milk-latte",
        "food_name": "Whole Milk Latte",
        "brand": "Coffee shop default",
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 180,
          "proteinGrams": 9,
          "fatGrams": 7,
          "carbsGrams": 18
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:13:02.111Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Update breakfast oats to 60 grams dry." (difficulty β€”)0.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Updated Dry Rolled Oats to 60 g.
3 Β· App data rows written updated food_log_entry: Dry Rolled Oats Γ—1.3333333333333333 (gram) 227 cal Β· 8g P Β· 38.7g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-breakfast-oats",
        "shared_food_id": null,
        "display_name": "Dry Rolled Oats",
        "brand": null,
        "serving_label": "gram",
        "serving_quantity": 45,
        "serving_unit": "g",
        "macros_per_serving": {
          "calories": 170,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 29
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-breakfast-oats",
        "user_food_id": "seed-breakfast-oats",
        "food_name": "Dry Rolled Oats",
        "brand": null,
        "quantity": 1,
        "serving_label": "gram",
        "macros": {
          "calories": 170,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 29
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:13:20.146Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Correction: the rice was brown rice, not white." (difficulty β€”)5.3s
Verdict Expected UPDATE β€” should update the entry. FAIL: WRONG ACTION β€” created a NEW entry on an UPDATE request.
Why verdict WRONG ACTION β€” created a NEW entry on an UPDATE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written update_sync_failed food_log_entry: the snack pack I built last week
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-white-rice",
        "shared_food_id": null,
        "display_name": "Cooked White Rice",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 205,
          "proteinGrams": 4,
          "fatGrams": 0,
          "carbsGrams": 45
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-rice-entry",
        "user_food_id": "seed-white-rice",
        "food_name": "Cooked White Rice",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 205,
          "proteinGrams": 4,
          "fatGrams": 0,
          "carbsGrams": 45
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:13:30.018Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Make the salmon 7 ounces instead." (difficulty β€”)0.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Updated Smoked salmon to 7 oz.
3 Β· App data rows written updated food_log_entry: Smoked salmon Γ—3.5 (2 oz) 231 cal Β· 36.4g P Β· 0g C Β· 8.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-baked-salmon",
        "shared_food_id": null,
        "display_name": "Baked Salmon",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 5,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 250,
          "proteinGrams": 28,
          "fatGrams": 14,
          "carbsGrams": 0
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-salmon-entry",
        "user_food_id": "seed-baked-salmon",
        "food_name": "Baked Salmon",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 250,
          "proteinGrams": 28,
          "fatGrams": 14,
          "carbsGrams": 0
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:13:48.015Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Add olive oil to that salad, one tablespoon." (difficulty β€”)6.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: WRONG ACTION β€” created a NEW entry on an UPDATE request.
Why verdict WRONG ACTION β€” created a NEW entry on an UPDATE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written update_sync_failed food_log_entry: Chicken Salad Meal
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-garden-salad",
        "shared_food_id": null,
        "display_name": "Garden Salad",
        "brand": null,
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 120,
          "proteinGrams": 4,
          "fatGrams": 6,
          "carbsGrams": 12
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-salad-entry",
        "user_food_id": "seed-garden-salad",
        "food_name": "Garden Salad",
        "brand": null,
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 120,
          "proteinGrams": 4,
          "fatGrams": 6,
          "carbsGrams": 12
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:13:58.594Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Remove the cheese from that sandwich entry." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update β€” misroute-into-food (no verified mutation).
Why verdict Did not update β€” misroute-into-food (no verified mutation).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-turkey-sandwich",
        "shared_food_id": null,
        "display_name": "Turkey Sandwich",
        "brand": "Home default",
        "serving_label": "sandwich",
        "serving_quantity": 1,
        "serving_unit": "sandwich",
        "macros_per_serving": {
          "calories": 380,
          "proteinGrams": 26,
          "fatGrams": 12,
          "carbsGrams": 38
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-sandwich-entry",
        "user_food_id": "seed-turkey-sandwich",
        "food_name": "Turkey Sandwich",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "sandwich",
        "macros": {
          "calories": 380,
          "proteinGrams": 26,
          "fatGrams": 12,
          "carbsGrams": 38
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:14:09.816Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Change the yogurt to the vanilla Chobani one." (difficulty β€”)0.5s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Updated the food entry from "Mixed Berry Flavor Triple Zero Blended Greek Nonfat Yogurt" to "the vanilla chobani one".
3 Β· App data rows written updated food_log_entry: Zero Sugar Vanilla Yogurt Γ—1 (cup) 120 cal Β· 15g P Β· 9g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-plain-yogurt",
        "shared_food_id": null,
        "display_name": "Plain Greek Yogurt",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 130,
          "proteinGrams": 22,
          "fatGrams": 0,
          "carbsGrams": 8
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yogurt-entry",
        "user_food_id": "seed-plain-yogurt",
        "food_name": "Plain Greek Yogurt",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 130,
          "proteinGrams": 22,
          "fatGrams": 0,
          "carbsGrams": 8
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:14:21.399Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually the steak was 5 ounces cooked, not raw." (difficulty β€”)3.5s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.5s
1 Β· TTS said no speech captured
2 Β· Card shown Updated the food entry from "Grilled Steak" to "5 ounces cooked steak".
3 Β· App data rows written updated food_log_entry: Beef, Shoulder Steak, Boneless, Separable Lean Only, Trimmed To 0" Fat, Select, Cooked, Grilled Γ—5 (3 serving) 720 cal Β· 122g P Β· 0g C Β· 22g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-grilled-steak",
        "shared_food_id": null,
        "display_name": "Grilled Steak",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 6,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 340,
          "proteinGrams": 42,
          "fatGrams": 18,
          "carbsGrams": 0
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-steak-entry",
        "user_food_id": "seed-grilled-steak",
        "food_name": "Grilled Steak",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 340,
          "proteinGrams": 42,
          "fatGrams": 18,
          "carbsGrams": 0
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:14:54.589Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Set the smoothie to two servings." (difficulty β€”)1.5s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said no speech captured
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-berry-smoothie-entry",
        "shared_food_id": null,
        "display_name": "Berry Smoothie",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 260,
          "proteinGrams": 16,
          "fatGrams": 5,
          "carbsGrams": 38
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-smoothie-entry",
        "user_food_id": "seed-berry-smoothie-entry",
        "food_name": "Berry Smoothie",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 260,
          "proteinGrams": 16,
          "fatGrams": 5,
          "carbsGrams": 38
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:15:00.186Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change lunch from half avocado to a whole avocado." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-half-avocado",
        "shared_food_id": null,
        "display_name": "Avocado",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 0.5,
        "serving_unit": "avocado",
        "macros_per_serving": {
          "calories": 120,
          "proteinGrams": 1.5,
          "fatGrams": 11,
          "carbsGrams": 6
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-avocado-lunch",
        "user_food_id": "seed-half-avocado",
        "food_name": "Avocado",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 120,
          "proteinGrams": 1.5,
          "fatGrams": 11,
          "carbsGrams": 6
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:15:11.402Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Update the pasta sauce to pesto instead of marinara." (difficulty β€”)11.9s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 11.9s
1 Β· TTS said no speech captured
2 Β· Card shown Which exact pasta sauce to pesto Protein Pancakes should replace Protein Pancakes?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-pasta-marinara",
        "shared_food_id": null,
        "display_name": "Pasta with Marinara",
        "brand": "Home default",
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 420,
          "proteinGrams": 14,
          "fatGrams": 8,
          "carbsGrams": 72
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-pasta-entry",
        "user_food_id": "seed-pasta-marinara",
        "food_name": "Pasta with Marinara",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 420,
          "proteinGrams": 14,
          "fatGrams": 8,
          "carbsGrams": 72
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:15:34.468Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Correction: those were turkey meatballs, not beef." (difficulty β€”)6.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.3s
1 Β· TTS said no speech captured
2 Β· Card shown Updated the food entry from "Protein Pancakes" to "correction: those were turkey meatballs, not beef".
3 Β· App data rows written updated food_log_entry: Turkey meatballs Γ—1 (28 g) 52 cal Β· 5g P Β· 1.7g C Β· 2.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-beef-meatballs",
        "shared_food_id": null,
        "display_name": "Beef Meatballs",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 22,
          "fatGrams": 18,
          "carbsGrams": 8
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-meatballs",
        "user_food_id": "seed-beef-meatballs",
        "food_name": "Beef Meatballs",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 280,
          "proteinGrams": 22,
          "fatGrams": 18,
          "carbsGrams": 8
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:15:51.864Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Make the burrito bowl no sour cream." (difficulty β€”)3.7s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS said no speech captured
2 Β· Card shown Which exact Burrito Bowl without sour cream should replace Burrito Bowl?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-burrito-bowl",
        "shared_food_id": null,
        "display_name": "Burrito Bowl",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-burrito-for-edit",
        "user_food_id": "seed-burrito-bowl",
        "food_name": "Burrito Bowl",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:16:06.757Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Change the cereal milk to almond milk." (difficulty β€”)0.6s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown Updated the food entry from "2% milk" to "almond milk".
3 Β· App data rows written updated food_log_entry: Unsweetened almond milk Γ—1 (100 g) 13 cal Β· 0.4g P Β· 0.3g C Β· 1.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-cereal-whole-milk",
        "shared_food_id": null,
        "display_name": "Cereal with Whole Milk",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 9,
          "fatGrams": 8,
          "carbsGrams": 44
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-cereal",
        "user_food_id": "seed-cereal-whole-milk",
        "food_name": "Cereal with Whole Milk",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 280,
          "proteinGrams": 9,
          "fatGrams": 8,
          "carbsGrams": 44
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:16:18.428Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the banana I just logged." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-medium-banana",
        "shared_food_id": null,
        "display_name": "Medium Banana",
        "brand": null,
        "serving_label": "medium",
        "serving_quantity": 1,
        "serving_unit": "banana",
        "macros_per_serving": {
          "calories": 105,
          "proteinGrams": 1.3,
          "fatGrams": 0.4,
          "carbsGrams": 27
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-banana-recent",
        "user_food_id": "seed-medium-banana",
        "food_name": "Medium Banana",
        "brand": null,
        "quantity": 1,
        "serving_label": "medium",
        "macros": {
          "calories": 105,
          "proteinGrams": 1.3,
          "fatGrams": 0.4,
          "carbsGrams": 27
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -0.25
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:16:29.636Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove breakfast oatmeal from today." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I could not find a list matching today. Which list has breakfast oatmeal?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-oatmeal-bowl",
        "shared_food_id": null,
        "display_name": "Cooked Oatmeal Bowl",
        "brand": null,
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 180,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 32
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-today-bfast-oatmeal",
        "user_food_id": "seed-oatmeal-bowl",
        "food_name": "Cooked Oatmeal Bowl",
        "brand": null,
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 180,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 32
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -4
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:16:40.828Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Undo that protein bar entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-protein-bar",
        "shared_food_id": null,
        "display_name": "Chocolate Protein Bar",
        "brand": "Generic",
        "serving_label": "bar",
        "serving_quantity": 1,
        "serving_unit": "bar",
        "macros_per_serving": {
          "calories": 200,
          "proteinGrams": 20,
          "fatGrams": 7,
          "carbsGrams": 22
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-protein-bar-recent",
        "user_food_id": "seed-protein-bar",
        "food_name": "Chocolate Protein Bar",
        "brand": "Generic",
        "quantity": 1,
        "serving_label": "bar",
        "macros": {
          "calories": 200,
          "proteinGrams": 20,
          "fatGrams": 7,
          "carbsGrams": 22
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -0.5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:16:52.104Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Take out the fries from dinner." (difficulty β€”)3.0s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown I did not make any app changes. To remove the fries from your dinner entry, please specify the exact food entry you'd like to correct. For example, you could say "Correct dinner" and then tell me the change.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-dinner-fries",
        "shared_food_id": null,
        "display_name": "French Fries",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 320,
          "proteinGrams": 4,
          "fatGrams": 15,
          "carbsGrams": 42
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-dinner-fries",
        "user_food_id": "seed-dinner-fries",
        "food_name": "French Fries",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 320,
          "proteinGrams": 4,
          "fatGrams": 15,
          "carbsGrams": 42
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:17:06.249Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete my lunch salad." (difficulty β€”)0.0s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-lunch-salad",
        "shared_food_id": null,
        "display_name": "Lunch Salad",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 18,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-lunch-salad-del",
        "user_food_id": "seed-lunch-salad",
        "food_name": "Lunch Salad",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 280,
          "proteinGrams": 18,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:17:17.399Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove the second coffee entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-coffee-entry",
        "shared_food_id": null,
        "display_name": "Coffee",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 5,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 1
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-coffee-1",
        "user_food_id": "seed-coffee-entry",
        "food_name": "Coffee",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 5,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 1
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-coffee-2",
        "user_food_id": "seed-coffee-entry",
        "food_name": "Coffee",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 5,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 1
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:17:28.593Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Cancel the snack I added a minute ago." (difficulty β€”)3.0s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-recent-snack",
        "shared_food_id": null,
        "display_name": "Greek Yogurt Cup",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 130,
          "proteinGrams": 15,
          "fatGrams": 0,
          "carbsGrams": 12
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-snack-minute-ago",
        "user_food_id": "seed-recent-snack",
        "food_name": "Greek Yogurt Cup",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 130,
          "proteinGrams": 15,
          "fatGrams": 0,
          "carbsGrams": 12
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -0.1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:17:42.788Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Erase the pizza from yesterday night." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-yesterday-pizza",
        "shared_food_id": null,
        "display_name": "Cheese Pizza Slice",
        "brand": null,
        "serving_label": "slice",
        "serving_quantity": 2,
        "serving_unit": "slice",
        "macros_per_serving": {
          "calories": 570,
          "proteinGrams": 24,
          "fatGrams": 22,
          "carbsGrams": 64
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yesterday-pizza",
        "user_food_id": "seed-yesterday-pizza",
        "food_name": "Cheese Pizza Slice",
        "brand": null,
        "quantity": 1,
        "serving_label": "slice",
        "macros": {
          "calories": 570,
          "proteinGrams": 24,
          "fatGrams": 22,
          "carbsGrams": 64
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:17:53.967Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the guacamole line from my burrito bowl." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. FAIL: WRONG TARGET β€” deleted Guacamole instead of guacamole component.
Why verdict WRONG TARGET β€” deleted Guacamole instead of guacamole component.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Deleted Guacamole.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-burrito-guac-parent",
        "shared_food_id": null,
        "display_name": "Burrito Bowl",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-burrito-parent",
        "user_food_id": "seed-burrito-guac-parent",
        "food_name": "Burrito Bowl",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 620,
          "proteinGrams": 35,
          "fatGrams": 18,
          "carbsGrams": 72
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-guacamole",
        "shared_food_id": null,
        "display_name": "Guacamole",
        "brand": null,
        "serving_label": "tablespoon",
        "serving_quantity": 2,
        "serving_unit": "tbsp",
        "macros_per_serving": {
          "calories": 50,
          "proteinGrams": 1,
          "fatGrams": 4.5,
          "carbsGrams": 3
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-guac-component",
        "user_food_id": "seed-guacamole",
        "food_name": "Guacamole",
        "brand": null,
        "quantity": 2,
        "serving_label": "tbsp",
        "macros": {
          "calories": 50,
          "proteinGrams": 1,
          "fatGrams": 4.5,
          "carbsGrams": 3
        },
        "meal": "lunch",
        "notes": "component of burrito bowl",
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:18:12.419Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove my post-workout shake from today." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-post-workout-shake",
        "shared_food_id": null,
        "display_name": "Post-Workout Protein Shake",
        "brand": "Premier Protein",
        "serving_label": "bottle",
        "serving_quantity": 1,
        "serving_unit": "bottle",
        "macros_per_serving": {
          "calories": 160,
          "proteinGrams": 30,
          "fatGrams": 3,
          "carbsGrams": 5
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-post-workout-shake",
        "user_food_id": "seed-post-workout-shake",
        "food_name": "Post-Workout Protein Shake",
        "brand": "Premier Protein",
        "quantity": 1,
        "serving_label": "bottle",
        "macros": {
          "calories": 160,
          "proteinGrams": 30,
          "fatGrams": 3,
          "carbsGrams": 5
        },
        "meal": "snack",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:18:16.558Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Give me the calorie count for 100 grams of avocado." (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Avocado has about 160 calories per 100 g.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:18:27.798Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What has more protein, Greek yogurt or cottage cheese?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:18:38.991Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs in a cup of cooked quinoa?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Cooked quinoa has about 39.4g carbs per 1 cup.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:18:50.227Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log enough protein at breakfast?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown No β€” I do not see enough protein at breakfast logged today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-breakfast-eggs",
        "shared_food_id": null,
        "display_name": "Scrambled Eggs",
        "brand": null,
        "serving_label": "serving",
        "serving_quantity": 1,
        "serving_unit": "serving",
        "macros_per_serving": {
          "calories": 220,
          "proteinGrams": 18,
          "fatGrams": 15,
          "carbsGrams": 2
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-bfast-eggs-q",
        "user_food_id": "seed-breakfast-eggs",
        "food_name": "Scrambled Eggs",
        "brand": null,
        "quantity": 1,
        "serving_label": "serving",
        "macros": {
          "calories": 220,
          "proteinGrams": 18,
          "fatGrams": 15,
          "carbsGrams": 2
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-breakfast-toast",
        "shared_food_id": null,
        "display_name": "Whole Wheat Toast",
        "brand": null,
        "serving_label": "slice",
        "serving_quantity": 2,
        "serving_unit": "slice",
        "macros_per_serving": {
          "calories": 160,
          "proteinGrams": 8,
          "fatGrams": 2,
          "carbsGrams": 28
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-bfast-toast-q",
        "user_food_id": "seed-breakfast-toast",
        "food_name": "Whole Wheat Toast",
        "brand": null,
        "quantity": 1,
        "serving_label": "slice",
        "macros": {
          "calories": 160,
          "proteinGrams": 8,
          "fatGrams": 2,
          "carbsGrams": 28
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeHours": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:19:13.066Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Show lunch from yesterday." (difficulty β€”)0.2s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-yesterday-lunch-sandwich",
        "shared_food_id": null,
        "display_name": "Turkey Sandwich",
        "brand": "Home default",
        "serving_label": "sandwich",
        "serving_quantity": 1,
        "serving_unit": "sandwich",
        "macros_per_serving": {
          "calories": 380,
          "proteinGrams": 26,
          "fatGrams": 12,
          "carbsGrams": 38
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yest-lunch-sand",
        "user_food_id": "seed-yesterday-lunch-sandwich",
        "food_name": "Turkey Sandwich",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "sandwich",
        "macros": {
          "calories": 380,
          "proteinGrams": 26,
          "fatGrams": 12,
          "carbsGrams": 38
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-yesterday-lunch-chips",
        "shared_food_id": null,
        "display_name": "Potato Chips",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 1,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 150,
          "proteinGrams": 2,
          "fatGrams": 10,
          "carbsGrams": 15
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yest-lunch-chips",
        "user_food_id": "seed-yesterday-lunch-chips",
        "food_name": "Potato Chips",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 150,
          "proteinGrams": 2,
          "fatGrams": 10,
          "carbsGrams": 15
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:19:24.356Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould answer the query"Give me the sodium count for a Subway turkey sandwich." (difficulty β€”)0.5s
Verdict Expected QUERY β€” should answer the query. FAIL: answer did not state expected numeric value(s): sodiumMg
Why verdict answer did not state expected numeric value(s): sodiumMg
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:19:36.080Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Which is lower calorie, ranch or balsamic vinaigrette?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:19:47.320Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Estimate calories added by two tablespoons of olive oil." (difficulty β€”)0.2s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Olive oil has about 241 calories per 2 tbsp.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:19:58.769Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What is my average breakfast calories this week?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Average breakfast calories: 421.1667 calories.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-week-bfast-oats",
        "shared_food_id": null,
        "display_name": "Cooked Oatmeal",
        "brand": null,
        "serving_label": "cup",
        "serving_quantity": 1,
        "serving_unit": "cup",
        "macros_per_serving": {
          "calories": 150,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-week-bfast-1",
        "user_food_id": "seed-week-bfast-oats",
        "food_name": "Cooked Oatmeal",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 150,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-week-bfast-2",
        "user_food_id": "seed-week-bfast-oats",
        "food_name": "Cooked Oatmeal",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 150,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-week-bfast-3",
        "user_food_id": "seed-week-bfast-oats",
        "food_name": "Cooked Oatmeal",
        "brand": null,
        "quantity": 1,
        "serving_label": "cup",
        "macros": {
          "calories": 150,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "meal": "breakfast",
        "notes": null,
        "logged_at": {
          "$relativeDays": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:20:10.013Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould answer the query"Give me the fiber count for black beans." (difficulty β€”)0.2s
Verdict Expected QUERY β€” should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Black beans has about 8.7g fiber per 100 g.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:20:21.343Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould answer the query"Was dinner higher calorie than lunch today?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. FAIL: answer did not state expected numeric value(s): calories
Why verdict answer did not state expected numeric value(s): calories
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Yes β€” lunch was higher calorie today (6855 vs 4405 for dinner).
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-lunch-salad",
        "shared_food_id": null,
        "display_name": "Chicken Salad",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 350,
          "proteinGrams": 32,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-today-lunch-cmp",
        "user_food_id": "seed-today-lunch-salad",
        "food_name": "Chicken Salad",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 350,
          "proteinGrams": 32,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -5
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-dinner-steak",
        "shared_food_id": null,
        "display_name": "Grilled Steak Dinner",
        "brand": "Home default",
        "serving_label": "plate",
        "serving_quantity": 1,
        "serving_unit": "plate",
        "macros_per_serving": {
          "calories": 720,
          "proteinGrams": 48,
          "fatGrams": 32,
          "carbsGrams": 40
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-today-dinner-cmp",
        "user_food_id": "seed-today-dinner-steak",
        "food_name": "Grilled Steak Dinner",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "plate",
        "macros": {
          "calories": 720,
          "proteinGrams": 48,
          "fatGrams": 32,
          "carbsGrams": 40
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeHours": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:20:32.611Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What are macros for a large egg?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Egg per 1 egg: 72 calories, 6.3g protein, 0.4g carbs, 4.8g fat.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:20:43.911Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould answer the query"Show today’s protein total so far." (difficulty β€”)4.9s
Verdict Expected QUERY β€” should answer the query. FAIL: Query not answered β€” asked back instead of answering.
Why verdict Query not answered β€” asked back instead of answering.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.9s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for show todays protein total so far? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-protein-entry",
        "shared_food_id": null,
        "display_name": "Grilled Chicken Breast",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 6,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 52,
          "fatGrams": 6,
          "carbsGrams": 0
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-today-protein",
        "user_food_id": "seed-today-protein-entry",
        "food_name": "Grilled Chicken Breast",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 280,
          "proteinGrams": 52,
          "fatGrams": 6,
          "carbsGrams": 0
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -3
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:20:59.980Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould answer the query"Is quinoa or white rice better for fiber?" (difficulty β€”)0.2s
Verdict Expected QUERY β€” should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Cooked quinoa is higher in fiber (2.8g fiber per 100 g) than Cooked white rice (0.4g fiber per 100 g).
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:21:11.389Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Give me calories for a Chick-fil-A grilled chicken sandwich." (difficulty β€”)0.7s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:21:23.273Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What was my biggest meal yesterday?" (difficulty β€”)2.4s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-lunch-salad",
        "shared_food_id": null,
        "display_name": "Chicken Salad",
        "brand": "Home default",
        "serving_label": "bowl",
        "serving_quantity": 1,
        "serving_unit": "bowl",
        "macros_per_serving": {
          "calories": 350,
          "proteinGrams": 32,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yest-meal-lunch",
        "user_food_id": "seed-today-lunch-salad",
        "food_name": "Chicken Salad",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "bowl",
        "macros": {
          "calories": 350,
          "proteinGrams": 32,
          "fatGrams": 14,
          "carbsGrams": 18
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-dinner-steak",
        "shared_food_id": null,
        "display_name": "Grilled Steak Dinner",
        "brand": "Home default",
        "serving_label": "plate",
        "serving_quantity": 1,
        "serving_unit": "plate",
        "macros_per_serving": {
          "calories": 720,
          "proteinGrams": 48,
          "fatGrams": 32,
          "carbsGrams": 40
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-yest-meal-dinner",
        "user_food_id": "seed-today-dinner-steak",
        "food_name": "Grilled Steak Dinner",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "plate",
        "macros": {
          "calories": 720,
          "proteinGrams": 48,
          "fatGrams": 32,
          "carbsGrams": 40
        },
        "meal": "dinner",
        "notes": null,
        "logged_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:21:36.833Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many grams of carbs are in a medium banana?" (difficulty β€”)0.2s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Banana has about 27.1g carbs per 1 medium banana.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:21:48.140Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What foods did I log with more than 30 grams protein today?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown No β€” I do not see with more than 30 grams protein logged today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-high-protein-meal",
        "shared_food_id": null,
        "display_name": "Chicken and Rice",
        "brand": "Home default",
        "serving_label": "plate",
        "serving_quantity": 1,
        "serving_unit": "plate",
        "macros_per_serving": {
          "calories": 480,
          "proteinGrams": 45,
          "fatGrams": 10,
          "carbsGrams": 48
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-high-protein-today",
        "user_food_id": "seed-high-protein-meal",
        "food_name": "Chicken and Rice",
        "brand": "Home default",
        "quantity": 1,
        "serving_label": "plate",
        "macros": {
          "calories": 480,
          "proteinGrams": 45,
          "fatGrams": 10,
          "carbsGrams": 48
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -2
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:21:59.465Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Does peanut butter have more fat than almond butter?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:22:10.738Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Show calories remaining for a 2200 calorie goal." (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown You are about 28877 calories over today's 2100 calorie budget (30977 logged).
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seeded value
    {
      "table": "user_food_items",
      "record": {
        "id": "seed-today-protein-entry",
        "shared_food_id": null,
        "display_name": "Grilled Chicken Breast",
        "brand": null,
        "serving_label": "ounce",
        "serving_quantity": 6,
        "serving_unit": "oz",
        "macros_per_serving": {
          "calories": 280,
          "proteinGrams": 52,
          "fatGrams": 6,
          "carbsGrams": 0
        },
        "macros_per_100g": null,
        "times_logged": 1,
        "last_logged_at": null,
        "created_at": {
          "$relativeDays": -14
        }
      }
    }
  • Seeded value
    {
      "table": "food_log_entries",
      "record": {
        "id": "seed-log-today-cals-1",
        "user_food_id": "seed-today-protein-entry",
        "food_name": "Grilled Chicken Breast",
        "brand": null,
        "quantity": 1,
        "serving_label": "ounce",
        "macros": {
          "calories": 280,
          "proteinGrams": 52,
          "fatGrams": 6,
          "carbsGrams": 0
        },
        "meal": "lunch",
        "notes": null,
        "logged_at": {
          "$relativeHours": -4
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
  • Seeded value
    {
      "table": "user_module_preferences",
      "record": {
        "id": "seed-pref-nutrition-2200",
        "module_key": "nutrition",
        "preferences": {
          "dailyCalorieGoal": 2200,
          "proteinGoalGrams": 150,
          "fatGoalGrams": 70,
          "carbsGoalGrams": 220
        },
        "updated_at": {
          "$relativeDays": -1
        },
        "deleted_at": null,
        "deleted_by_request_id": null
      }
    }
snapshot captured 2026-08-01T23:22:22.015Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould apply the setting"Set my daily protein goal to 150 grams." (difficulty β€”)0.2s
Verdict Expected SETTINGS β€” should apply the setting. PASS: Applied setting.
Why verdict Applied setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Okay, I updated your daily protein goal to 150 grams.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "settings" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:22:33.370Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould apply the setting"Change my calorie target to 2100 per day." (difficulty β€”)0.1s
Verdict Expected SETTINGS β€” should apply the setting. PASS: Applied setting.
Why verdict Applied setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Okay, I updated your daily calorie goal to 2100 calories.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "settings" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:22:44.602Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould apply the setting"Use grams by default for food weights." (difficulty β€”)0.0s
Verdict Expected SETTINGS β€” should apply the setting. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown Started the exercise food weights on Grams By Default.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "workouts" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:22:55.803Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould apply the setting"Remember my usual breakfast: oats, whey, blueberries." (difficulty β€”)0.5s
Verdict Expected SETTINGS β€” should apply the setting. PASS: Applied setting.
Why verdict Applied setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: my usual breakfast: oats, whey, blueberries.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:23:18.932Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould apply the setting"Make my default coffee a grande oat milk latte." (difficulty β€”)0.1s
Verdict Expected SETTINGS β€” should apply the setting. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I understood a workout plan or equipment request, but could not complete it safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:23:30.249Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould apply the setting"Turn on reminders to log dinner." (difficulty β€”)3.2s
Verdict Expected SETTINGS β€” should apply the setting. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for turn on reminders to log dinner? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:23:44.624Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould apply the setting"Set my carb goal to 250 grams." (difficulty β€”)0.2s
Verdict Expected SETTINGS β€” should apply the setting. PASS: Applied setting.
Why verdict Applied setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said no speech captured
2 Β· Card shown Okay, I updated your daily carb goal to 250 grams.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "settings" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:23:56.057Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould apply the setting"Save my meal prep as chicken rice broccoli." (difficulty β€”)0.1s
Verdict Expected SETTINGS β€” should apply the setting. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown What would you like to name this meal?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:24:07.232Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould apply the setting"Use cooked weights unless I say dry." (difficulty β€”)1.8s
Verdict Expected SETTINGS β€” should apply the setting. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said no speech captured
2 Β· Card shown I'll set your food logging preference to use cooked weights by default, unless you specify "dry" for an item.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:24:20.138Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould apply the setting"Stop reminding me to log snacks." (difficulty β€”)2.4s
Verdict Expected SETTINGS β€” should apply the setting. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for stop reminding me to log snacks? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:24:33.757Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Never mind, don’t log that." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Okay β€” no food was logged for replay setup replay setup cereal..
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:25:06.263Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Cancel that food entry." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Okay β€” no food was logged for replay setup replay setup pasta..
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:25:28.261Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"No, skip the smoothie." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Okay β€” no food was logged for replay setup replay setup smoothie..
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:25:53.486Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Actually forget dinner." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:26:19.261Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Don’t add the coffee." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Okay β€” no food was logged for replay setup replay setup coffee..
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:26:41.593Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Stop, that was for tomorrow, not today." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Was the potato plain, or did it have toppings like butter, sour cream, or cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:27:08.700Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"No food log needed." (difficulty β€”)0.0s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown Okay β€” no food was logged for replay setup replay setup salad..
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:27:33.903Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Ignore that last nutrition thing." (difficulty β€”)1.5s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said no speech captured
2 Β· Card shown Got it β€” I’m here if you need help logging food, workouts, or anything else in the app.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:27:57.637Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"What is the weather tomorrow?" (difficulty β€”)2.4s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER weather β€” out-of-domain weather answer quality not mechanically gradeable
Why verdict OTHER weather β€” out-of-domain weather answer quality not mechanically gradeable
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said no speech captured
2 Β· Card shown I can’t check weather forecasts directly, but you can add a note or a to-do about checking the weather in the app. Want to say, β€œNote: check weather for tomorrow”?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:28:11.150Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould handle appropriately"Text Sarah that I am running late." (difficulty β€”)0.1s
Verdict Expected OTHER β€” should handle appropriately. PASS: OTHER text β€” declined out-of-domain messaging.
Why verdict OTHER text β€” declined out-of-domain messaging.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I can't send texts or messages. You can still log food, workouts, notes, and to-dos here.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:28:22.323Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"Start a timer for ten minutes." (difficulty β€”)0.1s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER timer β€” response not mechanically confirmable as a timer action
Why verdict OTHER timer β€” response not mechanically confirmable as a timer action
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Work time logging isn't available. I can help with food, strength workouts, notes, and to-dos.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:28:33.535Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"How many miles is a 10K?" (difficulty β€”)0.1s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER distance β€” response has no parseable miles figure
Why verdict OTHER distance β€” response has no parseable miles figure
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:28:44.778Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould handle appropriately"Play my workout playlist." (difficulty β€”)0.0s
Verdict Expected OTHER β€” should handle appropriately. PASS: OTHER music β€” music action acknowledged.
Why verdict OTHER music β€” music action acknowledged.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said no speech captured
2 Β· Card shown I can't play music or playlists. I can help with food, workouts, notes, and to-dos.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:28:56.142Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould handle appropriately"Remind me to call the dentist." (difficulty β€”)0.3s
Verdict Expected OTHER β€” should handle appropriately. PASS: OTHER reminder β€” reminder/todo acknowledged.
Why verdict OTHER reminder β€” reminder/todo acknowledged.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Added to-do: call the dentist. Priority 3. Tell me if the title or due date should be different.
3 Β· App data rows written created todo_item: call the dentist
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:29:18.846Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"What time is sunset?" (difficulty β€”)2.6s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER general_query β€” general knowledge answer quality not mechanically gradeable
Why verdict OTHER general_query β€” general knowledge answer quality not mechanically gradeable
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said no speech captured
2 Β· Card shown I can’t check sunset times directly here. You can add a note or to-do to look it up later. Want to say, β€œNote: check sunset time tonight”?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:29:32.581Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould handle appropriately"Open my calendar." (difficulty β€”)0.1s
Verdict Expected OTHER β€” should handle appropriately. PASS: OTHER navigation β€” navigated.
Why verdict OTHER navigation β€” navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening To-dos Calendar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:29:43.766Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"Tell me a joke." (difficulty β€”)0.7s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER conversation β€” conversational quality not mechanically gradeable
Why verdict OTHER conversation β€” conversational quality not mechanically gradeable
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said no speech captured
2 Β· Card shown What’s a runner’s favorite type of music? Running and bass.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:29:55.586Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"How much should I deadlift today?" (difficulty β€”)0.1s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER workout_not_food β€” workout recommendation quality not mechanically gradeable
Why verdict OTHER workout_not_food β€” workout recommendation quality not mechanically gradeable
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown That can be a good addition if it fits your goal and recovery. Add it gradually and keep the first few sets conservative.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "workouts" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:30:06.784Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Open my food log." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:30:18.043Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Show today’s nutrition summary." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food Today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:30:29.332Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Take me to meal history." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:30:40.526Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Open food settings." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food Prefs.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:30:51.876Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould navigate"Show my macro dashboard." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Home.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "main" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:03.104Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Go to saved meals." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food Library.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:14.389Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould navigate"Open barcode scan for food." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:25.668Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould navigate"Show weekly food trends." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:36.937Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Pull up yesterday’s meals." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:48.167Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould navigate"Open my grocery list." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. UNVERIFIED: Informational non-gating row (excluded from pass/fail tallies).
Why verdict Informational non-gating row (excluded from pass/fail tallies).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said no speech captured
2 Β· Card shown You do not have any general lists yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "lists" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:31:59.422Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Note that the soup tasted too salty." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: the soup tasted too salty.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:32:11.720Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Remember this brand of yogurt upset my stomach." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: this brand of yogurt upset my stomach.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:32:23.404Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add a note: the chicken recipe needs more lemon." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: the chicken recipe needs more lemon.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:32:34.966Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Remember I liked the lower sugar granola." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: I liked the lower sugar granola.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:32:46.541Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Note that dinner was at the airport." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: dinner was at the airport.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:32:58.887Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add note to lunch: ate while driving." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: lunch: ate while driving.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:33:22.665Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Remember the protein powder was too sweet." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: the protein powder was too sweet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:33:34.245Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Note: meal prep portion felt small." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: meal prep portion felt small.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:33:46.541Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save a food note that spicy ramen triggered reflux." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: spicy ramen triggered reflux.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:33:58.631Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Remember to buy that salsa again." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: FOOD_NOTE saved (note written, no diary entry).
Why verdict FOOD_NOTE saved (note written, no diary entry).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said no speech captured
2 Β· Card shown Saved food note: buy that salsa again.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:34:10.200Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log 3 ounces canned tuna in water with 1 tablespoon light mayo." (difficulty β€”)1.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve Light mayonnaise before I log this meal. What should I use for Light mayonnaise?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:34:22.451Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record a 16 ounce homemade green juice: kale, apple, cucumber, ginger." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said no speech captured
2 Β· Card shown Which kale should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:34:35.765Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add 2 tablespoons powdered creamer to my coffee." (difficulty β€”)6.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.3s
1 Β· TTS said no speech captured
2 Β· Card shown Updated the food entry from "Black Coffee" to "coffee with 2 tablespoons powdered creamer".
3 Β· App data rows written updated food_log_entry: Coffee Γ—1 (2 tbsp) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:34:53.384Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 1 cup cooked barley and 4 ounces roasted chicken thigh." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked barley, Chicken thigh β€” card not captured.
Why verdict Logged (write-truth verified): Cooked barley, Chicken thigh β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 cup cooked barley and 4 ounces roasted chicken thigh.
3 Β· App data rows written created food_log_entry: Cooked barley Γ—1 (1 cup) 193 cal Β· 3.6g P Β· 44.3g C Β· 0.6g F
created food_log_entry: Chicken thigh Γ—1 (4 oz) 237 cal Β· 29.5g P Β· 0g C Β· 12.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:35:05.005Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 30 grams whey isolate mixed in water." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Whey isolate β€” card not captured.
Why verdict Logged (write-truth verified): Whey isolate β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged Whey isolate.
3 Β· App data rows written created food_log_entry: Whey isolate Γ—1 (30 g) 108 cal Β· 25.8g P Β· 0.9g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:35:17.131Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record half a medium cantaloupe." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cantaloupe β€” card not captured.
Why verdict Logged (write-truth verified): Cantaloupe β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged half a medium cantaloupe. Assumed half a medium cantaloupe as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cantaloupe Γ—1 (half a medium cantaloupe) 94 cal Β· 2.2g P Β· 22.6g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:35:28.711Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 5 ounces cooked ground turkey, 93 percent lean." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Lean ground turkey β€” card not captured.
Why verdict Logged (write-truth verified): Lean ground turkey β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 5 ounces cooked ground turkey 93 percent lean.
3 Β· App data rows written created food_log_entry: Lean ground turkey Γ—1 (5 oz) 241 cal Β· 38.3g P Β· 0g C Β· 9.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:35:40.438Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 2 cups vegetable stir fry cooked with 2 teaspoons sesame oil." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Vegetable stir fry, Sesame oil β€” card not captured.
Why verdict Logged (write-truth verified): Vegetable stir fry, Sesame oil β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 2 cups vegetable stir fry cooked and 2 teaspoons sesame oil.
3 Β· App data rows written created food_log_entry: Vegetable stir fry Γ—1 (2 cup) 225 cal Β· 7.5g P Β· 30g C Β· 9g F
created food_log_entry: Sesame oil Γ—1 (2 tsp) 80 cal Β· 0g P Β· 0g C Β· 9.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:35:52.420Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one bakery blueberry muffin, large." (difficulty β€”)2.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS said no speech captured
2 Β· Card shown I need to resolve large before I log this meal. What should I use for large?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:36:05.805Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record 1 cup chicken salad made with mayo." (difficulty β€”)5.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.7s
1 Β· TTS said no speech captured
2 Β· Card shown What exact food and amount should I use for 1 cup chicken salad made with mayo? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:36:22.769Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add 90 grams smoked tofu." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Smoked tofu β€” card not captured.
Why verdict Logged (write-truth verified): Smoked tofu β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 90 grams smoked tofu.
3 Β· App data rows written created food_log_entry: Smoked tofu Γ—1 (90 g) 158 cal Β· 17.1g P Β· 1.8g C Β· 9.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:36:34.270Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track 1 ounce nutritional yeast on popcorn." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Air-popped popcorn, Nutritional yeast β€” card not captured.
Why verdict Logged (write-truth verified): Air-popped popcorn, Nutritional yeast β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 1 ounce nutritional yeast and Air-popped popcorn. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Nutritional yeast Γ—1 (1 oz) 92 cal Β· 14.2g P Β· 10.2g C Β· 1.4g F
created food_log_entry: Air-popped popcorn Γ—1 (100 g) 387 cal Β· 12.9g P Β· 78g C Β· 4.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:36:46.032Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log 12 ounces coconut water." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Coconut water β€” card not captured.
Why verdict Logged (write-truth verified): Coconut water β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged 12 ounces coconut water.
3 Β· App data rows written created food_log_entry: Coconut water Γ—1 (12 oz) 65 cal Β· 2.4g P Β· 12.6g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:36:57.516Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record 3 dates stuffed with almond butter." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said no speech captured
2 Β· Card shown How much should I log for Almond butter? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:37:09.266Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add one cup matzo ball soup." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Matzo ball soup β€” card not captured.
Why verdict Logged (write-truth verified): Matzo ball soup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said no speech captured
2 Β· Card shown Logged one cup matzo ball soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Matzo ball soup Γ—1 (1 cup) 140 cal Β· 8.1g P Β· 15.2g C Β· 5.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T23:37:20.780Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)