πŸ“Š Status Dashboard ↑ all runs

food-corpus-mixed-F-324f4ab3-c63-20260802

food-corpus-mixed-F Β· preserved partial run Β· iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
183
Pass
102 (56%)
Fail
62 (34%)
Unverified
19 (10%)
Pass rate
62%
Avg difficulty
β€”
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β€” needs a human look (that's you πŸ‘/πŸ‘Ž-ing it). "Pass rate" = pass Γ· (pass + fail) β€” it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 19 unclassified β€” the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened β€” comprehension vs execution vs cosmetic

Comprehension β€” picked the wrong action/target (the hard problem)
61 (98%)
Execution β€” right decision, output broke (plumbing)
1 (2%)
Of 62 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? β€” by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
β–Έ LOG β€” log the entry 8043 (54%) 35 (44%) 2 (3%)
β–Έ CLARIFY β€” ask a clarifying question 5346 (87%) 7 (13%) 0 (0%)
β–Έ DELETE β€” delete the entry 144 (29%) 10 (71%) 0 (0%)
β–Έ UPDATE β€” update the entry 145 (36%) 9 (64%) 0 (0%)
β–Έ CLARIFY_ANSWER β€” complete the pending action 132 (15%) 1 (8%) 10 (77%)
β–Έ QUERY β€” answer the query 70 (0%) 0 (0%) 7 (100%)
β–Έ DECLINE β€” decline 22 (100%) 0 (0%) 0 (0%)
Total183102 (62%)6219

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) β€” this bar chart lights up once that lands.

Clarification follow-ups β€” scored separately

Second turn: app asked, we replied β€” did it resolve correctly?
Follow-ups
13
Resolved
2 (15%)
Mishandled
1 (8%)
Unverified
10

Cosmetic only

Not yet classified β€” pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified β€” pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
1.1s
p90
3.2s
Max
12.8s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β€” click any dot to jump to its detail.
0s
1s
2s
5s
10s
13s
Response path β€” quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
130
Sync clarification
53
Slowest 8 utterances (click to jump to detail):
"I had a grain bowl with bulgur, lentils, and yogurt sauce."12.8s
"I had huevos rancheros with two eggs, salsa, and black beans"6.2s
"Dinner was green curry with tofu, eggplant, and jasmine rice."5.9s
"Take out the margarita from last night."5.5s
"I had personal pizza."5.3s
"Wrong item. Pick the seared ahi."5.3s
"Lunch included four ounces roast pork."5.3s
"That's not it; the plain one."4.8s

Filter β€” controls the list below

Pass / Fail / Unverified
PASS 102 FAIL 62 UNVERIFIED 19
Module (intended for)
Food (183)
Utterance sub-type (within module)
183 shown β€” 102 pass, 62 fail, 19 unverified

Per-utterance detail

FAILshould log the entry"Log one large tangerine for the sequence." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one large tangerine for the sequence? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one large tangerine for the sequence? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:33.168Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one Aloha chocolate chip cookie dough bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chocolate Chip Cookie Dough Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): Chocolate Chip Cookie Dough Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Chocolate Chip Cookie Dough Protein Bar β€” Aloha (1 bar (56.0g)) with an estimated macro range.
2 Β· Card shown Logged Chocolate Chip Cookie Dough Protein Bar β€” Aloha (1 bar (56.0g)) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Chocolate Chip Cookie Dough Protein Bar Γ—1 (1 bar (56.0g)) 240 cal Β· 14g P Β· 25g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:44.857Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had one cup grits with water only." (difficulty β€”)2.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said What exact food and amount should I use for one cup grits with water only? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup grits with water only? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:58.830Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add two sunny side eggs for lunch." (difficulty β€”)4.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.0s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:14.041Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup cherries as a snack." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cherries β€” card not captured.
Why verdict Logged (write-truth verified): Cherries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup cherries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cherries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherries Γ—1 (1 cup) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:25.552Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record six ounces grilled shrimp." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Shrimp β€” card not captured.
Why verdict Logged (write-truth verified): Shrimp β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces grilled shrimp.
2 Β· Card shown Logged six ounces grilled shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ—1 (6 oz) 168 cal Β· 40.8g P Β· 0.3g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:40.969Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Shrimp" at 90% confidence.
  • Matched your past food logs to "Grilled Shrimp" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon cashew butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cashew butter β€” card not captured.
Why verdict Logged (write-truth verified): Cashew butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cashew butter Γ—1 (1 tbsp) 94 cal Β· 2.8g P Β· 4g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:48.152Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cashew butter" at 90% confidence.
  • Matched your past food logs to "cashew butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I drank one cup unsweetened almond milk." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Unsweetened almond milk β€” card not captured.
Why verdict Logged (write-truth verified): Unsweetened almond milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup unsweetened almond milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup unsweetened almond milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Unsweetened almond milk Γ—1 (1 cup) 31 cal Β· 1g P Β· 0.7g C Β· 2.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:59.466Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
  • Matched your past food logs to "Unsweetened Almond Milk" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one medium papaya half." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Papaya β€” card not captured.
Why verdict Logged (write-truth verified): Papaya β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one medium papaya half. Assumed 100 g because no amount was stated.
2 Β· Card shown Logged one medium papaya half. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Papaya Γ—1 (100 g) 43 cal Β· 0.5g P Β· 10.8g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:10.904Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Papaya" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was two sunny side eggs." (difficulty β€”)3.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:25.315Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down six ounces grilled shrimp." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Shrimp β€” card not captured.
Why verdict Logged (write-truth verified): Shrimp β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces grilled shrimp.
2 Β· Card shown Logged six ounces grilled shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ—1 (6 oz) 168 cal Β· 40.8g P Β· 0.3g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:36.613Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "six ounces grilled shrimp" at 90% confidence.
  • Matched the common-food list to "Shrimp" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked jasmine rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked jasmine rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked jasmine rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cooked jasmine rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked jasmine rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked jasmine rice Γ—1 (1 cup) 205 cal Β· 3.8g P Β· 44.6g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:48.061Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
  • Matched your past food logs to "jasmine rice" at 82% confidence.
  • Matched your saved foods and aliases to "Cooked Jasmine Rice" at 74% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was one large tangerine." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "tangerine": logged 180 kcal vs expected ~64 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "tangerine": logged 180 kcal vs expected ~64 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Got it, I logged tangerine.
2 Β· Card shown I logged tangerine β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: tangerine Γ—1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:59.485Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate five ounces seared ahi tuna." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Seared Ahi Tuna β€” card not captured.
Why verdict Logged (write-truth verified): Seared Ahi Tuna β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Seared Ahi Tuna (five ounces (141.7 g)).
2 Β· Card shown Logged Seared Ahi Tuna (five ounces (141.7 g)).
3 Β· App data rows written created food_log_entry: Seared Ahi Tuna Γ—1 (five ounces (141.7 g)) 184 cal Β· 41.1g P Β· 0g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:10.943Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one cup cherries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cherries β€” card not captured.
Why verdict Logged (write-truth verified): Cherries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cherries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cherries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherries Γ—1 (1 cup) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:22.196Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cherries" at 90% confidence.
  • Matched your past food logs to "Cherries" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Count eighteen pistachios." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Pistachios? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pistachios? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:35.054Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Lunch included four ounces roast pork." (difficulty β€”)5.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pork? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pork? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:49.907Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save one cup roasted carrots." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Baby carrots β€” card not captured.
Why verdict Logged (write-truth verified): Baby carrots β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup roasted carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup roasted carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Baby carrots Γ—1 (1 cup) 52 cal Β· 0.9g P Β· 12.2g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:01.257Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Baby carrots" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I drank eight ounces pineapple juice." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Which one did you mean? 1. Pineapple Juice, 100% (1 fl oz (no ice)), 2. Pineapple Juice, Canned or Bottled, Unsweetened, with Added Ascorbic Acid, 3. Pineapple Juice, Canned, Not From Concentrate, Unsweetened, with Added Vitamins A, C and E, 4. Pineapple Juice, 100% (eight ounces )
2 Β· Card shown Which one did you mean? 1. Pineapple Juice, 100% (1 fl oz (no ice)), 2. Pineapple Juice, Canned or Bottled, Unsweetened, with Added Ascorbic Acid, 3. Pineapple Juice, Canned, Not From Concentrate, Unsweetened, with Added Vitamins A, C and E, 4. Pineapple Juice, 100% (eight ounces )
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:12.765Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Note two chicken breakfast sausages." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged your note in General about two chicken breakfast sausages.
2 Β· Card shown Logged your note in General about two chicken breakfast sausages.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "notes" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:24.611Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Supper was one cup kidney beans." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said Which one did you mean? 1. Kidney Beans, 2. Kidney Beans, From Dried, Fat Added, 3. Kidney Beans, From Dried, No Added Fat
2 Β· Card shown Which one did you mean? 1. Kidney Beans, 2. Kidney Beans, From Dried, Fat Added, 3. Kidney Beans, From Dried, No Added Fat
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:48.857Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Enter one medium apricot." (difficulty β€”)1.3s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said I could not finish that request safely.
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:01.349Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Ate a third cup dried mango." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mango, Dried β€” card not captured.
Why verdict Logged (write-truth verified): Mango, Dried β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Mango, Dried (a third cup (55 g)).
2 Β· Card shown Logged Mango, Dried (a third cup (55 g)).
3 Β· App data rows written created food_log_entry: Mango, Dried Γ—1 (a third cup (55 g)) 175 cal Β· 1.4g P Β· 43.2g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:13.137Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon cashew butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cashew butter β€” card not captured.
Why verdict Logged (write-truth verified): Cashew butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cashew butter Γ—1 (1 tbsp) 94 cal Β· 2.8g P Β· 4g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:24.469Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "one tablespoon cashew butter" at 90% confidence.
  • Matched the common-food list to "Cashew butter" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was one cup roasted beets." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Beets β€” card not captured.
Why verdict Logged (write-truth verified): Beets β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup roasted beets. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup roasted beets. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Beets Γ—1 (1 cup) 75 cal Β· 2.9g P Β· 17g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:35.927Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Beets" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had two cups pineapple chunks." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pineapple β€” card not captured.
Why verdict Logged (write-truth verified): Pineapple β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two cups pineapple chunks.
2 Β· Card shown Logged two cups pineapple chunks.
3 Β· App data rows written created food_log_entry: Pineapple Γ—1 (2 cup) 165 cal Β· 1.7g P Β· 43.2g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:47.246Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pineapple" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put in one hundred eighty grams skyr-style yogurt." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said I found Plain Greek yogurt, but I also heard hundred eighty skyr style yogurt. Should I log those separately too?
2 Β· Card shown I found Plain Greek yogurt, but I also heard hundred eighty skyr style yogurt. Should I log those separately too?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:02.433Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup almond milk unsweetened." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Unsweetened almond milk β€” card not captured.
Why verdict Logged (write-truth verified): Unsweetened almond milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup almond milk unsweetened. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup almond milk unsweetened. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Unsweetened almond milk Γ—1 (1 cup) 31 cal Β· 1g P Β· 0.7g C Β· 2.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:11.396Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
  • Matched your past food logs to "Unsweetened almond milk" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast was half a cup feta crumbles." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Feta cheese β€” card not captured.
Why verdict Logged (write-truth verified): Feta cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged half a cup feta crumbles. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged half a cup feta crumbles. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Feta cheese Γ—1 (0.5 cup) 198 cal Β· 10.6g P Β· 3.1g C Β· 16g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:22.651Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Feta cheese" at 90% confidence.
  • Matched your past food logs to "Codex Test Dairy Feta Crumbles" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count two corn tortillas small." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Corn tortilla β€” card not captured.
Why verdict Logged (write-truth verified): Corn tortilla β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two corn tortillas small.
2 Β· Card shown Logged two corn tortillas small.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ—1 (2 corn tortillas) 122 cal Β· 3.2g P Β· 25g C Β· 1.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:33.988Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Corn tortilla" at 90% confidence.
  • Matched your past food logs to "Corn Tortilla" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had six ounces lean ground chicken." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Lean ground chicken β€” card not captured.
Why verdict Logged (write-truth verified): Lean ground chicken β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces lean ground chicken.
2 Β· Card shown Logged six ounces lean ground chicken.
3 Β· App data rows written created food_log_entry: Lean ground chicken Γ—1 (6 oz) 191 cal Β· 32.3g P Β· 0g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:45.380Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Lean ground chicken" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add one cup black-eyed peas." (difficulty β€”)4.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said Which type of black-eyed peas was it? There are several with different nutrition.
2 Β· Card shown Which type of black-eyed peas was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:00.894Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track half a cup pico de gallo." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:12.652Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log two frozen waffles whole grain." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said Did you have syrup, butter, or another topping with it? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Did you have syrup, butter, or another topping with it? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:26.630Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate one plain croissant small." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one plain croissant small? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one plain croissant small? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:40.466Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record five ounces mussels." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Which one did you mean? 1. Mussels (five ounces ), 2. Mussels
2 Β· Card shown Which one did you mean? 1. Mussels (five ounces ), 2. Mussels
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:52.515Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Snack was one Babybel light." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one babybel light. Assumed 1 babybel light as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one babybel light. Assumed 1 babybel light as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Babybel light Γ—1 (1 babybel light) 42 cal Β· 6g P Β· 0g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:11.691Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Babybel light" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add one teaspoon avocado oil." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Avocado oil β€” card not captured.
Why verdict Logged (write-truth verified): Avocado oil β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one teaspoon avocado oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one teaspoon avocado oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Avocado oil Γ—1 (1 tsp) 40 cal Β· 0g P Β· 0g C Β· 4.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:18.065Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Avocado oil" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one cup barley." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked barley β€” card not captured.
Why verdict Logged (write-truth verified): Cooked barley β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup barley. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup barley. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked barley Γ—1 (1 cup) 193 cal Β· 3.6g P Β· 44.3g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:29.368Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked barley" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one medium sweet onion sauteed." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one medium sweet onion sauteed? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one medium sweet onion sauteed? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:43.263Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track eight ounces cold brew coffee." (difficulty β€”)4.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.8s
1 Β· TTS said Which one did you mean? 1. Cold Brew Coffee, 2. Cold Brew Coffee (sixteen ounces )
2 Β· Card shown Which one did you mean? 1. Cold Brew Coffee, 2. Cold Brew Coffee (sixteen ounces )
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:10.872Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count one cup radishes." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Radishes β€” card not captured.
Why verdict Logged (write-truth verified): Radishes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup radishes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup radishes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Radishes Γ—1 (1 cup) 19 cal Β· 0.8g P Β· 3.9g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:22.291Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Radishes" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was six ounces turkey meatballs." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "turkey meatballs": logged 315 kcal vs expected ~220 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "turkey meatballs": logged 315 kcal vs expected ~220 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces turkey meatballs.
2 Β· Card shown Logged six ounces turkey meatballs.
3 Β· App data rows written created food_log_entry: Turkey meatballs Γ—1 (6 oz) 315 cal Β· 30.6g P Β· 10.2g C Β· 17g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:33.547Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Turkey meatballs" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one cup miso soup." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Miso soup β€” card not captured.
Why verdict Logged (write-truth verified): Miso soup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup miso soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup miso soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Miso soup Γ—1 (1 cup) 49 cal Β· 3.7g P Β· 6.6g C Β· 1.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:44.853Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Miso soup" at 90% confidence.
  • Matched your past food logs to "Codex Test Kitchen Miso Soup Bowl" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add three rice crackers." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Rice crackers β€” card not captured.
Why verdict Logged (write-truth verified): Rice crackers β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three rice crackers.
2 Β· Card shown Logged three rice crackers.
3 Β· App data rows written created food_log_entry: Rice crackers Γ—1 (3 rice crackers) 87 cal Β· 2.1g P Β· 17.3g C Β· 1.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:56.149Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Rice crackers" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup blueberries frozen." (difficulty β€”)2.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blueberries, Frozen β€” card not captured.
Why verdict Logged (write-truth verified): Blueberries, Frozen β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Got it, I logged Blueberries, Frozen.
2 Β· Card shown I logged Blueberries, Frozen β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Blueberries, Frozen Γ—1 (one cup (148 g)) 75 cal Β· 0.6g P Β· 18.1g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:09.795Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track two tablespoons tzatziki." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I couldn't convert two tablespoons of Tzatziki from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert two tablespoons of Tzatziki from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:21.070Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate one medium guava." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Guava β€” card not captured.
Why verdict Logged (write-truth verified): Guava β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium guava. Assumed 1 guava as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium guava. Assumed 1 guava as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Guava Γ—1 (1 guava) 37 cal Β· 1.4g P Β· 7.9g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:32.321Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Guava" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put down one cup bulgur." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said I couldn't convert one cup of Bulgur, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert one cup of Bulgur, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:44.229Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record four ounces chicken breast strips." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chicken breast β€” card not captured.
Why verdict Logged (write-truth verified): Chicken breast β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged four ounces chicken breast strips.
2 Β· Card shown Logged four ounces chicken breast strips.
3 Β· App data rows written created food_log_entry: Chicken breast Γ—1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:55.610Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my usual Aloha bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Aloha Chocolate Chip Cookie Dough β€” card not captured.
Why verdict Logged (write-truth verified): Aloha Chocolate Chip Cookie Dough β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
2 Β· Card shown Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Aloha Chocolate Chip Cookie Dough Γ—1 (bar) 220 cal Β· 14g P Β· 24g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Aloha Aloha Chocolate Chip Cookie Dough
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-aloha",
        "name": "Aloha Chocolate Chip Cookie Dough",
        "brand": "Aloha",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 220,
          "proteinGrams": 14,
          "fatGrams": 10,
          "carbsGrams": 24
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual Aloha bar",
      "foodItemId": "seed-f-aloha",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bar",
        "displayLabel": "my usual Aloha bar",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:06:06.932Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual aloha bar" at 96% confidence.
  • Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had my usual labneh." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Plain Labneh β€” card not captured.
Why verdict Logged (write-truth verified): Plain Labneh β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Dairy Plain Labneh. Using your saved "my usual labneh". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Plain Labneh. Using your saved "my usual labneh". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Plain Labneh Γ—1 (cup) 160 cal Β· 10g P Β· 5g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Plain Labneh
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-labneh",
        "name": "Plain Labneh",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 10,
          "fatGrams": 12,
          "carbsGrams": 5
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual labneh",
      "foodItemId": "seed-f-labneh",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual labneh",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:06:18.185Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual labneh" at 96% confidence.
  • Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Lunch was my usual chicken shawarma." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chicken Shawarma Plate β€” card not captured.
Why verdict Logged (write-truth verified): Chicken Shawarma Plate β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Deli Chicken Shawarma Plate. Using your saved "my usual chicken shawarma". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Deli Chicken Shawarma Plate. Using your saved "my usual chicken shawarma". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Shawarma Plate Γ—1 (plate) 480 cal Β· 36g P Β· 40g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Deli Chicken Shawarma Plate
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-shawarma",
        "name": "Chicken Shawarma Plate",
        "brand": "Codex Test Deli",
        "source": "manual",
        "servingLabel": "plate",
        "servingQuantity": 1,
        "servingUnit": "plate",
        "macrosPerServing": {
          "calories": 480,
          "proteinGrams": 36,
          "fatGrams": 18,
          "carbsGrams": 40
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual chicken shawarma",
      "foodItemId": "seed-f-shawarma",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "plate",
        "displayLabel": "my usual chicken shawarma",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:06:29.392Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual chicken shawarma" at 96% confidence.
  • Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was my usual rice." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked Jasmine Rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Jasmine Rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Jasmine Rice Γ—1 (cup) 205 cal Β· 4g P Β· 45g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Jasmine Rice
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-rice",
        "name": "Cooked Jasmine Rice",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 205,
          "proteinGrams": 4,
          "fatGrams": 0.4,
          "carbsGrams": 45
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual rice",
      "foodItemId": "seed-f-rice",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual rice",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:06:40.592Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual rice" at 96% confidence.
  • Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track my usual pistachios." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pistachios β€” card not captured.
Why verdict Logged (write-truth verified): Pistachios β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Pistachios. Using your saved "my usual pistachios". Tell me if that is wrong.
2 Β· Card shown Logged Pistachios. Using your saved "my usual pistachios". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Pistachios Γ—1 (ounce) 160 cal Β· 6g P Β· 8g C Β· 13g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pistachios
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-pistachio",
        "name": "Pistachios",
        "brand": null,
        "source": "manual",
        "servingLabel": "ounce",
        "servingQuantity": 1,
        "servingUnit": "oz",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 6,
          "fatGrams": 13,
          "carbsGrams": 8
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual pistachios",
      "foodItemId": "seed-f-pistachio",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "ounce",
        "displayLabel": "my usual pistachios",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:06:51.835Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual pistachios" at 96% confidence.
  • Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my default almond milk." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Unsweetened Almond Milk β€” card not captured.
Why verdict Logged (write-truth verified): Unsweetened Almond Milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Unsweetened Almond Milk. Using your saved "my default almond milk". Tell me if that is wrong.
2 Β· Card shown Logged Unsweetened Almond Milk. Using your saved "my default almond milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Unsweetened Almond Milk Γ—1 (cup) 30 cal Β· 1g P Β· 1g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Unsweetened Almond Milk
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-almondmilk",
        "name": "Unsweetened Almond Milk",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 30,
          "proteinGrams": 1,
          "fatGrams": 2.5,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my default almond milk",
      "foodItemId": "seed-f-almondmilk",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my default almond milk",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:03.079Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my default almond milk" at 96% confidence.
  • Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my usual evening chai." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chai Latte β€” card not captured.
Why verdict Logged (write-truth verified): Chai Latte β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Chai Latte. Using your saved "my usual evening chai". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Chai Latte. Using your saved "my usual evening chai". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chai Latte Γ—1 (cup) 120 cal Β· 4g P Β· 20g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Cafe Chai Latte
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-chai",
        "name": "Chai Latte",
        "brand": "Codex Test Cafe",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 120,
          "proteinGrams": 4,
          "fatGrams": 3,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual evening chai",
      "foodItemId": "seed-f-chai",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual evening chai",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:14.299Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual evening chai" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had my normal grits." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Grits. Using your saved "my normal grits". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Grits. Using your saved "my normal grits". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Grits Γ—1 (cup) 145 cal Β· 3g P Β· 31g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Grits
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-grits",
        "name": "Cooked Grits",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 145,
          "proteinGrams": 3,
          "fatGrams": 0.5,
          "carbsGrams": 31
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my normal grits",
      "foodItemId": "seed-f-grits",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my normal grits",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:25.550Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my normal grits" at 96% confidence.
  • Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track my go-to cold brew." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cold Brew Coffee β€” card not captured.
Why verdict Logged (write-truth verified): Cold Brew Coffee β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Cold Brew Coffee. Using your saved "my go to cold brew". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Cold Brew Coffee. Using your saved "my go to cold brew". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cold Brew Coffee Γ—1 (cup) 5 cal Β· 0.3g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Cafe Cold Brew Coffee
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-coldbrew",
        "name": "Cold Brew Coffee",
        "brand": "Codex Test Cafe",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 5,
          "proteinGrams": 0.3,
          "fatGrams": 0,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my go-to cold brew",
      "foodItemId": "seed-f-coldbrew",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my go-to cold brew",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:36.815Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my go to cold brew" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my usual bedtime cocoa." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Hot Cocoa Water β€” card not captured.
Why verdict Logged (write-truth verified): Hot Cocoa Water β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Hot Cocoa Water. Using your saved "my usual bedtime cocoa". Tell me if that is wrong.
2 Β· Card shown Logged Hot Cocoa Water. Using your saved "my usual bedtime cocoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Hot Cocoa Water Γ—1 (cup) 80 cal Β· 2g P Β· 16g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Hot Cocoa Water
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-cocoa",
        "name": "Hot Cocoa Water",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 80,
          "proteinGrams": 2,
          "fatGrams": 1,
          "carbsGrams": 16
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual bedtime cocoa",
      "foodItemId": "seed-f-cocoa",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual bedtime cocoa",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:48.063Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual bedtime cocoa" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add the same feta as yesterday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Feta Crumbles" β€” no saved row with matching identity (rows: Feta cheese)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Feta Crumbles" β€” no saved row with matching identity (rows: Feta cheese)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Feta cheese. Using your recent Feta cheese history. Tell me if that is wrong.
2 Β· Card shown Logged Feta cheese. Using your recent Feta cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Feta cheese Γ—1 (0.5 cup) 198 cal Β· 10.6g P Β· 3.1g C Β· 16g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Feta Crumbles
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-feta",
        "name": "Feta Crumbles",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 10,
          "fatGrams": 16,
          "carbsGrams": 3
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 0.5 for seed-f-hist-feta at 2026-07-17T13:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-feta",
      "quantity": 0.5,
      "loggedAt": "2026-07-17T13:00:00.000Z"
    }
snapshot captured 2026-08-02T22:08:10.851Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Feta cheese" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Same Aloha bar as yesterday." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Aloha Protein Bar" β€” no saved row with matching identity (rows: Aloha Chocolate Chip Cookie Dough)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Aloha Protein Bar" β€” no saved row with matching identity (rows: Aloha Chocolate Chip Cookie Dough)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
2 Β· Card shown Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Aloha Chocolate Chip Cookie Dough Γ—1 (bar) 220 cal Β· 14g P Β· 24g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Aloha Aloha Protein Bar
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-aloha",
        "name": "Aloha Protein Bar",
        "brand": "Aloha",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 220,
          "proteinGrams": 14,
          "fatGrams": 10,
          "carbsGrams": 24
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-aloha at 2026-07-17T16:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-aloha",
      "quantity": 1,
      "loggedAt": "2026-07-17T16:00:00.000Z"
    }
snapshot captured 2026-08-02T22:08:22.100Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log the same miso soup I had last night." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Miso soup β€” card not captured.
Why verdict Logged (write-truth verified): Miso soup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Miso soup. Using your recent Miso soup history. Tell me if that is wrong.
2 Β· Card shown Logged Miso soup. Using your recent Miso soup history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Miso soup Γ—1 (1 cup) 49 cal Β· 3.7g P Β· 6.6g C Β· 1.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Miso Soup Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-miso",
        "name": "Miso Soup Bowl",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 50,
          "proteinGrams": 3,
          "fatGrams": 1,
          "carbsGrams": 6
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-miso at 2026-07-17T19:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-miso",
      "quantity": 1,
      "loggedAt": "2026-07-17T19:30:00.000Z"
    }
snapshot captured 2026-08-02T22:08:33.515Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Miso soup" at 90% confidence.
  • Matched your past food logs to "Miso soup" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same oatmeal as this morning." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
2 Β· Card shown Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oatmeal Bowl Γ—1 (bowl) 150 cal Β· 5g P Β· 27g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Oatmeal Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-oats",
        "name": "Oatmeal Bowl",
        "brand": null,
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 5,
          "fatGrams": 2.5,
          "carbsGrams": 27
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-oats at 2026-07-18T07:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-oats",
      "quantity": 1,
      "loggedAt": "2026-07-18T07:30:00.000Z"
    }
snapshot captured 2026-08-02T22:08:44.851Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add the same ahi I had earlier." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Seared Ahi Tuna β€” card not captured.
Why verdict Logged (write-truth verified): Seared Ahi Tuna β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Seared Ahi Tuna. Using your recent Seared Ahi Tuna history. Tell me if that is wrong.
2 Β· Card shown Logged Seared Ahi Tuna. Using your recent Seared Ahi Tuna history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Seared Ahi Tuna Γ—1 (five ounces (141.7 g)) 184 cal Β· 41.1g P Β· 0g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Seared Ahi Tuna
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-ahi",
        "name": "Seared Ahi Tuna",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 38,
          "fatGrams": 2,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-ahi at 2026-07-18T12:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-ahi",
      "quantity": 1,
      "loggedAt": "2026-07-18T12:30:00.000Z"
    }
snapshot captured 2026-08-02T22:08:56.178Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Ahi tuna" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same smoothie as yesterday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cherry Protein Smoothie β€” card not captured.
Why verdict Logged (write-truth verified): Cherry Protein Smoothie β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Recipe Cherry Protein Smoothie. Using your recent Codex Test Recipe Cherry Protein Smoothie history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Cherry Protein Smoothie. Using your recent Codex Test Recipe Cherry Protein Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cherry Protein Smoothie Γ—1 (smoothie) 270 cal Β· 22g P Β· 32g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Recipe Cherry Protein Smoothie
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-smooth",
        "name": "Cherry Protein Smoothie",
        "brand": "Codex Test Recipe",
        "source": "manual",
        "servingLabel": "smoothie",
        "servingQuantity": 1,
        "servingUnit": "smoothie",
        "macrosPerServing": {
          "calories": 270,
          "proteinGrams": 22,
          "fatGrams": 4,
          "carbsGrams": 32
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-smooth at 2026-07-17T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-smooth",
      "quantity": 1,
      "loggedAt": "2026-07-17T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:09:07.509Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log the shrimp I had last time." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I heard you want the same the shrimp I had last time as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
2 Β· Card shown I heard you want the same the shrimp I had last time as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Grilled Shrimp
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-shrimp",
        "name": "Grilled Shrimp",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 170,
          "proteinGrams": 36,
          "fatGrams": 2,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-hist-shrimp at 2026-07-16T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-shrimp",
      "quantity": 1,
      "loggedAt": "2026-07-16T18:00:00.000Z"
    }
snapshot captured 2026-08-02T22:09:18.803Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Shrimp" at 90% confidence.
  • Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Same tortilla as earlier today." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” MACROS off for "Corn Tortilla": logged 122 kcal vs expected ~50 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β€” MACROS off for "Corn Tortilla": logged 122 kcal vs expected ~50 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Corn tortilla. Using your recent Corn tortilla history. Tell me if that is wrong.
2 Β· Card shown Logged Corn tortilla. Using your recent Corn tortilla history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ—1 (2 corn tortillas) 122 cal Β· 3.2g P Β· 25g C Β· 1.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Corn Tortilla
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-hist-tort",
        "name": "Corn Tortilla",
        "brand": null,
        "source": "manual",
        "servingLabel": "tortilla",
        "servingQuantity": 1,
        "servingUnit": "tortilla",
        "macrosPerServing": {
          "calories": 50,
          "proteinGrams": 1.2,
          "fatGrams": 0.7,
          "carbsGrams": 10
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 2 for seed-f-hist-tort at 2026-07-18T07:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-hist-tort",
      "quantity": 2,
      "loggedAt": "2026-07-18T07:00:00.000Z"
    }
snapshot captured 2026-08-02T22:09:30.099Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Tortilla" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was one Larabar cashew cookie." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said What exact food and amount should I use for one larabar cashew cookie? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one larabar cashew cookie? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:41.818Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Finished one Fairlife Core Power banana shake." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:53.502Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one Fage total zero strawberry cup." (difficulty β€”)3.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:08.283Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save one Aloha chocolate mint bar." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chocolate Mint Organic Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): Chocolate Mint Organic Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Chocolate Mint Organic Protein Bar β€” ALOHA with an estimated macro range.
2 Β· Card shown Logged Chocolate Mint Organic Protein Bar β€” ALOHA β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Chocolate Mint Organic Protein Bar Γ—1 (1 Bar) 220 cal Β· 14g P Β· 26g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:19.973Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate one RXBAR mixed berry." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said What exact food and amount should I use for one rxbar mixed berry? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one rxbar mixed berry? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:31.745Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log a papaya and one Aloha bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Papaya, Aloha Protein Bar, Chocolate Espresso β€” card not captured.
Why verdict Logged (write-truth verified): Papaya, Aloha Protein Bar, Chocolate Espresso β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged a papaya and Aloha Protein Bar, Chocolate Espresso β€” Aloha. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged a papaya and Aloha Protein Bar, Chocolate Espresso β€” Aloha. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Papaya Γ—1 (100 g) 43 cal Β· 0.5g P Β· 10.8g C Β· 0.3g F
created food_log_entry: Aloha Protein Bar, Chocolate Espresso Γ—1 (1 bar (1 serving (56 g))) 230 cal Β· 14g P Β· 26g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:43.519Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had oatmeal and cold brew." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Cooked oatmeal and cold brew. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked oatmeal and cold brew. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F
created food_log_entry: cold brew Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:55.196Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was sunny side eggs and corn tortillas." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Egg and Corn tortilla. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Egg and Corn tortilla. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (50 g) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F
created food_log_entry: Corn tortilla Γ—1 (28 g) 61 cal Β· 1.6g P Β· 12.5g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:06.712Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a turkey burger and a tangerine." (difficulty β€”)1.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said I need to resolve a turkey burger before I log this meal. What should I use for a turkey burger?
2 Β· Card shown I need to resolve a turkey burger before I log this meal. What should I use for a turkey burger?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:19.656Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was pistachios and cherries." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Pistachios and Cherries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Pistachios and Cherries? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:31.082Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "pistachios" at 90% confidence.
  • Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was ahi and roasted carrots." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Ahi tuna and Baby carrots? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Ahi tuna and Baby carrots? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:42.485Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Baby carrots" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate labneh and blueberries." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Labneh and Blueberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh and Blueberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:53.898Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Blueberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track shrimp and jasmine rice." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Shrimp and Cooked jasmine rice? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Shrimp and Cooked jasmine rice? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:17.092Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
  • Matched your past food logs to "jasmine rice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add feta and jicama." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Feta cheese and Jicama? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Feta cheese and Jicama? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:28.636Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Jicama" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had a Larabar and sparkling lime water." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Larabar, Water β€” card not captured.
Why verdict Logged (write-truth verified): Larabar, Water β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Larabar β€” Larabar and Water. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Larabar β€” Larabar and Water. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Larabar Γ—1 (55 g) 200 cal Β· 20g P Β· 22g C Β· 7g F
created food_log_entry: Water Γ—1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:40.461Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log miso soup and bok choy." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Miso soup and Bok choy? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Miso soup and Bok choy? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:52.035Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "miso soup" at 90% confidence.
  • Matched the common-food list to "Miso soup" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was oatmeal, yogurt, and coffee." (difficulty β€”)0.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Cooked oatmeal, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked oatmeal, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F
created food_log_entry: Plain Greek yogurt Γ—1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F
created food_log_entry: Coffee Γ—1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:03.710Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a guava, Babybel light, and rice crackers." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Babybel light and Rice crackers? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Babybel light and Rice crackers? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:15.262Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Rice crackers" at 90% confidence.
  • Matched your saved foods and aliases to "Rice crackers" at 66% confidence.
  • Matched your saved foods and aliases to "one babybel light" at 66% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was turkey meatballs, barley, and beets." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Turkey meatballs, Cooked barley, and Beets? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Turkey meatballs, Cooked barley, and Beets? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:26.884Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked barley" at 90% confidence.
  • Matched your past food logs to "Turkey meatballs" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was radishes and tzatziki." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Radishes and Tzatziki? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Radishes and Tzatziki? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:38.273Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Radishes" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a grain bowl and iced tea." (difficulty β€”)1.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Grain Bowl Γ—1 (serving) 313 cal Β· 8.1g P Β· 55.7g C Β· 6.7g F
created food_log_entry: Unsweetened iced tea Γ—1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:52.492Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had rice, kidney beans, and ground chicken." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Cooked white rice, Beans, and Lean ground chicken. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked white rice, Beans, and Lean ground chicken. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ—1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F
created food_log_entry: Beans Γ—1 (86 g) 109 cal Β· 7.5g P Β· 19.6g C Β· 0.4g F
created food_log_entry: Lean ground chicken Γ—1 (100 g) 112 cal Β· 19g P Β· 0g C Β· 3.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:04.336Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track labneh, honey, and pistachios." (difficulty β€”)0.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said How much should I log for Labneh, Honey, and Pistachios? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh, Honey, and Pistachios? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:16.144Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "pistachios" at 90% confidence.
  • Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add eggs, chicken sausage, and pineapple juice." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Logged Egg, AMYLU Chicken Sausage, and Pineapple Juice, 100%. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Egg, AMYLU Chicken Sausage, and Pineapple Juice, 100%. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (50 g) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F
created food_log_entry: AMYLU Chicken Sausage Γ—1 (one) 110 cal Β· 12g P Β· 1g C Β· 6g F
created food_log_entry: Pineapple Juice, 100% Γ—1 (1 fl oz (no ice)) 16 cal Β· 0.1g P Β· 4g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:28.190Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate pasta and a side of butter lettuce." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Cooked pasta and Butter lettuce. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked pasta and Butter lettuce. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ—1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
created food_log_entry: Butter lettuce Γ—1 (55 g) 7 cal Β· 0.8g P Β· 1.2g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:39.704Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a kiwi and cashew butter." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much should I log for Cashew butter? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Cashew butter? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:51.305Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cashew butter" at 90% confidence.
  • Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was cereal and almond milk." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said I need to resolve cereal before I log this meal. What should I use for cereal?
2 Β· Card shown I need to resolve cereal before I log this meal. What should I use for cereal?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:03.541Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had huevos rancheros with two eggs, salsa, and black beans" (difficulty β€”)6.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.2s
1 Β· TTS said Which black beans should I use?
2 Β· Card shown Which black beans should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:20.965Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a smoothie with cherries, kale, and casein protein." (difficulty β€”)2.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.9s
1 Β· TTS said Which kale should I use?
2 Β· Card shown Which kale should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:35.042Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a grain bowl with bulgur, lentils, and yogurt sauce." (difficulty β€”)12.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 12.8s
1 Β· TTS said What should I use for yogurt sauce?
2 Β· Card shown What should I use for yogurt sauce?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:58.986Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Breakfast was breakfast burrito with egg, potato, and cheese." (difficulty β€”)3.6s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β€” no saved row captured (untagged / lossy) β€” resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said Logging your Breakfast was breakfast burrito with egg, potato, and cheese β€” still looking up the nutrition details; they'll appear in your log shortly.
2 Β· Card shown Logging your Breakfast was breakfast burrito with egg, potato, and cheese β€” still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: Breakfast was breakfast burrito with egg, potato, and cheese (pending)
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:20.267Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I made jambalaya with shrimp, sausage, rice, and peppers." (difficulty β€”)2.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Which shrimp should I use?
2 Β· Card shown Which shrimp should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:27.138Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was a taco bowl with rice, carnitas, pico, and guacamole." (difficulty β€”)2.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said What should I use for pico?
2 Β· Card shown What should I use for pico?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:52.304Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had ramen with chicken and corn." (difficulty β€”)3.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said Which corn should I use?
2 Β· Card shown Which corn should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:06.826Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a chicken sandwich with pickles and mustard." (difficulty β€”)0.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What should I use for pickles?
2 Β· Card shown What should I use for pickles?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:18.824Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I built an acai bowl with granola, pineapple, and coconut." (difficulty β€”)4.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said Which coconut should I use?
2 Β· Card shown Which coconut should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:34.538Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was green curry with tofu, eggplant, and jasmine rice." (difficulty β€”)5.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.9s
1 Β· TTS said Which eggplant should I use?
2 Β· Card shown Which eggplant should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:51.551Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add some grits." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Instant grits? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Instant grits? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:02.793Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had bulgur." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said How much bulgur did you have?
2 Β· Card shown How much bulgur did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:14.712Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log jasmine rice for dinner." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said How much should I log for Cooked jasmine rice? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Cooked jasmine rice? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:27.191Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
  • Matched your past food logs to "jasmine rice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track ramen noodles." (difficulty β€”)3.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS said How much ramen noodles did you have?
2 Β· Card shown How much ramen noodles did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:42.024Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate tortilla chips." (difficulty β€”)1.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said How much tortilla chips did you have?
2 Β· Card shown How much tortilla chips did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:54.889Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add pistachios." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Pistachios? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pistachios? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:06.091Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "pistachios" at 90% confidence.
  • Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Log a bowl of miso." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a bowl of miso? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bowl of miso? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:19.959Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of jambalaya." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a plate of jambalaya? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a plate of jambalaya? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:33.883Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track pineapple juice." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much pineapple juice did you have?
2 Β· Card shown How much pineapple juice did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:45.353Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add cold brew." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said How much cold brew did you have?
2 Β· Card shown How much cold brew did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:57.742Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I drank margarita." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much margarita did you have?
2 Β· Card shown How much margarita did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:09.021Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log sherbet." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much sherbet did you have?
2 Β· Card shown How much sherbet did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:20.539Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Had some mixed seeds." (difficulty β€”)2.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said How much mixed seeds did you have?
2 Β· Card shown How much mixed seeds did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:33.762Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Add popcorn." (difficulty β€”)1.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said How much popcorn did you have?
2 Β· Card shown How much popcorn did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:46.643Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had an Aloha bar." (difficulty β€”)0.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Which one did you mean? 1. Protein Bar β€” Aloha (bar), 2. Protein Bar, Chocolate Espresso β€” Aloha, 3. Chocolate Mint Organic Protein Bar β€” ALOHA, 4. Chocolate Chip Cookie Dough Protein Bar β€” Aloha
2 Β· Card shown Which one did you mean? 1. Protein Bar β€” Aloha (bar), 2. Protein Bar, Chocolate Espresso β€” Aloha, 3. Chocolate Mint Organic Protein Bar β€” ALOHA, 4. Chocolate Chip Cookie Dough Protein Bar β€” Aloha
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:58.387Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a labneh cup." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a labneh cup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a labneh cup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Labneh Γ—1 (1 cup) 192 cal Β· 12g P Β· 6g C Β· 14.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:21.342Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Labneh" at 90% confidence.
  • Matched your past food logs to "Codex Test Dairy Plain Labneh" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Track a nut milk." (difficulty β€”)3.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said Which one did you mean? 1. my default almond milk, 2. one cup almond milk unsweetened, 3. one cup unsweetened almond milk, 4. unsweetened almond milk
2 Β· Card shown Which one did you mean? 1. my default almond milk, 2. one cup almond milk unsweetened, 3. one cup unsweetened almond milk, 4. unsweetened almond milk
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:36.304Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a burrito." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which one did you mean? 1. Burrito, Beef, with Beans and Rice, Cheese, 2. Burrito, Chicken, with Beans and Rice, Cheese
2 Β· Card shown Which one did you mean? 1. Burrito, Beef, with Beans and Rice, Cheese, 2. Burrito, Chicken, with Beans and Rice, Cheese
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:48.233Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a meal shake." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said I couldn't find Add A Meal Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
2 Β· Card shown I couldn't find Add A Meal Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:00.589Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had cold brew with cream." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said How much cold brew with cream did you have?
2 Β· Card shown How much cold brew with cream did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:13.161Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a biscuit." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which one did you mean? 1. Biscuit, From Fast Food / Restaurant, 2. Biscuit, From Refrigerated Dough
2 Β· Card shown Which one did you mean? 1. Biscuit, From Fast Food / Restaurant, 2. Biscuit, From Refrigerated Dough
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:25.119Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Track a turkey burger." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Logged Turkey Burger Patty with an estimated macro range.
2 Β· Card shown Logged Turkey Burger Patty β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Turkey Burger Patty Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:37.713Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had personal pizza." (difficulty β€”)5.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:55.468Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Add a biscuit sandwich." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged ice cream sandwich with an estimated macro range.
2 Β· Card shown Logged ice cream sandwich β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: ice cream sandwich Γ—1 (serving) 200 cal Β· 5g P Β· 20g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:05.661Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual cold brew size." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged cold brew. Using your saved "log my usual cold brew size". Tell me if that is wrong.
2 Β· Card shown Logged cold brew. Using your saved "log my usual cold brew size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: cold brew Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: cold brew
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-brew-confirm",
        "name": "cold brew",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "log my usual cold brew size",
      "foodItemId": "seed-f-brew-confirm",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "log my usual cold brew size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:23:17.011Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "log my usual cold brew size" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add the regular dinner portion." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
2 Β· Card shown Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: dinner portion Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: dinner portion
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-dinner-portion",
        "name": "dinner portion",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "add the regular dinner portion",
      "foodItemId": "seed-f-dinner-portion",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "add the regular dinner portion",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:23:28.289Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "add the regular dinner portion" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track my default afternoon snack." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
2 Β· Card shown Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: snack
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-snack-amt",
        "name": "snack",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "track my default afternoon snack",
      "foodItemId": "seed-f-snack-amt",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "track my default afternoon snack",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:23:39.616Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "track my default afternoon snack" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had the usual breakfast size." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
2 Β· Card shown Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: breakfast
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-bfast-size",
        "name": "breakfast",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "i had the usual breakfast size",
      "foodItemId": "seed-f-bfast-size",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "i had the usual breakfast size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:23:51.171Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "i had the usual breakfast size" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Three quarters of a cup." (difficulty β€”)2.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I couldn't find Quarter's A Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Quarter's A Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:04.244Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One and a half cups, plain." (difficulty β€”)1.4s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:16.824Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"The Aloha chocolate mint." (difficulty β€”)3.9s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said I couldn't find "Aloha Chocolate Mint" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
2 Β· Card shown I couldn't find "Aloha Chocolate Mint" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:31.900Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Aloha Chocolate Chip Cookie Dough" at 84% confidence.
  • Matched your past food logs to "ALOHA Chocolate Mint Organic Protein Bar" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Unsweetened almond milk." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Unsweetened almond milk? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Unsweetened almond milk? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:43.131Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Unsweetened almond milk" at 98% confidence.
  • Matched your saved foods and aliases to "unsweetened almond milk" at 96% confidence.
  • Matched your saved foods and aliases to "Unsweetened almond milk" at 84% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not it β€” the unsweetened one." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about breakfast?
2 Β· Card shown What should I change about breakfast?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:54.389Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Wrong one. The cherry, not grape." (difficulty β€”)0.6s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Cherries and Grapes. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cherries and Grapes. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cherries Γ—1 (154 g) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F
created food_log_entry: Grapes Γ—1 (100 g) 69 cal Β· 0.7g P Β· 18.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:06.105Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, not the flavored labneh." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Grapes?
2 Β· Card shown What should I change about Grapes?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:17.291Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Cancel that entry." (difficulty β€”)0.1s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pending Food Item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-corr-pending-3",
        "name": "Pending Food Item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-corr-pending-3 at 2026-07-18T11:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-corr-pending-3",
      "quantity": 1,
      "loggedAt": "2026-07-18T11:00:00.000Z"
    }
snapshot captured 2026-08-02T22:25:40.103Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould decline"Never mind, remove that." (difficulty β€”)1.3s
Verdict Expected DECLINE β€” should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pending Food Item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-corr-pending-4",
        "name": "Pending Food Item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-corr-pending-4 at 2026-07-18T11:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-corr-pending-4",
      "quantity": 1,
      "loggedAt": "2026-07-18T11:00:00.000Z"
    }
snapshot captured 2026-08-02T22:25:52.759Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not the bar I meant." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Cherries?
2 Β· Card shown What should I change about Cherries?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:03.987Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"Not the large β€” the small tangerine." (difficulty β€”)2.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said Got it. Logging the small tangerine instead.
2 Β· Card shown Got it. Logging the small tangerine instead.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:17.212Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong item. Pick the seared ahi." (difficulty β€”)5.3s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for wrong item pick the seared ahi? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for wrong item pick the seared ahi? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:34.337Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"That's not it; the plain one." (difficulty β€”)4.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.8s
1 Β· TTS said I couldn't find "plain one" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find "plain one" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:00.884Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"No, the other tortilla." (difficulty β€”)2.3s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Updated to the other tortilla.
2 Β· Card shown Updated the food entry from "Cherries" to "the other tortilla".
3 Β· App data rows written updated food_log_entry: Tortilla Γ—1 (45 g) 140 cal Β· 3.8g P Β· 22.5g C Β· 3.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:14.295Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not those pistachios β€” the roasted ones." (difficulty β€”)3.9s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said What exact food and amount should I use for Pistachios? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pistachios? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:40.536Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the tangerine from earlier." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:03.000Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove that Aloha bar." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:14.216Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the grits entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:25.444Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:36.642Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "egg" at 90% confidence.
  • Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove the cherries." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:47.843Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "cherries" at 90% confidence.
  • Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the shrimp log." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:59.093Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Shrimp" at 90% confidence.
  • Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Scratch the cashew butter." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:10.371Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cashew butter" at 90% confidence.
  • Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove the almond milk entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:24.198Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
  • Matched your past food logs to "Unsweetened Almond Milk" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete that churro I logged last night." (difficulty β€”)0.7s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Deleted churro.
2 Β· Card shown Deleted churro.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: churro
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-0-churro",
        "name": "churro",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-0-churro at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-0-churro",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:29:41.717Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove yesterday's ice cream sandwich." (difficulty β€”)0.0s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: ice cream sandwich
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-1-ice-cream-sandwich",
        "name": "ice cream sandwich",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-1-ice-cream-sandwich at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-1-ice-cream-sandwich",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:29:57.466Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "ice cream sandwich" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete the leftover taco entry." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted taco.
2 Β· Card shown Deleted taco.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: taco
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-2-taco",
        "name": "taco",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-2-taco at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-2-taco",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:30:15.873Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Take out the margarita from last night." (difficulty β€”)5.5s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.5s
1 Β· TTS said I didn't make any changes to your food log. To remove an item, please specify the exact food and time to delete.
2 Β· Card shown I didn't make any changes to your food log. To remove an item, please specify the exact food and time to delete.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: margarita
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-3-margarita",
        "name": "margarita",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-3-margarita at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-3-margarita",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:30:25.609Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Remove the doughnut log from earlier this week." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted doughnut.
2 Β· Card shown Deleted doughnut.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: doughnut
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-4-doughnut",
        "name": "doughnut",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-4-doughnut at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-4-doughnut",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:30:43.928Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete the chips I shouldn't have logged." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted chips.
2 Β· Card shown Deleted chips.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: chips
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-del-5-chips",
        "name": "chips",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-del-5-chips at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-del-5-chips",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:30:55.263Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Potato chips" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the sequence tangerine quantity to two." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:30:59.561Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Actually make the Aloha bar two bars." (difficulty β€”)0.8s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which exact aloha bar two bars should replace Aloha Protein Bar, Chocolate Espresso?
2 Β· Card shown Which exact aloha bar two bars should replace Aloha Protein Bar, Chocolate Espresso?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:11.590Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Update the grits to one and a half cups." (difficulty β€”)0.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Cooked Grits to 1.5 cup.
2 Β· Card shown Updated Cooked Grits to 1.5 cup.
3 Β· App data rows written updated food_log_entry: Cooked Grits Γ—1.5 (cup) 218 cal Β· 4.5g P Β· 46.5g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:22.924Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the eggs to three." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:34.133Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "egg" at 90% confidence.
  • Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Make the cherries a half cup." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:45.359Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "cherries" at 90% confidence.
  • Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Update the shrimp to eight ounces." (difficulty β€”)0.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Shrimp to 8 oz.
2 Β· Card shown Updated Shrimp to 8 oz.
3 Β· App data rows written updated food_log_entry: Shrimp Γ—1.3333333333333335 (6 oz) 224 cal Β· 54.4g P Β· 0.4g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:56.789Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Shrimp" at 90% confidence.
  • Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change cashew butter to two tablespoons." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:08.004Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cashew butter" at 90% confidence.
  • Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually the almond milk was vanilla, not plain." (difficulty β€”)3.2s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said Updated to vanilla almond milk.
2 Β· Card shown Updated the food entry from "Unsweetened Almond Milk" to "vanilla almond milk".
3 Β· App data rows written updated food_log_entry: Unsweetened almond milk Γ—1 (100 g) 13 cal Β· 0.4g P Β· 0.3g C Β· 1.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:22.502Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Actually that was mint, not chocolate." (difficulty β€”)0.2s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Which exact mint should replace Tortilla?
2 Β· Card shown Which exact mint should replace Tortilla?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: chocolate item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-0-chocolate-item",
        "name": "chocolate item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-0-chocolate-item at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-0-chocolate-item",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:32:33.823Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the portion to one and a half cups." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: jasmine rice
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-1-jasmine-rice",
        "name": "jasmine rice",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-1-jasmine-rice at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-1-jasmine-rice",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:32:45.199Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Make it a quarter cup instead." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: grits
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-2-grits",
        "name": "grits",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-2-grits at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-2-grits",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:32:56.625Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Update that to eight ounces." (difficulty β€”)0.2s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Updated Tortilla to 8 oz.
2 Β· Card shown Updated Tortilla to 8 oz.
3 Β· App data rows written updated food_log_entry: Tortilla Γ—1.4727012987012986 (154 g) 206 cal Β· 5.6g P Β· 33.1g C Β· 5.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: shrimp
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-3-shrimp",
        "name": "shrimp",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-3-shrimp at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-3-shrimp",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:07.905Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually it was peanut butter, not cashew butter." (difficulty β€”)1.6s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said Updated to peanut butter.
2 Β· Card shown Updated the food entry from "Tortilla" to "peanut butter".
3 Β· App data rows written updated food_log_entry: Peanut butter Γ—1 (32 g) 188 cal Β· 8g P Β· 6.3g C Β· 16.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: cashew butter
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-4-cashew-butter",
        "name": "cashew butter",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-4-cashew-butter at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-4-cashew-butter",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:20.637Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the tangerine to a small." (difficulty β€”)2.6s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said Which exact small tangerine should replace tangerine?
2 Β· Card shown Which exact small tangerine should replace tangerine?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: tangerine
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-f-edit-5-tangerine",
        "name": "tangerine",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-f-edit-5-tangerine at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-f-edit-5-tangerine",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:34.434Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein remains for today?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:33:45.681Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories have I tracked?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:08.564Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat two nights ago?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said No β€” I do not see two nights ago logged today.
2 Β· Card shown No β€” I do not see two nights ago logged today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:19.750Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much potassium today?" (difficulty β€”)0.0s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:30.921Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's left in my protein budget?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You are about 8070 calories over today's 2200 calorie budget (10270 logged).
2 Β· Card shown You are about 8070 calories over today's 2200 calorie budget (10270 logged).
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:42.123Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log brunch yet?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said No β€” I do not see brunch logged today.
2 Β· Card shown No β€” I do not see brunch logged today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:53.526Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs are on the board?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:35:04.780Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)