πŸ“Š Status Dashboard ↑ all runs

food-corpus-mixed-G-324f4ab3-c63-20260802

food-corpus-mixed-G Β· preserved partial run Β· iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
176
Pass
98 (56%)
Fail
66 (38%)
Unverified
12 (7%)
Pass rate
60%
Avg difficulty
β€”
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β€” needs a human look (that's you πŸ‘/πŸ‘Ž-ing it). "Pass rate" = pass Γ· (pass + fail) β€” it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 12 unclassified β€” the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened β€” comprehension vs execution vs cosmetic

Comprehension β€” picked the wrong action/target (the hard problem)
65 (98%)
Execution β€” right decision, output broke (plumbing)
1 (2%)
Of 66 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? β€” by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
β–Έ LOG β€” log the entry 8040 (50%) 39 (49%) 1 (1%)
β–Έ CLARIFY β€” ask a clarifying question 5345 (85%) 8 (15%) 0 (0%)
β–Έ DELETE β€” delete the entry 147 (50%) 6 (43%) 1 (7%)
β–Έ UPDATE β€” update the entry 144 (29%) 10 (71%) 0 (0%)
β–Έ CLARIFY_ANSWER β€” complete the pending action 132 (15%) 2 (15%) 9 (69%)
β–Έ DECLINE β€” decline 10 (0%) 1 (100%) 0 (0%)
β–Έ QUERY β€” answer the query 10 (0%) 0 (0%) 1 (100%)
Total17698 (60%)6612

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) β€” this bar chart lights up once that lands.

Clarification follow-ups β€” scored separately

Second turn: app asked, we replied β€” did it resolve correctly?
Follow-ups
13
Resolved
2 (15%)
Mishandled
2 (15%)
Unverified
9

Cosmetic only

Not yet classified β€” pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified β€” pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
1.2s
p90
3.6s
Max
8.8s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β€” click any dot to jump to its detail.
0s
1s
2s
5s
10s
9s
Response path β€” quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
123
Sync clarification
53
Slowest 8 utterances (click to jump to detail):
"I had a grain bowl with millet, mung beans, and muhammara."8.8s
"Not the large β€” the medium blood orange."6.8s
"Lunch included three ounces duck breast skinless."6.5s
"Log mochi ice cream."5.6s
"I had one cup buckwheat porridge with water only."5.6s
"Save one cup roasted broccoli florets."5.4s
"I had naan pizza."5.3s
"Change the blood orange to a large."5.0s

Filter β€” controls the list below

Pass / Fail / Unverified
PASS 98 FAIL 66 UNVERIFIED 12
Module (intended for)
Food (176)
Utterance sub-type (within module)
176 shown β€” 98 pass, 66 fail, 12 unverified

Per-utterance detail

PASSshould log the entry"Log one medium blood orange for the sequence." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blood orange β€” card not captured.
Why verdict Logged (write-truth verified): Blood orange β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium blood orange for the sequence. Assumed 1 blood orange as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium blood orange for the sequence. Assumed 1 blood orange as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blood orange Γ—1 (1 blood orange) 70 cal Β· 1.3g P Β· 18.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:21.408Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Blood orange" at 90% confidence.
  • Matched your past food logs to "blood orange" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one No Cow cookie dough bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
2 Β· Card shown I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:32.675Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "No Cow Cookie Dough" at 90% confidence.
  • Matched your past food logs to "cookie dough item" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had one cup buckwheat porridge with water only." (difficulty β€”)5.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.6s
1 Β· TTS said What exact food and amount should I use for one cup buckwheat porridge with water only? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup buckwheat porridge with water only? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:49.910Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add two soft boiled eggs for lunch." (difficulty β€”)4.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.7s
1 Β· TTS said What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:05.683Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup gooseberries as a snack." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Gooseberries β€” card not captured.
Why verdict Logged (write-truth verified): Gooseberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup gooseberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup gooseberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Gooseberries Γ—1 (1 cup) 66 cal Β· 1.4g P Β· 15.3g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:17.140Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Gooseberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record five ounces grilled swordfish." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said I couldn't convert five ounces of swordfish from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert five ounces of swordfish from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:28.464Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon walnut butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Walnut butter β€” card not captured.
Why verdict Logged (write-truth verified): Walnut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon walnut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon walnut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Walnut butter Γ—1 (1 tbsp) 95 cal Β· 2g P Β· 2g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:39.787Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Walnut butter" at 90% confidence.
  • Matched your past food logs to "walnut butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I drank one cup coconut milk beverage." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one cup coconut milk beverage? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup coconut milk beverage? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:53.757Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one medium blood orange." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blood orange β€” card not captured.
Why verdict Logged (write-truth verified): Blood orange β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium blood orange. Assumed 1 blood orange as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium blood orange. Assumed 1 blood orange as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blood orange Γ—1 (1 blood orange) 70 cal Β· 1.3g P Β· 18.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:04.993Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Blood orange" at 90% confidence.
  • Matched your saved foods and aliases to "Blood orange" at 83% confidence.
  • Matched your past food logs to "blood orange" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was two soft boiled eggs." (difficulty β€”)3.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said Which type of soft boiled eggs was it? There are several with different nutrition.
2 Β· Card shown Which type of soft boiled eggs was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:19.894Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put down five ounces grilled swordfish." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I couldn't convert five ounces of swordfish from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert five ounces of swordfish from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:33.034Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked soba noodles." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Noodles, Japanese, Soba, Cooked β€” card not captured.
Why verdict Logged (write-truth verified): Noodles, Japanese, Soba, Cooked β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Got it, I logged Noodles, Japanese, Soba, Cooked (one cup (140 g)).
2 Β· Card shown I logged Noodles, Japanese, Soba, Cooked (one cup (140 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Noodles, Japanese, Soba, Cooked Γ—1 (one cup (140 g)) 139 cal Β· 7.1g P Β· 30g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:46.440Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was one Asian pear." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pear, Asian, Raw β€” card not captured.
Why verdict Logged (write-truth verified): Pear, Asian, Raw β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Pear, Asian, Raw (1 asian pear).
2 Β· Card shown Logged Pear, Asian, Raw (1 asian pear).
3 Β· App data rows written created food_log_entry: Pear, Asian, Raw Γ—1 (1 asian pear) 75 cal Β· 0.9g P Β· 18.9g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:57.940Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate four ounces baked sea bass." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said I couldn't convert four ounces of Baked Sea Bass from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert four ounces of Baked Sea Bass from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:09.315Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one cup gooseberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Gooseberries β€” card not captured.
Why verdict Logged (write-truth verified): Gooseberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup gooseberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup gooseberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Gooseberries Γ—1 (1 cup) 66 cal Β· 1.4g P Β· 15.3g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:20.638Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Gooseberries" at 90% confidence.
  • Matched your past food logs to "Gooseberries" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Count fourteen macadamias." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Macadamias? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Macadamias? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:31.996Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Macadamias" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Lunch included three ounces duck breast skinless." (difficulty β€”)6.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.5s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:49.623Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your past food logs to "Duck Breast Skinless" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Save one cup roasted broccoli florets." (difficulty β€”)5.4s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said What exact food and amount should I use for Broccoli? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Broccoli? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:08.717Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I drank eight ounces pomegranate juice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pomegranate juice β€” card not captured.
Why verdict Logged (write-truth verified): Pomegranate juice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged eight ounces pomegranate juice.
2 Β· Card shown Logged eight ounces pomegranate juice.
3 Β· App data rows written created food_log_entry: Pomegranate juice Γ—1 (8 oz) 122 cal Β· 0.5g P Β· 29.7g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:17.518Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pomegranate juice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Note two chicken apple sausages." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged your note in General about two chicken apple sausages.
2 Β· Card shown Logged your note in General about two chicken apple sausages.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "notes" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:29.087Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Supper was one cup adzuki beans." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said What exact food and amount should I use for one cup adzuki beans? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup adzuki beans? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:54.979Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Enter one medium passion fruit." (difficulty β€”)3.2s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said I could not finish that request safely.
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:11.440Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Ate a quarter cup dried cherries." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cherries, Dried β€” card not captured.
Why verdict Logged (write-truth verified): Cherries, Dried β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Got it, I logged Cherries, Dried (a quarter cup (38.5 g)).
2 Β· Card shown I logged Cherries, Dried (a quarter cup (38.5 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Cherries, Dried Γ—1 (a quarter cup (38.5 g)) 128 cal Β· 0.5g P Β· 31g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:22.981Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon walnut butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Walnut butter β€” card not captured.
Why verdict Logged (write-truth verified): Walnut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon walnut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon walnut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Walnut butter Γ—1 (1 tbsp) 95 cal Β· 2g P Β· 2g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:34.302Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "one tablespoon walnut butter" at 90% confidence.
  • Matched the common-food list to "Walnut butter" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was one cup braised cabbage." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cabbage β€” card not captured.
Why verdict Logged (write-truth verified): Cabbage β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup braised cabbage. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup braised cabbage. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cabbage Γ—1 (1 cup) 35 cal Β· 2g P Β· 8.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:45.756Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cabbage" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one and a half cups strawberries sliced." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Strawberries β€” card not captured.
Why verdict Logged (write-truth verified): Strawberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged one and a half cups strawberries sliced. Assumed 1.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one and a half cups strawberries sliced. Assumed 1.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Strawberries Γ—1 (1.5 cup) 73 cal Β· 1.6g P Β· 17.6g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:57.392Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Strawberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put in two hundred grams labneh." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Labneh β€” card not captured.
Why verdict Logged (write-truth verified): Labneh β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two hundred grams labneh.
2 Β· Card shown Logged two hundred grams labneh.
3 Β· App data rows written created food_log_entry: Labneh Γ—1 (200 g) 160 cal Β· 10g P Β· 5g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:08.707Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one cup coconut milk beverage." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one cup coconut milk beverage? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup coconut milk beverage? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:22.654Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast was half a cup goat cheese." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Goat cheese β€” card not captured.
Why verdict Logged (write-truth verified): Goat cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged half a cup goat cheese. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged half a cup goat cheese. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Goat cheese Γ—1 (0.5 cup) 200 cal Β· 11.9g P Β· 0.1g C Β· 16.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:34.094Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Goat cheese" at 90% confidence.
  • Matched your past food logs to "Codex Test Dairy Soft Goat Cheese" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Count one naan bread half." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:46.226Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had five ounces venison." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Which type of venison was it? There are several with different nutrition.
2 Β· Card shown Which type of venison was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:57.785Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add one cup mung beans cooked." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one cup mung beans cooked? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup mung beans cooked? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:12.226Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track half a cup kimchi." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Kimchi β€” card not captured.
Why verdict Logged (write-truth verified): Kimchi β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Got it, I logged Kimchi (half a cup (75 g)).
2 Β· Card shown I logged Kimchi (half a cup (75 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Kimchi Γ—1 (half a cup (75 g)) 11 cal Β· 0.8g P Β· 1.8g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:23.844Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log two buckwheat pancakes." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:35.975Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate one brioche roll small." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:49.973Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record four ounces calamari grilled." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said What exact food and amount should I use for four ounces calamari grilled? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for four ounces calamari grilled? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:03.195Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was two Babybel original cheeses." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Babybel β€” card not captured.
Why verdict Logged (write-truth verified): Babybel β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two babybel original cheeses.
2 Β· Card shown Logged two babybel original cheeses.
3 Β· App data rows written created food_log_entry: Babybel Γ—1 (2 babybel original) 140 cal Β· 10g P Β· 0g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:14.597Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Babybel" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add one teaspoon chili oil." (difficulty β€”)2.3s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "chili oil" β€” no saved row with matching identity (rows: Labneh with Olive Oil)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "chili oil" β€” no saved row with matching identity (rows: Labneh with Olive Oil)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Got it, I logged Codex Test Dairy Labneh with Olive Oil.
2 Β· Card shown I logged Codex Test Dairy Labneh with Olive Oil β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Labneh with Olive Oil Γ—0.021 (cup) 4 cal Β· 0.2g P Β· 0.1g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:28.111Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one cup millet." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked millet β€” card not captured.
Why verdict Logged (write-truth verified): Cooked millet β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup millet. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup millet. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked millet Γ—1 (1 cup) 207 cal Β· 6.1g P Β· 41.2g C Β· 1.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:39.320Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked millet" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one medium yam." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Yam β€” card not captured.
Why verdict Logged (write-truth verified): Yam β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium yam. Assumed 1 yam as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium yam. Assumed 1 yam as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Yam Γ—1 (1 yam) 174 cal Β· 2.3g P Β· 41.3g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:50.746Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Yam" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track ten ounces matcha latte water base." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for ten ounces matcha latte water base? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for ten ounces matcha latte water base? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:16.231Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count one cup sugar snap peas raw." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Snap peas β€” card not captured.
Why verdict Logged (write-truth verified): Snap peas β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup sugar snap peas raw. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup sugar snap peas raw. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Snap peas Γ—1 (1 cup) 41 cal Β· 2.7g P Β· 7.4g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:27.616Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Snap peas" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner was five ounces lamb loin." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Lamb loin β€” card not captured.
Why verdict Logged (write-truth verified): Lamb loin β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged five ounces lamb loin.
2 Β· Card shown Logged five ounces lamb loin.
3 Β· App data rows written created food_log_entry: Lamb loin Γ—1 (5 oz) 220 cal Β· 28.1g P Β· 0g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:38.981Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Lamb loin" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had one cup average tomato bisque." (difficulty β€”)4.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said I couldn't find Average Tomato Bisque Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Average Tomato Bisque Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:54.641Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add two seaweed snacks packs." (difficulty β€”)3.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said I couldn't find Add Two Seaweed Snacks Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Add Two Seaweed Snacks Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:09.714Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup mango chunks." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mango β€” card not captured.
Why verdict Logged (write-truth verified): Mango β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup mango chunks. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup mango chunks. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Mango Γ—1 (1 cup) 99 cal Β· 1.3g P Β· 24.8g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:21.022Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Mango" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons muhammara." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Muhammara β€” card not captured.
Why verdict Logged (write-truth verified): Muhammara β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two tablespoons muhammara.
2 Β· Card shown Logged two tablespoons muhammara.
3 Β· App data rows written created food_log_entry: Muhammara Γ—1 (2 tbsp) 70 cal Β· 1.5g P Β· 6g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:32.428Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Muhammara" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate one medium lychee cup ten pieces." (difficulty β€”)4.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.1s
1 Β· TTS said I couldn't find Medium Lychee Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Medium Lychee Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:47.818Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put down one cup teff." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said I couldn't convert one cup of Teff, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert one cup of Teff, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:59.610Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record four ounces turkey cutlet." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said What exact food and amount should I use for four ounces turkey cutlet? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for four ounces turkey cutlet? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:07:12.018Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add my usual No Cow bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
2 Β· Card shown I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: No Cow No Cow Cookie Dough
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-nocow",
        "name": "No Cow Cookie Dough",
        "brand": "No Cow",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 190,
          "proteinGrams": 20,
          "fatGrams": 5,
          "carbsGrams": 19
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual No Cow bar",
      "foodItemId": "seed-g-nocow",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bar",
        "displayLabel": "my usual No Cow bar",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:23.234Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual no cow bar" at 96% confidence.
  • Matched your saved foods and aliases to "No Cow Bar" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had my usual labneh dip." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Labneh with Olive Oil β€” card not captured.
Why verdict Logged (write-truth verified): Labneh with Olive Oil β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Dairy Labneh with Olive Oil. Using your saved "my usual labneh dip". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Labneh with Olive Oil. Using your saved "my usual labneh dip". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Labneh with Olive Oil Γ—1 (cup) 180 cal Β· 10g P Β· 5g C Β· 14g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Labneh with Olive Oil
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-labneh",
        "name": "Labneh with Olive Oil",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 10,
          "fatGrams": 14,
          "carbsGrams": 5
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual labneh dip",
      "foodItemId": "seed-g-labneh",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual labneh dip",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:34.513Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual labneh dip" at 96% confidence.
  • Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Lunch was my usual poke cup." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Salmon Poke Cup β€” card not captured.
Why verdict Logged (write-truth verified): Salmon Poke Cup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Kitchen Salmon Poke Cup. Using your saved "my usual poke cup". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Kitchen Salmon Poke Cup. Using your saved "my usual poke cup". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Salmon Poke Cup Γ—1 (cup) 380 cal Β· 28g P Β· 32g C Β· 14g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Salmon Poke Cup
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-poke",
        "name": "Salmon Poke Cup",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 380,
          "proteinGrams": 28,
          "fatGrams": 14,
          "carbsGrams": 32
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual poke cup",
      "foodItemId": "seed-g-poke",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual poke cup",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:45.763Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual poke cup" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was my usual rice." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked Sushi Rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Sushi Rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Sushi Rice. Using your saved "my usual rice". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Sushi Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Sushi Rice Γ—1 (cup) 200 cal Β· 4g P Β· 44g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Sushi Rice
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-rice",
        "name": "Cooked Sushi Rice",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 4,
          "fatGrams": 0.3,
          "carbsGrams": 44
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual rice",
      "foodItemId": "seed-g-rice",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual rice",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:07:57.021Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual rice" at 96% confidence.
  • Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track my usual macadamias." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Macadamia Nuts β€” card not captured.
Why verdict Logged (write-truth verified): Macadamia Nuts β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Macadamia Nuts. Using your saved "my usual macadamias". Tell me if that is wrong.
2 Β· Card shown Logged Macadamia Nuts. Using your saved "my usual macadamias". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Macadamia Nuts Γ—1 (ounce) 204 cal Β· 2.2g P Β· 4g C Β· 21g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Macadamia Nuts
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-mac",
        "name": "Macadamia Nuts",
        "brand": null,
        "source": "manual",
        "servingLabel": "ounce",
        "servingQuantity": 1,
        "servingUnit": "oz",
        "macrosPerServing": {
          "calories": 204,
          "proteinGrams": 2.2,
          "fatGrams": 21,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual macadamias",
      "foodItemId": "seed-g-mac",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "ounce",
        "displayLabel": "my usual macadamias",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:08:08.258Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual macadamias" at 96% confidence.
  • Matched the common-food list to "Macadamias" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my default coconut milk." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Coconut Milk Beverage β€” card not captured.
Why verdict Logged (write-truth verified): Coconut Milk Beverage β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Coconut Milk Beverage. Using your saved "my default coconut milk". Tell me if that is wrong.
2 Β· Card shown Logged Coconut Milk Beverage. Using your saved "my default coconut milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Coconut Milk Beverage Γ—1 (cup) 45 cal Β· 0g P Β· 1g C Β· 4.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Coconut Milk Beverage
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-cocomilk",
        "name": "Coconut Milk Beverage",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 45,
          "proteinGrams": 0,
          "fatGrams": 4.5,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my default coconut milk",
      "foodItemId": "seed-g-cocomilk",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my default coconut milk",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:08:19.743Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my default coconut milk" at 96% confidence.
  • Matched the common-food list to "Milk" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my usual morning matcha latte." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Matcha Latte Oat β€” card not captured.
Why verdict Logged (write-truth verified): Matcha Latte Oat β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Matcha Latte Oat. Using your saved "my usual morning matcha latte". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Matcha Latte Oat. Using your saved "my usual morning matcha latte". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Matcha Latte Oat Γ—1 (cup) 140 cal Β· 2g P Β· 22g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Cafe Matcha Latte Oat
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-matcha",
        "name": "Matcha Latte Oat",
        "brand": "Codex Test Cafe",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 2,
          "fatGrams": 4,
          "carbsGrams": 22
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual morning matcha latte",
      "foodItemId": "seed-g-matcha",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual morning matcha latte",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:08:30.791Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual morning matcha latte" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had my normal buckwheat porridge." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Buckwheat Porridge. Using your saved "my normal buckwheat porridge". Tell me if that is wrong.
2 Β· Card shown Logged Buckwheat Porridge. Using your saved "my normal buckwheat porridge". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Buckwheat Porridge Γ—1 (cup) 155 cal Β· 5.7g P Β· 33g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Buckwheat Porridge
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-buck",
        "name": "Buckwheat Porridge",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 155,
          "proteinGrams": 5.7,
          "fatGrams": 1,
          "carbsGrams": 33
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my normal buckwheat porridge",
      "foodItemId": "seed-g-buck",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my normal buckwheat porridge",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:08:42.047Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my normal buckwheat porridge" at 96% confidence.
  • Matched the common-food list to "Cooked buckwheat" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track my go-to miso soup." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Miso Soup Cup β€” card not captured.
Why verdict Logged (write-truth verified): Miso Soup Cup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Kitchen Miso Soup Cup. Using your saved "my go to miso soup". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Kitchen Miso Soup Cup. Using your saved "my go to miso soup". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Miso Soup Cup Γ—1 (cup) 40 cal Β· 3g P Β· 5g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Miso Soup Cup
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-miso",
        "name": "Miso Soup Cup",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 40,
          "proteinGrams": 3,
          "fatGrams": 1,
          "carbsGrams": 5
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my go-to miso soup",
      "foodItemId": "seed-g-miso",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my go-to miso soup",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:08:53.278Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my go to miso soup" at 96% confidence.
  • Matched the common-food list to "Miso soup" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my usual evening rooibos." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Rooibos Tea β€” card not captured.
Why verdict Logged (write-truth verified): Rooibos Tea β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Rooibos Tea. Using your saved "my usual evening rooibos". Tell me if that is wrong.
2 Β· Card shown Logged Rooibos Tea. Using your saved "my usual evening rooibos". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Rooibos Tea Γ—1 (cup) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Rooibos Tea
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-rooibos",
        "name": "Rooibos Tea",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 0,
          "proteinGrams": 0,
          "fatGrams": 0,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual evening rooibos",
      "foodItemId": "seed-g-rooibos",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual evening rooibos",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:09:04.512Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual evening rooibos" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add the same goat cheese as yesterday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Goat cheese β€” card not captured.
Why verdict Logged (write-truth verified): Goat cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Goat cheese. Using your recent Goat cheese history. Tell me if that is wrong.
2 Β· Card shown Logged Goat cheese. Using your recent Goat cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Goat cheese Γ—1 (0.5 cup) 200 cal Β· 11.9g P Β· 0.1g C Β· 16.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Soft Goat Cheese
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-goat",
        "name": "Soft Goat Cheese",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 12,
          "fatGrams": 16,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 0.5 for seed-g-hist-goat at 2026-07-17T13:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-goat",
      "quantity": 0.5,
      "loggedAt": "2026-07-17T13:00:00.000Z"
    }
snapshot captured 2026-08-02T22:09:27.380Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Goat cheese" at 90% confidence.
  • Matched your past food logs to "Goat cheese" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Same No Cow bar as yesterday." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. UNVERIFIED: CONTEXT-FRAGMENT β€” app asked for missing context; needs multi-turn replay (not a single-shot fail).
Why verdict CONTEXT-FRAGMENT β€” app asked for missing context; needs multi-turn replay (not a single-shot fail).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which exact same no cow bar as yesterday should replace Goat cheese?
2 Β· Card shown Which exact same no cow bar as yesterday should replace Goat cheese?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: No Cow No Cow Bar
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-nocow",
        "name": "No Cow Bar",
        "brand": "No Cow",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 190,
          "proteinGrams": 20,
          "fatGrams": 5,
          "carbsGrams": 19
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-nocow at 2026-07-17T16:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-nocow",
      "quantity": 1,
      "loggedAt": "2026-07-17T16:00:00.000Z"
    }
snapshot captured 2026-08-02T22:09:38.703Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "No Cow Bar" at 90% confidence.
  • Matched your saved foods and aliases to "my usual no cow bar" at 65% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log the same tomato bisque I had last night." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Tomato Bisque β€” card not captured.
Why verdict Logged (write-truth verified): Tomato Bisque β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Codex Test Kitchen Tomato Bisque. Using your recent Codex Test Kitchen Tomato Bisque history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Kitchen Tomato Bisque. Using your recent Codex Test Kitchen Tomato Bisque history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Tomato Bisque Γ—1 (bowl) 130 cal Β· 3g P Β· 18g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Kitchen Tomato Bisque
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-bisque",
        "name": "Tomato Bisque",
        "brand": "Codex Test Kitchen",
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 130,
          "proteinGrams": 3,
          "fatGrams": 5,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-bisque at 2026-07-17T19:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-bisque",
      "quantity": 1,
      "loggedAt": "2026-07-17T19:30:00.000Z"
    }
snapshot captured 2026-08-02T22:09:50.149Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Tomato bisque" at 90% confidence.
  • Matched your past food logs to "Codex Test Kitchen Tomato Bisque" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same oatmeal as this morning." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Oatmeal Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
2 Β· Card shown Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oatmeal Bowl Γ—1 (bowl) 150 cal Β· 5g P Β· 27g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Oatmeal Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-oats",
        "name": "Oatmeal Bowl",
        "brand": null,
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 5,
          "fatGrams": 2.5,
          "carbsGrams": 27
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-oats at 2026-07-18T07:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-oats",
      "quantity": 1,
      "loggedAt": "2026-07-18T07:30:00.000Z"
    }
snapshot captured 2026-08-02T22:10:01.490Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add the same sea bass I had earlier." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Baked Sea Bass β€” card not captured.
Why verdict Logged (write-truth verified): Baked Sea Bass β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Baked Sea Bass. Using your recent Baked Sea Bass history. Tell me if that is wrong.
2 Β· Card shown Logged Baked Sea Bass. Using your recent Baked Sea Bass history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Baked Sea Bass Γ—1 (fillet) 160 cal Β· 30g P Β· 0g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Baked Sea Bass
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-bass",
        "name": "Baked Sea Bass",
        "brand": null,
        "source": "manual",
        "servingLabel": "fillet",
        "servingQuantity": 1,
        "servingUnit": "fillet",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 30,
          "fatGrams": 4,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-bass at 2026-07-18T12:30:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-bass",
      "quantity": 1,
      "loggedAt": "2026-07-18T12:30:00.000Z"
    }
snapshot captured 2026-08-02T22:10:12.863Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your past food logs to "Baked Sea Bass" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same smoothie as yesterday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Dragon Fruit Smoothie β€” card not captured.
Why verdict Logged (write-truth verified): Dragon Fruit Smoothie β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Recipe Dragon Fruit Smoothie. Using your recent Codex Test Recipe Dragon Fruit Smoothie history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Dragon Fruit Smoothie. Using your recent Codex Test Recipe Dragon Fruit Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Dragon Fruit Smoothie Γ—1 (smoothie) 250 cal Β· 20g P Β· 35g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Recipe Dragon Fruit Smoothie
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-smooth",
        "name": "Dragon Fruit Smoothie",
        "brand": "Codex Test Recipe",
        "source": "manual",
        "servingLabel": "smoothie",
        "servingQuantity": 1,
        "servingUnit": "smoothie",
        "macrosPerServing": {
          "calories": 250,
          "proteinGrams": 20,
          "fatGrams": 3,
          "carbsGrams": 35
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-smooth at 2026-07-17T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-smooth",
      "quantity": 1,
      "loggedAt": "2026-07-17T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:10:24.200Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log the duck I had last time." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Duck Breast Skinless β€” card not captured.
Why verdict Logged (write-truth verified): Duck Breast Skinless β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Duck Breast Skinless. Using your saved "Duck Breast Skinless". Tell me if that is wrong.
2 Β· Card shown Logged Duck Breast Skinless. Using your saved "Duck Breast Skinless". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Duck Breast Skinless Γ—1 (serving) 140 cal Β· 22g P Β· 0g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Duck Breast Skinless
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-duck",
        "name": "Duck Breast Skinless",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 22,
          "fatGrams": 5,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-duck at 2026-07-16T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-duck",
      "quantity": 1,
      "loggedAt": "2026-07-16T18:00:00.000Z"
    }
snapshot captured 2026-08-02T22:10:35.502Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same naan as earlier today." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Naan Half β€” card not captured.
Why verdict Logged (write-truth verified): Naan Half β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Naan Half. Using your recent Naan Half history. Tell me if that is wrong.
2 Β· Card shown Logged Naan Half. Using your recent Naan Half history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Naan Half Γ—1 (piece) 160 cal Β· 5g P Β· 26g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Naan Half
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-hist-naan",
        "name": "Naan Half",
        "brand": null,
        "source": "manual",
        "servingLabel": "piece",
        "servingQuantity": 1,
        "servingUnit": "piece",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 5,
          "fatGrams": 4,
          "carbsGrams": 26
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-hist-naan at 2026-07-18T07:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-hist-naan",
      "quantity": 1,
      "loggedAt": "2026-07-18T07:00:00.000Z"
    }
snapshot captured 2026-08-02T22:10:46.831Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Naan" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was one EPIC chicken sesame BBQ bar." (difficulty β€”)1.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said I couldn't find Snack Was One EPIC Chicken Sesame BBQ Snack Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic snack bar.
2 Β· Card shown I couldn't find Snack Was One EPIC Chicken Sesame BBQ Snack Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic snack bar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:59.477Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Finished one Fairlife Core Power cookies and cream bottle." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:12.850Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one Two Good vanilla cup." (difficulty β€”)1.9s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said Which one did you mean? 1. TWO GOOD Vanilla Lowfat Greek Yogurt, Vanilla, 2. Vanilla Blended Greek Nonfat Yogurt β€” Good & Gather
2 Β· Card shown Which one did you mean? 1. TWO GOOD Vanilla Lowfat Greek Yogurt, Vanilla, 2. Vanilla Blended Greek Nonfat Yogurt β€” Good & Gather
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:26.135Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Save one No Cow chocolate fudge brownie bar." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Which exact save one no cow chocolate fudge brownie bar should replace Naan Half?
2 Β· Card shown Which exact save one no cow chocolate fudge brownie bar should replace Naan Half?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:37.964Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate one RXBAR maple sea salt." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said What exact food and amount should I use for one rxbar maple sea salt? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one rxbar maple sea salt? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:49.571Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log a blood orange and one No Cow bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
2 Β· Card shown I wasn't sure which food you meant to correct. Could you try again with a bit more detail?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:00.862Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "No Cow Bar" at 90% confidence.
  • Matched your past food logs to "blood orange" at 82% confidence.
  • Matched your saved foods and aliases to "my usual no cow bar" at 65% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had oatmeal and matcha." (difficulty β€”)1.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said I need to resolve matcha before I log this meal. What should I use for matcha?
2 Β· Card shown I need to resolve matcha before I log this meal. What should I use for matcha?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:13.836Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was soft boiled eggs and naan." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Egg and Naan. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Egg and Naan. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (50 g) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F
created food_log_entry: Naan Γ—1 (90 g) 262 cal Β· 8.1g P Β· 45g C Β· 5.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:25.316Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a banh mi and an Asian pear." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged a banh mi and Pear. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged a banh mi and Pear. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Banh mi Γ—1 (1 banh mi) 690 cal Β· 30g P Β· 90g C Β· 24g F
created food_log_entry: Pear Γ—1 (178 g) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:36.809Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was macadamias and gooseberries." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Macadamias and Gooseberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Macadamias and Gooseberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:48.220Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Gooseberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was sea bass and broccoli florets." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Baked Sea Bass and Broccoli. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Baked Sea Bass and Broccoli. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Baked Sea Bass Γ—1 (fillet) 160 cal Β· 30g P Β· 0g C Β· 4g F
created food_log_entry: Broccoli Γ—1 (100 g) 35 cal Β· 2.4g P Β· 7.2g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:59.858Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate labneh and strawberries." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Labneh and Strawberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh and Strawberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:11.265Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Strawberries" at 90% confidence.
  • Matched your past food logs to "Labneh" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track swordfish and millet." (difficulty β€”)1.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said I need to resolve swordfish before I log this meal. What should I use for swordfish?
2 Β· Card shown I need to resolve swordfish before I log this meal. What should I use for swordfish?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:34.931Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add goat cheese and endive." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Goat cheese and Endive? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Goat cheese and Endive? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:47.501Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "goat cheese" at 90% confidence.
  • Matched the common-food list to "Goat cheese" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had an EPIC bar and club soda." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said Which an EPIC bar should I use? I did not log it yet because more than one match fits.
2 Β· Card shown Which an EPIC bar should I use? I did not log it yet because more than one match fits.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:59.703Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log tomato bisque and watercress." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Tomato bisque and Watercress? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Tomato bisque and Watercress? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:11.206Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Tomato bisque" at 90% confidence.
  • Matched your past food logs to "Codex Test Kitchen Tomato Bisque" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was oatmeal, mango, and coffee." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Cooked oatmeal, Mango, and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked oatmeal, Mango, and Coffee. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F
created food_log_entry: Mango Γ—1 (100 g) 60 cal Β· 0.8g P Β· 15g C Β· 0.4g F
created food_log_entry: Coffee Γ—1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:22.819Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a dragon fruit, Babybel, and seaweed snacks." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Babybel and Seaweed snacks? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Babybel and Seaweed snacks? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:34.374Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Seaweed snacks" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was lamb loin, millet, and cabbage." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Lamb loin, Cooked millet, and Cabbage? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Lamb loin, Cooked millet, and Cabbage? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:45.981Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Lamb loin" at 90% confidence.
  • Matched your past food logs to "Lamb loin" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was snap peas and muhammara." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Snap peas and Muhammara? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Snap peas and Muhammara? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:57.446Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Muhammara" at 90% confidence.
  • Matched your past food logs to "Snap peas" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a grain bowl and rooibos." (difficulty β€”)1.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said I need to resolve rooibos before I log this meal. What should I use for rooibos?
2 Β· Card shown I need to resolve rooibos before I log this meal. What should I use for rooibos?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:10.414Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had soba, adzuki beans, and duck." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said I need to resolve soba and duck before I log this meal. What should I use for soba and duck?
2 Β· Card shown I need to resolve soba and duck before I log this meal. What should I use for soba and duck?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:22.779Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track labneh, honey, and macadamias." (difficulty β€”)0.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said How much should I log for Labneh, Honey, and Macadamias? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh, Honey, and Macadamias? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:34.548Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Macadamias" at 90% confidence.
  • Matched your past food logs to "Labneh" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add eggs, chicken apple sausage, and pomegranate juice." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Egg, Chicken apple sausage, and Pomegranate juice? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Egg, Chicken apple sausage, and Pomegranate juice? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:46.044Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I ate pasta and a side of collards." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: WRONG item vs seeded default/key β€” WRONG/MISSING item "a side of collards" β€” no saved row with matching identity (rows: Cooked pasta, Collard greens, Cooked pasta, Collard greens)
Why verdict WRONG item vs seeded default/key β€” WRONG/MISSING item "a side of collards" β€” no saved row with matching identity (rows: Cooked pasta, Collard greens, Cooked pasta, Collard greens)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Cooked pasta and Collard greens. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Cooked pasta and Collard greens. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ—1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
created food_log_entry: Collard greens Γ—1 (100 g) 33 cal Β· 2.7g P Β· 5.6g C Β· 0.7g F
created food_log_entry: Cooked pasta Γ—1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
created food_log_entry: Collard greens Γ—1 (100 g) 33 cal Β· 2.7g P Β· 5.6g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:57.936Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log lychees and walnut butter." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Lychees and Walnut butter? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Lychees and Walnut butter? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:09.540Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Walnut butter" at 90% confidence.
  • Matched your past food logs to "Walnut butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was cereal and coconut milk." (difficulty β€”)1.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said I need to resolve cereal before I log this meal. What should I use for cereal?
2 Β· Card shown I need to resolve cereal before I log this meal. What should I use for cereal?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:21.715Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had a bibimbap with rice, egg, spinach, and gochujang" (difficulty β€”)1.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Egg, Bibimbap, Cooked white rice, Spinach, Gochujang β€” card not captured.
Why verdict Logged (write-truth verified): Egg, Bibimbap, Cooked white rice, Spinach, Gochujang β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said Logged Bibimbap. Includes Cooked white rice, one egg, Spinach, and Gochujang.
2 Β· Card shown Logged Bibimbap. Includes Cooked white rice, one egg, Spinach, and Gochujang.
3 Β· App data rows written created food_log_entry: Bibimbap Γ—1 (serving) 249 cal Β· 10.8g P Β· 37.8g C Β· 5.6g F
created food_log_entry: Cooked white rice Γ—1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F
created food_log_entry: Egg Γ—1 (1 egg) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F
created food_log_entry: Spinach Γ—1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F
created food_log_entry: Gochujang Γ—1 (18 g) 40 cal Β· 0.9g P Β· 8.3g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:34.386Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Log a smoothie with dragon fruit, banana, and collagen." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said Logged Smoothie. Includes Dragon Fruit, one banana, and Collagen peptides.
2 Β· Card shown Logged Smoothie. Includes Dragon Fruit, one banana, and Collagen peptides.
3 Β· App data rows written created food_log_entry: Smoothie Γ—1 (serving) 587 cal Β· 92.6g P Β· 56.3g C Β· 0.8g F
created food_log_entry: Dragon Fruit Γ—1 (a) 122 cal Β· 1.3g P Β· 29.2g C Β· 0.4g F
created food_log_entry: Banana Γ—1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
created food_log_entry: Collagen peptides Γ—1 (100 g) 360 cal Β· 90g P Β· 0g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:48.232Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had a grain bowl with millet, mung beans, and muhammara." (difficulty β€”)8.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.8s
1 Β· TTS said Logged Grain Bowl. Includes Millet, Cooked, Mung Beans, Cooked, and Muhammara.
2 Β· Card shown Logged Grain Bowl. Includes Millet, Cooked, Mung Beans, Cooked, and Muhammara.
3 Β· App data rows written pending_created food_log_entry: a grain bowl with millet, mung beans, and muhammara (pending)
created food_log_entry: Grain Bowl Γ—1 (serving) 566 cal Β· 19.6g P Β· 80.1g C Β· 19.5g F
created food_log_entry: Millet, Cooked Γ—1 (1 serving) 207 cal Β· 6.1g P Β· 41.2g C Β· 1.7g F
created food_log_entry: Mung Beans, Cooked Γ—1 (1 cup) 289 cal Β· 12g P Β· 32.9g C Β· 12.8g F
created food_log_entry: Muhammara Γ—1 (2 tbsp) 70 cal Β· 1.5g P Β· 6g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:08.231Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was smorrebrod with egg and smoked salmon." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much should I log for Smoked salmon? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Smoked salmon? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:19.916Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Smoked salmon" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I made tagine with lamb, apricots, chickpeas, and oil." (difficulty β€”)3.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said Logging your I made tagine with lamb, apricots, chickpeas, and oil β€” still looking up the nutrition details; they'll appear in your log shortly.
2 Β· Card shown Logging your I made tagine with lamb, apricots, chickpeas, and oil β€” still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: I made tagine with lamb, apricots, chickpeas, and oil (pending)
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:41.277Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was a poke bowl with rice, salmon, edamame, and seaweed." (difficulty β€”)1.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said What should I use for rice?
2 Β· Card shown What should I use for rice?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:58.398Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had laksa with shrimp and tofu." (difficulty β€”)2.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Laksa, Shrimp, Firm tofu β€” card not captured.
Why verdict Logged (write-truth verified): Laksa, Shrimp, Firm tofu β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Logged Laksa. Includes Shrimp and Firm tofu.
2 Β· Card shown Logged Laksa. Includes Shrimp and Firm tofu.
3 Β· App data rows written created food_log_entry: Laksa Γ—1 (serving) 172 cal Β· 23.7g P Β· 2.9g C Β· 8.8g F
created food_log_entry: Shrimp Γ—1 (1 oz) 28 cal Β· 6.7g P Β· 0.1g C Β· 0.1g F
created food_log_entry: Firm tofu Γ—1 (100 g) 144 cal Β· 17g P Β· 2.8g C Β· 8.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:12.101Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log a duck wrap with hoisin and cucumber." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Duck Wrap, Hoisin Sauce, Cucumber β€” card not captured.
Why verdict Logged (write-truth verified): Duck Wrap, Hoisin Sauce, Cucumber β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said Logged Duck Wrap. Includes Hoisin Sauce and Cucumber.
2 Β· Card shown Logged Duck Wrap. Includes Hoisin Sauce and Cucumber.
3 Β· App data rows written created food_log_entry: Duck Wrap Γ—1 (serving) 50 cal Β· 1.2g P Β· 10.7g C Β· 0.6g F
created food_log_entry: Hoisin Sauce Γ—1 (1 tablespoon) 35 cal Β· 0.5g P Β· 7.1g C Β· 0.5g F
created food_log_entry: Cucumber Γ—1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:24.970Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I built a yogurt bowl with buckwheat, honey, and strawberries." (difficulty β€”)4.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said Logged Yogurt Bowl. Includes Buckwheat, Honey, and Strawberries, Raw.
2 Β· Card shown Logged Yogurt Bowl. Includes Buckwheat, Honey, and Strawberries, Raw.
3 Β· App data rows written created food_log_entry: Yogurt Bowl Γ—1 (serving) 701 cal Β· 23.6g P Β· 150.9g C Β· 6.1g F
created food_log_entry: Buckwheat Γ—1 (1 serving) 583 cal Β· 22.6g P Β· 121.6g C Β· 5.8g F
created food_log_entry: Honey Γ—1 (21 g) 64 cal Β· 0.1g P Β· 17.3g C Β· 0g F
created food_log_entry: Strawberries, Raw Γ—1 (1 cup) 54 cal Β· 0.9g P Β· 12g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:40.649Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was mapo tofu with pork, tofu, and rice." (difficulty β€”)2.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said What should I use for tofu?
2 Β· Card shown What should I use for tofu?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:54.031Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add some millet." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Cooked millet? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Cooked millet? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:05.361Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked millet" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had buckwheat porridge." (difficulty β€”)3.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.3s
1 Β· TTS said How much buckwheat porridge did you have?
2 Β· Card shown How much buckwheat porridge did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:19.830Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log soba for dinner." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Noodles, Japanese, Soba, Cooked. Using your saved "Noodles, Japanese, Soba, Cooked". Tell me if that is wrong.
2 Β· Card shown Logged Noodles, Japanese, Soba, Cooked. Using your saved "Noodles, Japanese, Soba, Cooked". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Noodles, Japanese, Soba, Cooked Γ—1 (1 cup) 113 cal Β· 5.8g P Β· 24.4g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:31.410Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track udon noodles." (difficulty β€”)3.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said How much udon noodles did you have?
2 Β· Card shown How much udon noodles did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:46.363Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate seaweed snacks." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Seaweed snacks? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Seaweed snacks? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:57.582Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Seaweed snacks" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add macadamias." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Macadamias? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Macadamias? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:08.832Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Macadamias" at 90% confidence.
  • Matched your past food logs to "Macadamia Nuts" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of bisque." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a bowl of bisque? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bowl of bisque? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:22.700Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of tagine." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a plate of tagine? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a plate of tagine? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:36.676Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track pomegranate juice." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Pomegranate juice? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pomegranate juice? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:47.978Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pomegranate juice" at 90% confidence.
  • Matched your past food logs to "Pomegranate juice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add matcha latte." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said How much matcha latte did you have?
2 Β· Card shown How much matcha latte did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:00.348Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I drank soju." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much soju did you have?
2 Β· Card shown How much soju did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:11.700Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log mochi ice cream." (difficulty β€”)5.6s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.6s
1 Β· TTS said How much mochi ice cream did you have?
2 Β· Card shown How much mochi ice cream did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:28.492Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Had some pumpkin seeds." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Pumpkin seeds? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pumpkin seeds? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:39.738Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pumpkin seeds" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add seaweed snacks." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Seaweed snacks? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Seaweed snacks? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:50.988Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Seaweed snacks" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had a No Cow bar." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:02.660Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a labneh tub." (difficulty β€”)1.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:27.072Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a coconut drink." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said Got it, I logged Beverages, Coconut Water, Ready-To-Drink, Unsweetened.
2 Β· Card shown I logged Beverages, Coconut Water, Ready-To-Drink, Unsweetened β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Beverages, Coconut Water, Ready-To-Drink, Unsweetened Γ—1 (1 serving) 44 cal Β· 0.5g P Β· 10.3g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:39.498Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a banh mi." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a banh mi. Assumed 1 banh mi as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a banh mi. Assumed 1 banh mi as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banh mi Γ—1 (1 banh mi) 690 cal Β· 30g P Β· 90g C Β· 24g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:50.836Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "a banh mi" at 90% confidence.
  • Matched the common-food list to "Banh mi" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a collagen shake." (difficulty β€”)1.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:03.823Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had matcha latte." (difficulty β€”)1.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said How much matcha latte did you have?
2 Β· Card shown How much matcha latte did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:16.421Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a roll." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Got it, I logged Roll, White, Hot Dog Bun (1 roll (1 hot dog bun)).
2 Β· Card shown I logged Roll, White, Hot Dog Bun (1 roll (1 hot dog bun)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Roll, White, Hot Dog Bun Γ—1 (1 roll (1 hot dog bun)) 120 cal Β· 4.2g P Β· 22.1g C Β· 1.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:27.733Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track a duck sandwich." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:40.114Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had naan pizza." (difficulty β€”)5.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:56.769Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a savory muffin." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said What exact food and amount should I use for a savory muffin? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a savory muffin? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:09.238Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual matcha size." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged matcha. Using your saved "log my usual matcha size". Tell me if that is wrong.
2 Β· Card shown Logged matcha. Using your saved "log my usual matcha size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: matcha Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: matcha
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-matcha-confirm",
        "name": "matcha",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "log my usual matcha size",
      "foodItemId": "seed-g-matcha-confirm",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "log my usual matcha size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:24:20.499Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "log my usual matcha size" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add the regular supper portion." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged supper portion. Using your saved "add the regular supper portion". Tell me if that is wrong.
2 Β· Card shown Logged supper portion. Using your saved "add the regular supper portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: supper portion Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: supper portion
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-supper-portion",
        "name": "supper portion",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "add the regular supper portion",
      "foodItemId": "seed-g-supper-portion",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "add the regular supper portion",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:24:31.739Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "add the regular supper portion" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track my default evening snack." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged snack. Using your saved "track my default evening snack". Tell me if that is wrong.
2 Β· Card shown Logged snack. Using your saved "track my default evening snack". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: snack
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-snack-amt",
        "name": "snack",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "track my default evening snack",
      "foodItemId": "seed-g-snack-amt",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "track my default evening snack",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:24:42.998Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "track my default evening snack" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had the usual brunch size." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged brunch. Using your saved "i had the usual brunch size". Tell me if that is wrong.
2 Β· Card shown Logged brunch. Using your saved "i had the usual brunch size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: brunch Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: brunch
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-brunch-size",
        "name": "brunch",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "i had the usual brunch size",
      "foodItemId": "seed-g-brunch-size",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "serving",
        "displayLabel": "i had the usual brunch size",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T22:24:54.388Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "i had the usual brunch size" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Half a cup." (difficulty β€”)1.4s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:06.960Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One cup, plain." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:18.172Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"The No Cow chocolate fudge." (difficulty β€”)0.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which exact no cow chocolate fudge should replace brunch?
2 Β· Card shown Which exact no cow chocolate fudge should replace brunch?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:30.065Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Coconut milk beverage." (difficulty β€”)0.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:41.275Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "coconut milk beverage" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not it β€” the unsweetened one." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about brunch?
2 Β· Card shown What should I change about brunch?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:52.567Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"Wrong one. The blood orange, not navel." (difficulty β€”)0.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Logged Blood orange and Sliced Navel Oranges β€” NOT A BRANDED ITEM. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Blood orange and Sliced Navel Oranges β€” NOT A BRANDED ITEM. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Blood orange Γ—1 (140 g) 70 cal Β· 1.3g P Β· 18.1g C Β· 0.2g F
created food_log_entry: Sliced Navel Oranges Γ—1 (5 ONZ) 70 cal Β· 1g P Β· 18g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:04.761Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, not the flavored labneh." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Sliced Navel Oranges?
2 Β· Card shown What should I change about Sliced Navel Oranges?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:15.945Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Labneh" at 90% confidence.
  • Matched your past food logs to "Labneh" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould decline"Cancel that log." (difficulty β€”)0.5s
Verdict Expected DECLINE β€” should decline. FAIL: Wrote when it should decline.
Why verdict Wrote when it should decline.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Okay β€” cancelled Blood orange.
2 Β· Card shown Okay β€” cancelled Blood orange.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Pending Food Item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-corr-pending-3",
        "name": "Pending Food Item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 10,
          "fatGrams": 5,
          "carbsGrams": 15
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-corr-pending-3 at 2026-07-18T11:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-corr-pending-3",
      "quantity": 1,
      "loggedAt": "2026-07-18T11:00:00.000Z"
    }
snapshot captured 2026-08-02T22:26:46.026Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not the bar I meant." (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Sliced Navel Oranges?
2 Β· Card shown What should I change about Sliced Navel Oranges?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:02.004Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not the large β€” the medium blood orange." (difficulty β€”)6.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.8s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:19.985Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"Wrong item. Pick the grilled swordfish." (difficulty β€”)4.7s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.7s
1 Β· TTS said Got it. I’ve selected grilled swordfish instead.
2 Β· Card shown Got it. I’ve selected grilled swordfish instead.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:35.985Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"That's not it; the plain one." (difficulty β€”)2.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said Got it β€” you want the plain chocolate fudge bar, not a branded variety. Say "replace brunch with plain chocolate fudge" to log it correctly.
2 Β· Card shown Got it β€” you want the plain chocolate fudge bar, not a branded variety. Say "replace brunch with plain chocolate fudge" to log it correctly.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:00.632Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"No, the other naan." (difficulty β€”)3.8s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said Updated to the other naan.
2 Β· Card shown Updated the food entry from "Sliced Navel Oranges" to "the other naan".
3 Β· App data rows written updated food_log_entry: Naan Γ—1 (90 g) 262 cal Β· 8.1g P Β· 45g C Β· 5.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:15.580Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not those macadamias β€” the roasted ones." (difficulty β€”)4.3s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said What exact food and amount should I use for Macadamias? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Macadamias? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:42.204Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the blood orange from earlier." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not find a list matching earlier. Which list has blood orange?
2 Β· Card shown I could not find a list matching earlier. Which list has blood orange?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:05.332Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "blood orange" at 90% confidence.
  • Matched the common-food list to "Blood orange" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould delete the entry"Remove that No Cow bar." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. UNVERIFIED: DELETE unverified β€” delete wording/event exists, but no database removal was captured.
Why verdict DELETE unverified β€” delete wording/event exists, but no database removal was captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Deleted No Cow Bar.
2 Β· Card shown Deleted No Cow Bar.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:13.416Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "No Cow Bar" at 90% confidence.
  • Matched your saved foods and aliases to "my usual no cow bar" at 65% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete the buckwheat porridge entry." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:28.343Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "buckwheat porridge" at 90% confidence.
  • Matched the common-food list to "Cooked buckwheat" at 90% confidence.
  • Matched your past food logs to "Buckwheat" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:39.594Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "egg" at 90% confidence.
  • Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Remove the gooseberries." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:50.933Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Gooseberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete the swordfish log." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted swordfish.
2 Β· Card shown Deleted swordfish.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:30:09.265Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Scratch the walnut butter." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:30:13.440Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Walnut butter" at 90% confidence.
  • Matched your past food logs to "Walnut butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Remove the coconut milk entry." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Deleted Coconut Milk Beverage.
2 Β· Card shown Deleted Coconut Milk Beverage.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:30:24.859Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Milk" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete that mochi I logged last night." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Deleted mochi.
2 Β· Card shown Deleted mochi.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: mochi
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-0-mochi",
        "name": "mochi",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-0-mochi at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-0-mochi",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:30:42.779Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Remove yesterday's tiramisu." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted tiramisu.
2 Β· Card shown Deleted tiramisu.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: tiramisu
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-1-tiramisu",
        "name": "tiramisu",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-1-tiramisu at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-1-tiramisu",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:31:06.403Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete the leftover sushi entry." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Deleted sushi.
2 Β· Card shown Deleted sushi.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: sushi
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-2-sushi",
        "name": "sushi",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-2-sushi at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-2-sushi",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:31:17.568Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Take out the soju from last night." (difficulty β€”)2.0s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: soju
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-3-soju",
        "name": "soju",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-3-soju at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-3-soju",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:31:23.819Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Remove the croissant log from earlier this week." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted croissant.
2 Β· Card shown Deleted croissant.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: croissant
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-4-croissant",
        "name": "croissant",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-4-croissant at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-4-croissant",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:31:41.794Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Delete the candy I shouldn't have logged." (difficulty β€”)0.2s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted candy.
2 Β· Card shown Deleted candy.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: candy
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-del-5-candy",
        "name": "candy",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 200,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 20
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-del-5-candy at 2026-07-17T20:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-del-5-candy",
      "quantity": 1,
      "loggedAt": "2026-07-17T20:00:00.000Z"
    }
snapshot captured 2026-08-02T22:31:53.066Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the sequence blood orange quantity to two." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:57.849Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "blood orange" at 90% confidence.
  • Matched the common-food list to "Blood orange" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Actually make the No Cow bar two bars." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update β€” misroute-into-food (no verified mutation).
Why verdict Did not update β€” misroute-into-food (no verified mutation).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I couldn't identify which food entry you meant. Which one would you like to correct?
2 Β· Card shown I couldn't identify which food entry you meant. Which one would you like to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:09.156Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "No Cow Bar" at 90% confidence.
  • Matched your saved foods and aliases to "my usual no cow bar" at 60% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Update the buckwheat porridge to one and a half cups." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:20.552Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "buckwheat porridge" at 90% confidence.
  • Matched the common-food list to "Cooked buckwheat" at 90% confidence.
  • Matched your past food logs to "Buckwheat" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the eggs to three." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:31.833Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "egg" at 90% confidence.
  • Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Make the gooseberries a half cup." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:43.133Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Gooseberries" at 90% confidence.
  • Matched your past food logs to "Gooseberries" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Update the swordfish to six ounces." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update β€” misroute-into-food (no verified mutation).
Why verdict Did not update β€” misroute-into-food (no verified mutation).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I couldn't identify which food entry you meant. Which one would you like to correct?
2 Β· Card shown I couldn't identify which food entry you meant. Which one would you like to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:54.544Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change walnut butter to two tablespoons." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:33:05.711Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Walnut butter" at 90% confidence.
  • Matched your past food logs to "Walnut butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually the coconut milk was chocolate, not plain." (difficulty β€”)2.8s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said Updated to chocolate coconut milk.
2 Β· Card shown Updated the food entry from "Beverages, Coconut Water, Ready-To-Drink, Unsweetened" to "chocolate coconut milk".
3 Β· App data rows written updated food_log_entry: Milk Γ—1 (100 g) 50 cal Β· 3.3g P Β· 4.8g C Β· 2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:33:19.742Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Actually that was birthday cake, not cookie dough." (difficulty β€”)2.0s
Verdict Expected UPDATE β€” should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said Which exact birthday cake should replace Blood orange?
2 Β· Card shown Which exact birthday cake should replace Blood orange?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: cookie dough item
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-0-cookie-dough-item",
        "name": "cookie dough item",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-0-cookie-dough-item at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-0-cookie-dough-item",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:32.904Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Change the portion to two cups." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: millet
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-1-millet",
        "name": "millet",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-1-millet at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-1-millet",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:44.181Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould update the entry"Make it half a cup instead." (difficulty β€”)0.1s
Verdict Expected UPDATE β€” should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: buckwheat porridge
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-2-buckwheat-porridge",
        "name": "buckwheat porridge",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-2-buckwheat-porridge at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-2-buckwheat-porridge",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:33:55.536Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Update that to six ounces." (difficulty β€”)0.3s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Blood orange to 6 oz.
2 Β· Card shown Updated Blood orange to 6 oz.
3 Β· App data rows written updated food_log_entry: Blood orange Γ—1.2149785714285712 (140 g) 85 cal Β· 1.6g P Β· 22g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: swordfish
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-3-swordfish",
        "name": "swordfish",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-3-swordfish at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-3-swordfish",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:34:07.002Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually it was almond butter, not walnut butter." (difficulty β€”)0.6s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Updated to almond butter.
2 Β· Card shown Updated the food entry from "Blood orange" to "almond butter".
3 Β· App data rows written updated food_log_entry: Almond Butter Γ—1 (1 tablespoon) 103 cal Β· 3.3g P Β· 3.4g C Β· 8.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: walnut butter
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-4-walnut-butter",
        "name": "walnut butter",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-4-walnut-butter at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-4-walnut-butter",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:34:18.736Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Change the blood orange to a large." (difficulty β€”)5.0s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.0s
1 Β· TTS said Updated Blood orange to 1 large.
2 Β· Card shown Updated Blood orange to 1 large.
3 Β· App data rows written updated food_log_entry: Blood orange Γ—1 (140 g) 70 cal Β· 1.3g P Β· 18.1g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: blood orange
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-g-edit-5-blood-orange",
        "name": "blood orange",
        "brand": null,
        "source": "manual",
        "servingLabel": "serving",
        "servingQuantity": 1,
        "servingUnit": "serving",
        "macrosPerServing": {
          "calories": 180,
          "proteinGrams": 8,
          "fatGrams": 6,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-07-16T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-g-edit-5-blood-orange at 2026-07-18T10:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-g-edit-5-blood-orange",
      "quantity": 1,
      "loggedAt": "2026-07-18T10:00:00.000Z"
    }
snapshot captured 2026-08-02T22:34:41.458Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein is on my log today?" (difficulty β€”)0.1s
Verdict Expected QUERY β€” should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:46.072Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)