food-corpus-mixed-F Β· preserved partial run Β· iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
183
Pass
102 (56%)
Fail
62 (34%)
Unverified
19 (10%)
Pass rate
62%
Avg difficulty
β
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β needs a human look (that's you π/π-ing it). "Pass rate" = pass Γ· (pass + fail) β it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 19 unclassified β the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.
Why the fails happened β comprehension vs execution vs cosmetic
Comprehension β picked the wrong action/target (the hard problem)
61 (98%)
resolution β 60 (98% of comprehension)
"Log one large tangerine for the sequence." β Over-asked: asked instead of logging (no saved row).
"I had one cup grits with water only." β Over-asked: asked instead of logging (no saved row).
"Add two sunny side eggs for lunch." β Over-asked: asked instead of logging (no saved row).
"Breakfast was two sunny side eggs." β Over-asked: asked instead of logging (no saved row).
"Snack was one large tangerine." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
"Count eighteen pistachios." β Over-asked: asked instead of logging (no saved row).
+ 54 more
context β 1 (2% of comprehension)
"Not the large β the small tangerine." β Did not complete the pending action (lost the follow-up context).
Execution β right decision, output broke (plumbing)
1 (2%)
data-write β 1 (100% of execution)
"Enter one medium apricot." β Decided to log but the write did not confirm/persist (write-path failure).
Of 62 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.
Handled correctly? β by expected action
Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed to
N
Correct
Wrong
Unverified
βΈ LOG β log the entry
80
43 (54%)
35 (44%)
2 (3%)
35 handled wrong β click one to jump to its full detail below
"Log one large tangerine for the sequence."
OVER-ASK β asked instead of logging (no saved row).
"I had one cup grits with water only."
OVER-ASK β asked instead of logging (no saved row).
"Add two sunny side eggs for lunch."
OVER-ASK β asked instead of logging (no saved row).
"Breakfast was two sunny side eggs."
OVER-ASK β asked instead of logging (no saved row).
"Snack was one large tangerine."
WRITE-TRUTH FAIL β MACROS off for "tangerine": logged 180 kcal vs expected ~64 (Β§14 15pct/25cal band)
"Count eighteen pistachios."
OVER-ASK β asked instead of logging (no saved row).
"Lunch included four ounces roast pork."
OVER-ASK β asked instead of logging (no saved row).
"I drank eight ounces pineapple juice."
OVER-ASK β asked instead of logging (no saved row).
"Note two chicken breakfast sausages."
WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
"Supper was one cup kidney beans."
OVER-ASK β asked instead of logging (no saved row).
βΈ CLARIFY_ANSWER β complete the pending action
13
2 (15%)
1 (8%)
10 (77%)
1 handled wrong β click one to jump to its full detail below
"Not the large β the small tangerine."
Did not complete the pending action.
βΈ QUERY β answer the query
7
0 (0%)
0 (0%)
7 (100%)
No errors β all handled correctly.
βΈ DECLINE β decline
2
2 (100%)
0 (0%)
0 (0%)
No errors β all handled correctly.
Total
183
102 (62%)
62
19
Accuracy by difficulty
Pending A1's per-utterance difficulty score (requested 2026-07-05) β this bar chart lights up once that lands.
Clarification follow-ups β scored separately
Second turn: app asked, we replied β did it resolve correctly?
Follow-ups
13
Resolved
2 (15%)
Mishandled
1 (8%)
Unverified
10
"Not the large β the small tangerine."
Did not complete the pending action.
Cosmetic only
Not yet classified β pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.
System / infra
Not yet classified β pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.
Latency
Avg (time to ready)
1.1s
p90
3.2s
Max
12.8s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β click any dot to jump to its detail.
0s
1s
2s
5s
10s
13s
Response path β quick (single response) vs async (an ack like "Working on itβ¦" before the real answer).
Quick response
130
Sync clarification
53
Slowest 8 utterances (click to jump to detail):
"I had a grain bowl with bulgur, lentils, and yogurt sauce."12.8s
"I had huevos rancheros with two eggs, salsa, and black beans"6.2s
"Dinner was green curry with tofu, eggplant, and jasmine rice."5.9s
"Take out the margarita from last night."5.5s
"I had personal pizza."5.3s
"Wrong item. Pick the seared ahi."5.3s
"Lunch included four ounces roast pork."5.3s
"That's not it; the plain one."4.8s
Filter β controls the list below
Pass / Fail / Unverified
PASS 102FAIL 62UNVERIFIED 19
Module (intended for)
Food (183)
Utterance sub-type (within module)
183 shown β 102 pass, 62 fail, 19 unverified
Per-utterance detail
FAILshould log the entry"Log one large tangerine for the sequence." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one large tangerine for the sequence? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one large tangerine for the sequence? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:33.168Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one Aloha chocolate chip cookie dough bar." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chocolate Chip Cookie Dough Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Chocolate Chip Cookie Dough Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Chocolate Chip Cookie Dough Protein Bar β Aloha (1 bar (56.0g)) with an estimated macro range.
2 Β· Card shown Logged Chocolate Chip Cookie Dough Protein Bar β Aloha (1 bar (56.0g)) β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Chocolate Chip Cookie Dough Protein Bar Γ1 (1 bar (56.0g)) 240 cal Β· 14g P Β· 25g C Β· 11g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:44.857Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had one cup grits with water only." (difficulty β)2.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said What exact food and amount should I use for one cup grits with water only? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one cup grits with water only? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:55:58.830Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add two sunny side eggs for lunch." (difficulty β)4.0s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.0s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:14.041Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup cherries as a snack." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cherries β card not captured.
Why verdict Logged (write-truth verified): Cherries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup cherries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cherries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherries Γ1 (1 cup) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:25.552Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record six ounces grilled shrimp." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Shrimp β card not captured.
Why verdict Logged (write-truth verified): Shrimp β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces grilled shrimp.
2 Β· Card shown Logged six ounces grilled shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ1 (6 oz) 168 cal Β· 40.8g P Β· 0.3g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:40.969Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Shrimp" at 90% confidence.
Matched your past food logs to "Grilled Shrimp" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon cashew butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cashew butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cashew butter Γ1 (1 tbsp) 94 cal Β· 2.8g P Β· 4g C Β· 8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:48.152Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cashew butter" at 90% confidence.
Matched your past food logs to "cashew butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I drank one cup unsweetened almond milk." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Unsweetened almond milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup unsweetened almond milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup unsweetened almond milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Unsweetened almond milk Γ1 (1 cup) 31 cal Β· 1g P Β· 0.7g C Β· 2.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:59.466Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
Matched your past food logs to "Unsweetened Almond Milk" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one medium papaya half." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Papaya β card not captured.
Why verdict Logged (write-truth verified): Papaya β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one medium papaya half. Assumed 100 g because no amount was stated.
2 Β· Card shown Logged one medium papaya half. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Papaya Γ1 (100 g) 43 cal Β· 0.5g P Β· 10.8g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:10.904Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Papaya" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Breakfast was two sunny side eggs." (difficulty β)3.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:25.315Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Put down six ounces grilled shrimp." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Shrimp β card not captured.
Why verdict Logged (write-truth verified): Shrimp β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces grilled shrimp.
2 Β· Card shown Logged six ounces grilled shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ1 (6 oz) 168 cal Β· 40.8g P Β· 0.3g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:36.613Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "six ounces grilled shrimp" at 90% confidence.
Matched the common-food list to "Shrimp" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked jasmine rice." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked jasmine rice β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cooked jasmine rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked jasmine rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked jasmine rice Γ1 (1 cup) 205 cal Β· 3.8g P Β· 44.6g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:48.061Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
Matched your past food logs to "jasmine rice" at 82% confidence.
Matched your saved foods and aliases to "Cooked Jasmine Rice" at 74% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Snack was one large tangerine." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "tangerine": logged 180 kcal vs expected ~64 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "tangerine": logged 180 kcal vs expected ~64 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Got it, I logged tangerine.
2 Β· Card shown I logged tangerine β let me know if that's not right.
3 Β· App data rows written created food_log_entry: tangerine Γ1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:59.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate five ounces seared ahi tuna." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Seared Ahi Tuna β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows written created food_log_entry: Seared Ahi Tuna Γ1 (five ounces (141.7 g)) 184 cal Β· 41.1g P Β· 0g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:10.943Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one cup cherries." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cherries β card not captured.
Why verdict Logged (write-truth verified): Cherries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cherries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cherries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherries Γ1 (1 cup) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:22.196Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cherries" at 90% confidence.
Matched your past food logs to "Cherries" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Count eighteen pistachios." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Pistachios? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pistachios? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:35.054Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Lunch included four ounces roast pork." (difficulty β)5.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pork? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pork? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:49.907Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one cup roasted carrots." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Baby carrots β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup roasted carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup roasted carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Baby carrots Γ1 (1 cup) 52 cal Β· 0.9g P Β· 12.2g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:01.257Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Baby carrots" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Which one did you mean? 1. Pineapple Juice, 100% (1 fl oz (no ice)), 2. Pineapple Juice, Canned or Bottled, Unsweetened, with Added Ascorbic Acid, 3. Pineapple Juice, Canned, Not From Concentrate, Unsweetened, with Added Vitamins A, C and E, 4. Pineapple Juice, 100% (eight ounces )
2 Β· Card shown Which one did you mean? 1. Pineapple Juice, 100% (1 fl oz (no ice)), 2. Pineapple Juice, Canned or Bottled, Unsweetened, with Added Ascorbic Acid, 3. Pineapple Juice, Canned, Not From Concentrate, Unsweetened, with Added Vitamins A, C and E, 4. Pineapple Juice, 100% (eight ounces )
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:12.765Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Note two chicken breakfast sausages." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged your note in General about two chicken breakfast sausages.
2 Β· Card shown Logged your note in General about two chicken breakfast sausages.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "notes" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:24.611Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Supper was one cup kidney beans." (difficulty β)2.1s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said Which one did you mean? 1. Kidney Beans, 2. Kidney Beans, From Dried, Fat Added, 3. Kidney Beans, From Dried, No Added Fat
2 Β· Card shown Which one did you mean? 1. Kidney Beans, 2. Kidney Beans, From Dried, Fat Added, 3. Kidney Beans, From Dried, No Added Fat
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:48.857Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Enter one medium apricot." (difficulty β)1.3s
Verdict Expected LOG β should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said I could not finish that request safely.
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:01.349Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Ate a third cup dried mango." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Mango, Dried β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Mango, Dried (a third cup (55 g)).
2 Β· Card shown Logged Mango, Dried (a third cup (55 g)).
3 Β· App data rows written created food_log_entry: Mango, Dried Γ1 (a third cup (55 g)) 175 cal Β· 1.4g P Β· 43.2g C Β· 0.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:13.137Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon cashew butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cashew butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon cashew butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cashew butter Γ1 (1 tbsp) 94 cal Β· 2.8g P Β· 4g C Β· 8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:24.469Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "one tablespoon cashew butter" at 90% confidence.
Matched the common-food list to "Cashew butter" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner side was one cup roasted beets." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Beets β card not captured.
Why verdict Logged (write-truth verified): Beets β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup roasted beets. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup roasted beets. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Beets Γ1 (1 cup) 75 cal Β· 2.9g P Β· 17g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:35.927Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Beets" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had two cups pineapple chunks." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pineapple β card not captured.
Why verdict Logged (write-truth verified): Pineapple β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two cups pineapple chunks.
2 Β· Card shown Logged two cups pineapple chunks.
3 Β· App data rows written created food_log_entry: Pineapple Γ1 (2 cup) 165 cal Β· 1.7g P Β· 43.2g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:47.246Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pineapple" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put in one hundred eighty grams skyr-style yogurt." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said I found Plain Greek yogurt, but I also heard hundred eighty skyr style yogurt. Should I log those separately too?
2 Β· Card shown I found Plain Greek yogurt, but I also heard hundred eighty skyr style yogurt. Should I log those separately too?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:02.433Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup almond milk unsweetened." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Unsweetened almond milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup almond milk unsweetened. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup almond milk unsweetened. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Unsweetened almond milk Γ1 (1 cup) 31 cal Β· 1g P Β· 0.7g C Β· 2.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:11.396Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
Matched your past food logs to "Unsweetened almond milk" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Breakfast was half a cup feta crumbles." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Feta cheese β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged half a cup feta crumbles. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged half a cup feta crumbles. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Feta cheese Γ1 (0.5 cup) 198 cal Β· 10.6g P Β· 3.1g C Β· 16g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:22.651Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Feta cheese" at 90% confidence.
Matched your past food logs to "Codex Test Dairy Feta Crumbles" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count two corn tortillas small." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Corn tortilla β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two corn tortillas small.
2 Β· Card shown Logged two corn tortillas small.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ1 (2 corn tortillas) 122 cal Β· 3.2g P Β· 25g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:33.988Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Corn tortilla" at 90% confidence.
Matched your past food logs to "Corn Tortilla" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had six ounces lean ground chicken." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Lean ground chicken β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces lean ground chicken.
2 Β· Card shown Logged six ounces lean ground chicken.
3 Β· App data rows written created food_log_entry: Lean ground chicken Γ1 (6 oz) 191 cal Β· 32.3g P Β· 0g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:45.380Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Lean ground chicken" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add one cup black-eyed peas." (difficulty β)4.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said Which type of black-eyed peas was it? There are several with different nutrition.
2 Β· Card shown Which type of black-eyed peas was it? There are several with different nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:00.894Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Track half a cup pico de gallo." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:12.652Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log two frozen waffles whole grain." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said Did you have syrup, butter, or another topping with it? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Did you have syrup, butter, or another topping with it? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:26.630Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I ate one plain croissant small." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one plain croissant small? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one plain croissant small? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:40.466Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Record five ounces mussels." (difficulty β)0.9s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Which one did you mean? 1. Mussels (five ounces ), 2. Mussels
2 Β· Card shown Which one did you mean? 1. Mussels (five ounces ), 2. Mussels
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:52.515Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Snack was one Babybel light." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. UNVERIFIED: UNVERIFIABLE β no saved row captured (untagged / lossy) β resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β no saved row captured (untagged / lossy) β resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one babybel light. Assumed 1 babybel light as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one babybel light. Assumed 1 babybel light as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Babybel light Γ1 (1 babybel light) 42 cal Β· 6g P Β· 0g C Β· 2.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:11.691Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Babybel light" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add one teaspoon avocado oil." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Avocado oil β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one teaspoon avocado oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one teaspoon avocado oil. Assumed 1 tsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Avocado oil Γ1 (1 tsp) 40 cal Β· 0g P Β· 0g C Β· 4.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:18.065Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Avocado oil" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one cup barley." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked barley β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup barley. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup barley. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked barley Γ1 (1 cup) 193 cal Β· 3.6g P Β· 44.3g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:29.368Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked barley" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log one medium sweet onion sauteed." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one medium sweet onion sauteed? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one medium sweet onion sauteed? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:43.263Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.8s
1 Β· TTS said Which one did you mean? 1. Cold Brew Coffee, 2. Cold Brew Coffee (sixteen ounces )
2 Β· Card shown Which one did you mean? 1. Cold Brew Coffee, 2. Cold Brew Coffee (sixteen ounces )
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:10.872Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count one cup radishes." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Radishes β card not captured.
Why verdict Logged (write-truth verified): Radishes β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup radishes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup radishes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Radishes Γ1 (1 cup) 19 cal Β· 0.8g P Β· 3.9g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:22.291Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Radishes" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was six ounces turkey meatballs." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "turkey meatballs": logged 315 kcal vs expected ~220 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "turkey meatballs": logged 315 kcal vs expected ~220 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces turkey meatballs.
2 Β· Card shown Logged six ounces turkey meatballs.
3 Β· App data rows written created food_log_entry: Turkey meatballs Γ1 (6 oz) 315 cal Β· 30.6g P Β· 10.2g C Β· 17g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:33.547Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Turkey meatballs" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one cup miso soup." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Miso soup β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup miso soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup miso soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Miso soup Γ1 (1 cup) 49 cal Β· 3.7g P Β· 6.6g C Β· 1.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:44.853Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Miso soup" at 90% confidence.
Matched your past food logs to "Codex Test Kitchen Miso Soup Bowl" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add three rice crackers." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Rice crackers β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three rice crackers.
2 Β· Card shown Logged three rice crackers.
3 Β· App data rows written created food_log_entry: Rice crackers Γ1 (3 rice crackers) 87 cal Β· 2.1g P Β· 17.3g C Β· 1.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:56.149Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Rice crackers" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup blueberries frozen." (difficulty β)2.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Blueberries, Frozen β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Got it, I logged Blueberries, Frozen.
2 Β· Card shown I logged Blueberries, Frozen β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Blueberries, Frozen Γ1 (one cup (148 g)) 75 cal Β· 0.6g P Β· 18.1g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:09.795Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Track two tablespoons tzatziki." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I couldn't convert two tablespoons of Tzatziki from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert two tablespoons of Tzatziki from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:21.070Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate one medium guava." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Guava β card not captured.
Why verdict Logged (write-truth verified): Guava β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium guava. Assumed 1 guava as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium guava. Assumed 1 guava as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Guava Γ1 (1 guava) 37 cal Β· 1.4g P Β· 7.9g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:32.321Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Guava" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put down one cup bulgur." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said I couldn't convert one cup of Bulgur, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert one cup of Bulgur, Cooked from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:44.229Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record four ounces chicken breast strips." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken breast β card not captured.
Why verdict Logged (write-truth verified): Chicken breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged four ounces chicken breast strips.
2 Β· Card shown Logged four ounces chicken breast strips.
3 Β· App data rows written created food_log_entry: Chicken breast Γ1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:55.610Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual Aloha bar." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Aloha Chocolate Chip Cookie Dough β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
2 Β· Card shown Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Aloha Chocolate Chip Cookie Dough Γ1 (bar) 220 cal Β· 14g P Β· 24g C Β· 10g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual aloha bar" at 96% confidence.
Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had my usual labneh." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Plain Labneh β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Dairy Plain Labneh. Using your saved "my usual labneh". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Plain Labneh. Using your saved "my usual labneh". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Plain Labneh Γ1 (cup) 160 cal Β· 10g P Β· 5g C Β· 12g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual labneh" at 96% confidence.
Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Lunch was my usual chicken shawarma." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken Shawarma Plate β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Deli Chicken Shawarma Plate. Using your saved "my usual chicken shawarma". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Deli Chicken Shawarma Plate. Using your saved "my usual chicken shawarma". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Shawarma Plate Γ1 (plate) 480 cal Β· 36g P Β· 40g C Β· 18g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual chicken shawarma" at 96% confidence.
Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner side was my usual rice." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked Jasmine Rice β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Jasmine Rice Γ1 (cup) 205 cal Β· 4g P Β· 45g C Β· 0.4g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual rice" at 96% confidence.
Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track my usual pistachios." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pistachios β card not captured.
Why verdict Logged (write-truth verified): Pistachios β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Pistachios. Using your saved "my usual pistachios". Tell me if that is wrong.
2 Β· Card shown Logged Pistachios. Using your saved "my usual pistachios". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Pistachios Γ1 (ounce) 160 cal Β· 6g P Β· 8g C Β· 13g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual pistachios" at 96% confidence.
Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log my default almond milk." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Unsweetened Almond Milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Unsweetened Almond Milk. Using your saved "my default almond milk". Tell me if that is wrong.
2 Β· Card shown Logged Unsweetened Almond Milk. Using your saved "my default almond milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Unsweetened Almond Milk Γ1 (cup) 30 cal Β· 1g P Β· 1g C Β· 2.5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my default almond milk" at 96% confidence.
Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual evening chai." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chai Latte β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Chai Latte. Using your saved "my usual evening chai". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Chai Latte. Using your saved "my usual evening chai". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chai Latte Γ1 (cup) 120 cal Β· 4g P Β· 20g C Β· 3g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual evening chai" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had my normal grits." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Grits. Using your saved "my normal grits". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Grits. Using your saved "my normal grits". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Grits Γ1 (cup) 145 cal Β· 3g P Β· 31g C Β· 0.5g F
{
"type": "food_default",
"phrase": "my normal grits",
"foodItemId": "seed-f-grits",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "cup",
"displayLabel": "my normal grits",
"confirmBeforeLog": false
}
}
snapshot captured 2026-08-02T22:07:25.550Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my normal grits" at 96% confidence.
Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track my go-to cold brew." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cold Brew Coffee β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Cold Brew Coffee. Using your saved "my go to cold brew". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Cold Brew Coffee. Using your saved "my go to cold brew". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cold Brew Coffee Γ1 (cup) 5 cal Β· 0.3g P Β· 0g C Β· 0g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my go to cold brew" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log my usual bedtime cocoa." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Hot Cocoa Water β card not captured.
Why verdict Logged (write-truth verified): Hot Cocoa Water β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Hot Cocoa Water. Using your saved "my usual bedtime cocoa". Tell me if that is wrong.
2 Β· Card shown Logged Hot Cocoa Water. Using your saved "my usual bedtime cocoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Hot Cocoa Water Γ1 (cup) 80 cal Β· 2g P Β· 16g C Β· 1g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual bedtime cocoa" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add the same feta as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "Feta Crumbles" β no saved row with matching identity (rows: Feta cheese)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "Feta Crumbles" β no saved row with matching identity (rows: Feta cheese)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Feta cheese. Using your recent Feta cheese history. Tell me if that is wrong.
2 Β· Card shown Logged Feta cheese. Using your recent Feta cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Feta cheese Γ1 (0.5 cup) 198 cal Β· 10.6g P Β· 3.1g C Β· 16g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Feta cheese" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Same Aloha bar as yesterday." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "Aloha Protein Bar" β no saved row with matching identity (rows: Aloha Chocolate Chip Cookie Dough)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "Aloha Protein Bar" β no saved row with matching identity (rows: Aloha Chocolate Chip Cookie Dough)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
2 Β· Card shown Logged Aloha Aloha Chocolate Chip Cookie Dough. Using your saved "my usual aloha bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Aloha Chocolate Chip Cookie Dough Γ1 (bar) 220 cal Β· 14g P Β· 24g C Β· 10g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log the same miso soup I had last night." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Miso soup β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Miso soup. Using your recent Miso soup history. Tell me if that is wrong.
2 Β· Card shown Logged Miso soup. Using your recent Miso soup history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Miso soup Γ1 (1 cup) 49 cal Β· 3.7g P Β· 6.6g C Β· 1.5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Miso soup" at 90% confidence.
Matched your past food logs to "Miso soup" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same oatmeal as this morning." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Oatmeal Bowl β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
2 Β· Card shown Logged Oatmeal Bowl. Using your recent Oatmeal Bowl history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oatmeal Bowl Γ1 (bowl) 150 cal Β· 5g P Β· 27g C Β· 2.5g F
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add the same ahi I had earlier." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Seared Ahi Tuna β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Seared Ahi Tuna. Using your recent Seared Ahi Tuna history. Tell me if that is wrong.
2 Β· Card shown Logged Seared Ahi Tuna. Using your recent Seared Ahi Tuna history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Seared Ahi Tuna Γ1 (five ounces (141.7 g)) 184 cal Β· 41.1g P Β· 0g C Β· 0.9g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Ahi tuna" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same smoothie as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cherry Protein Smoothie β card not captured.
Why verdict Logged (write-truth verified): Cherry Protein Smoothie β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Recipe Cherry Protein Smoothie. Using your recent Codex Test Recipe Cherry Protein Smoothie history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Cherry Protein Smoothie. Using your recent Codex Test Recipe Cherry Protein Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cherry Protein Smoothie Γ1 (smoothie) 270 cal Β· 22g P Β· 32g C Β· 4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Recipe Cherry Protein Smoothie
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log the shrimp I had last time." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I heard you want the same the shrimp I had last time as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
2 Β· Card shown I heard you want the same the shrimp I had last time as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Shrimp" at 90% confidence.
Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Same tortilla as earlier today." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "Corn Tortilla": logged 122 kcal vs expected ~50 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "Corn Tortilla": logged 122 kcal vs expected ~50 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Corn tortilla. Using your recent Corn tortilla history. Tell me if that is wrong.
2 Β· Card shown Logged Corn tortilla. Using your recent Corn tortilla history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ1 (2 corn tortillas) 122 cal Β· 3.2g P Β· 25g C Β· 1.6g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Tortilla" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Snack was one Larabar cashew cookie." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said What exact food and amount should I use for one larabar cashew cookie? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one larabar cashew cookie? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:41.818Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Finished one Fairlife Core Power banana shake." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:53.502Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Track one Fage total zero strawberry cup." (difficulty β)3.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:08.283Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one Aloha chocolate mint bar." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chocolate Mint Organic Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Chocolate Mint Organic Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Chocolate Mint Organic Protein Bar β ALOHA with an estimated macro range.
2 Β· Card shown Logged Chocolate Mint Organic Protein Bar β ALOHA β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Chocolate Mint Organic Protein Bar Γ1 (1 Bar) 220 cal Β· 14g P Β· 26g C Β· 9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:19.973Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I ate one RXBAR mixed berry." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said What exact food and amount should I use for one rxbar mixed berry? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one rxbar mixed berry? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:31.745Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log a papaya and one Aloha bar." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Papaya, Aloha Protein Bar, Chocolate Espresso β card not captured.
Why verdict Logged (write-truth verified): Papaya, Aloha Protein Bar, Chocolate Espresso β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged a papaya and Aloha Protein Bar, Chocolate Espresso β Aloha. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged a papaya and Aloha Protein Bar, Chocolate Espresso β Aloha. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Papaya Γ1 (100 g) 43 cal Β· 0.5g P Β· 10.8g C Β· 0.3g F created food_log_entry: Aloha Protein Bar, Chocolate Espresso Γ1 (1 bar (1 serving (56 g))) 230 cal Β· 14g P Β· 26g C Β· 10g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:43.519Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had oatmeal and cold brew." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Cooked oatmeal and cold brew. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cooked oatmeal and cold brew. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F created food_log_entry: cold brew Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:55.196Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was sunny side eggs and corn tortillas." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Egg and Corn tortilla. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Egg and Corn tortilla. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ1 (50 g) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F created food_log_entry: Corn tortilla Γ1 (28 g) 61 cal Β· 1.6g P Β· 12.5g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:06.712Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a turkey burger and a tangerine." (difficulty β)1.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said I need to resolve a turkey burger before I log this meal. What should I use for a turkey burger?
2 Β· Card shown I need to resolve a turkey burger before I log this meal. What should I use for a turkey burger?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:19.656Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was pistachios and cherries." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Pistachios and Cherries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Pistachios and Cherries? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:31.082Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "pistachios" at 90% confidence.
Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was ahi and roasted carrots." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Ahi tuna and Baby carrots? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Ahi tuna and Baby carrots? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:42.485Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Baby carrots" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate labneh and blueberries." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Labneh and Blueberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh and Blueberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:53.898Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Blueberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track shrimp and jasmine rice." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Shrimp and Cooked jasmine rice? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Shrimp and Cooked jasmine rice? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:17.092Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
Matched your past food logs to "jasmine rice" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add feta and jicama." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Feta cheese and Jicama? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Feta cheese and Jicama? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:28.636Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Jicama" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had a Larabar and sparkling lime water." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Larabar, Water β card not captured.
Why verdict Logged (write-truth verified): Larabar, Water β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Larabar β Larabar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Larabar β Larabar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Larabar Γ1 (55 g) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Water Γ1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:40.461Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log miso soup and bok choy." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Miso soup and Bok choy? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Miso soup and Bok choy? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:52.035Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "miso soup" at 90% confidence.
Matched the common-food list to "Miso soup" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was oatmeal, yogurt, and coffee." (difficulty β)0.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Cooked oatmeal, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cooked oatmeal, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Coffee Γ1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:03.710Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a guava, Babybel light, and rice crackers." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Babybel light and Rice crackers? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Babybel light and Rice crackers? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:15.262Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Rice crackers" at 90% confidence.
Matched your saved foods and aliases to "Rice crackers" at 66% confidence.
Matched your saved foods and aliases to "one babybel light" at 66% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was turkey meatballs, barley, and beets." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Turkey meatballs, Cooked barley, and Beets? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Turkey meatballs, Cooked barley, and Beets? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:26.884Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked barley" at 90% confidence.
Matched your past food logs to "Turkey meatballs" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was radishes and tzatziki." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Radishes and Tzatziki? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Radishes and Tzatziki? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:38.273Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Radishes" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a grain bowl and iced tea." (difficulty β)1.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Grain Bowl Γ1 (serving) 313 cal Β· 8.1g P Β· 55.7g C Β· 6.7g F created food_log_entry: Unsweetened iced tea Γ1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:13:52.492Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had rice, kidney beans, and ground chicken." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Cooked white rice, Beans, and Lean ground chicken. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cooked white rice, Beans, and Lean ground chicken. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F created food_log_entry: Beans Γ1 (86 g) 109 cal Β· 7.5g P Β· 19.6g C Β· 0.4g F created food_log_entry: Lean ground chicken Γ1 (100 g) 112 cal Β· 19g P Β· 0g C Β· 3.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:04.336Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track labneh, honey, and pistachios." (difficulty β)0.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said How much should I log for Labneh, Honey, and Pistachios? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Labneh, Honey, and Pistachios? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:16.144Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "pistachios" at 90% confidence.
Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add eggs, chicken sausage, and pineapple juice." (difficulty β)0.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Logged Egg, AMYLU Chicken Sausage, and Pineapple Juice, 100%. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Egg, AMYLU Chicken Sausage, and Pineapple Juice, 100%. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ1 (50 g) 72 cal Β· 6.3g P Β· 0.4g C Β· 4.8g F created food_log_entry: AMYLU Chicken Sausage Γ1 (one) 110 cal Β· 12g P Β· 1g C Β· 6g F created food_log_entry: Pineapple Juice, 100% Γ1 (1 fl oz (no ice)) 16 cal Β· 0.1g P Β· 4g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:28.190Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate pasta and a side of butter lettuce." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Cooked pasta and Butter lettuce. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cooked pasta and Butter lettuce. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Butter lettuce Γ1 (55 g) 7 cal Β· 0.8g P Β· 1.2g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:39.704Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a kiwi and cashew butter." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much should I log for Cashew butter? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Cashew butter? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:51.305Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cashew butter" at 90% confidence.
Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was cereal and almond milk." (difficulty β)1.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said I need to resolve cereal before I log this meal. What should I use for cereal?
2 Β· Card shown I need to resolve cereal before I log this meal. What should I use for cereal?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:03.541Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had huevos rancheros with two eggs, salsa, and black beans" (difficulty β)6.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.2s
1 Β· TTS said Which black beans should I use?
2 Β· Card shown Which black beans should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:20.965Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a smoothie with cherries, kale, and casein protein." (difficulty β)2.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.9s
1 Β· TTS said Which kale should I use?
2 Β· Card shown Which kale should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:35.042Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a grain bowl with bulgur, lentils, and yogurt sauce." (difficulty β)12.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 12.8s
1 Β· TTS said What should I use for yogurt sauce?
2 Β· Card shown What should I use for yogurt sauce?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:58.986Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the entry"Breakfast was breakfast burrito with egg, potato, and cheese." (difficulty β)3.6s
Verdict Expected LOG β should log the entry. UNVERIFIED: UNVERIFIABLE β no saved row captured (untagged / lossy) β resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
Why verdict UNVERIFIABLE β no saved row captured (untagged / lossy) β resolve via the notes.utterance_trace_id join. App claim not credited; resolve via the notes.utterance_trace_id join.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said Logging your Breakfast was breakfast burrito with egg, potato, and cheese β still looking up the nutrition details; they'll appear in your log shortly.
2 Β· Card shown Logging your Breakfast was breakfast burrito with egg, potato, and cheese β still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: Breakfast was breakfast burrito with egg, potato, and cheese (pending)
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:20.267Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I made jambalaya with shrimp, sausage, rice, and peppers." (difficulty β)2.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Which shrimp should I use?
2 Β· Card shown Which shrimp should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:27.138Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was a taco bowl with rice, carnitas, pico, and guacamole." (difficulty β)2.4s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said What should I use for pico?
2 Β· Card shown What should I use for pico?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:52.304Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had ramen with chicken and corn." (difficulty β)3.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said Which corn should I use?
2 Β· Card shown Which corn should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:06.826Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log a chicken sandwich with pickles and mustard." (difficulty β)0.9s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What should I use for pickles?
2 Β· Card shown What should I use for pickles?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:18.824Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I built an acai bowl with granola, pineapple, and coconut." (difficulty β)4.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said Which coconut should I use?
2 Β· Card shown Which coconut should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:34.538Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was green curry with tofu, eggplant, and jasmine rice." (difficulty β)5.9s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.9s
1 Β· TTS said Which eggplant should I use?
2 Β· Card shown Which eggplant should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:51.551Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add some grits." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Instant grits? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Instant grits? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:02.793Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had bulgur." (difficulty β)0.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said How much bulgur did you have?
2 Β· Card shown How much bulgur did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:14.712Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log jasmine rice for dinner." (difficulty β)1.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said How much should I log for Cooked jasmine rice? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Cooked jasmine rice? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:27.191Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked jasmine rice" at 90% confidence.
Matched your past food logs to "jasmine rice" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track ramen noodles." (difficulty β)3.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS said How much ramen noodles did you have?
2 Β· Card shown How much ramen noodles did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:42.024Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate tortilla chips." (difficulty β)1.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said How much tortilla chips did you have?
2 Β· Card shown How much tortilla chips did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:54.889Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add pistachios." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Pistachios? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pistachios? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:06.091Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "pistachios" at 90% confidence.
Matched the common-food list to "Pistachios" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Log a bowl of miso." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a bowl of miso? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bowl of miso? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:19.959Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of jambalaya." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a plate of jambalaya? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a plate of jambalaya? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:33.883Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track pineapple juice." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much pineapple juice did you have?
2 Β· Card shown How much pineapple juice did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:45.353Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add cold brew." (difficulty β)1.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said How much cold brew did you have?
2 Β· Card shown How much cold brew did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:19:57.742Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I drank margarita." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much margarita did you have?
2 Β· Card shown How much margarita did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:09.021Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log sherbet." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much sherbet did you have?
2 Β· Card shown How much sherbet did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:20.539Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Had some mixed seeds." (difficulty β)2.1s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said How much mixed seeds did you have?
2 Β· Card shown How much mixed seeds did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:33.762Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Add popcorn." (difficulty β)1.8s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said How much popcorn did you have?
2 Β· Card shown How much popcorn did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:46.643Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had an Aloha bar." (difficulty β)0.6s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Which one did you mean? 1. Protein Bar β Aloha (bar), 2. Protein Bar, Chocolate Espresso β Aloha, 3. Chocolate Mint Organic Protein Bar β ALOHA, 4. Chocolate Chip Cookie Dough Protein Bar β Aloha
2 Β· Card shown Which one did you mean? 1. Protein Bar β Aloha (bar), 2. Protein Bar, Chocolate Espresso β Aloha, 3. Chocolate Mint Organic Protein Bar β ALOHA, 4. Chocolate Chip Cookie Dough Protein Bar β Aloha
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:20:58.387Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a labneh cup." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a labneh cup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a labneh cup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Labneh Γ1 (1 cup) 192 cal Β· 12g P Β· 6g C Β· 14.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:21.342Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Labneh" at 90% confidence.
Matched your past food logs to "Codex Test Dairy Plain Labneh" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Track a nut milk." (difficulty β)3.8s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS said Which one did you mean? 1. my default almond milk, 2. one cup almond milk unsweetened, 3. one cup unsweetened almond milk, 4. unsweetened almond milk
2 Β· Card shown Which one did you mean? 1. my default almond milk, 2. one cup almond milk unsweetened, 3. one cup unsweetened almond milk, 4. unsweetened almond milk
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:36.304Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a burrito." (difficulty β)0.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which one did you mean? 1. Burrito, Beef, with Beans and Rice, Cheese, 2. Burrito, Chicken, with Beans and Rice, Cheese
2 Β· Card shown Which one did you mean? 1. Burrito, Beef, with Beans and Rice, Cheese, 2. Burrito, Chicken, with Beans and Rice, Cheese
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:21:48.233Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a meal shake." (difficulty β)1.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said I couldn't find Add A Meal Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
2 Β· Card shown I couldn't find Add A Meal Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:00.589Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had cold brew with cream." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said How much cold brew with cream did you have?
2 Β· Card shown How much cold brew with cream did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:13.161Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a biscuit." (difficulty β)0.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which one did you mean? 1. Biscuit, From Fast Food / Restaurant, 2. Biscuit, From Refrigerated Dough
2 Β· Card shown Which one did you mean? 1. Biscuit, From Fast Food / Restaurant, 2. Biscuit, From Refrigerated Dough
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:25.119Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Track a turkey burger." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Logged Turkey Burger Patty with an estimated macro range.
2 Β· Card shown Logged Turkey Burger Patty β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Turkey Burger Patty Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:37.713Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had personal pizza." (difficulty β)5.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pizza? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:22:55.468Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Add a biscuit sandwich." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged ice cream sandwich with an estimated macro range.
2 Β· Card shown Logged ice cream sandwich β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: ice cream sandwich Γ1 (serving) 200 cal Β· 5g P Β· 20g C Β· 10g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:23:05.661Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual cold brew size." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged cold brew. Using your saved "log my usual cold brew size". Tell me if that is wrong.
2 Β· Card shown Logged cold brew. Using your saved "log my usual cold brew size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: cold brew Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "log my usual cold brew size" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add the regular dinner portion." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
2 Β· Card shown Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: dinner portion Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "add the regular dinner portion" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track my default afternoon snack." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
2 Β· Card shown Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "track my default afternoon snack" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had the usual breakfast size." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
2 Β· Card shown Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
{
"type": "food_default",
"phrase": "i had the usual breakfast size",
"foodItemId": "seed-f-bfast-size",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "serving",
"displayLabel": "i had the usual breakfast size",
"confirmBeforeLog": false
}
}
snapshot captured 2026-08-02T22:23:51.171Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "i had the usual breakfast size" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Three quarters of a cup." (difficulty β)2.0s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I couldn't find Quarter's A Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Quarter's A Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:04.244Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One and a half cups, plain." (difficulty β)1.4s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:16.824Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"The Aloha chocolate mint." (difficulty β)3.9s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said I couldn't find "Aloha Chocolate Mint" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
2 Β· Card shown I couldn't find "Aloha Chocolate Mint" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:31.900Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "Aloha Chocolate Chip Cookie Dough" at 84% confidence.
Matched your past food logs to "ALOHA Chocolate Mint Organic Protein Bar" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Unsweetened almond milk." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Unsweetened almond milk? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Unsweetened almond milk? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:43.131Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Unsweetened almond milk" at 98% confidence.
Matched your saved foods and aliases to "unsweetened almond milk" at 96% confidence.
Matched your saved foods and aliases to "Unsweetened almond milk" at 84% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not it β the unsweetened one." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about breakfast?
2 Β· Card shown What should I change about breakfast?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:24:54.389Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould complete the pending action"Wrong one. The cherry, not grape." (difficulty β)0.6s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Cherries and Grapes. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cherries and Grapes. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cherries Γ1 (154 g) 97 cal Β· 1.7g P Β· 24.6g C Β· 0.3g F created food_log_entry: Grapes Γ1 (100 g) 69 cal Β· 0.7g P Β· 18.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:06.105Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, not the flavored labneh." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Grapes?
2 Β· Card shown What should I change about Grapes?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:25:17.291Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Labneh" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould decline"Cancel that entry." (difficulty β)0.1s
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not the bar I meant." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about Cherries?
2 Β· Card shown What should I change about Cherries?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:03.987Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"Not the large β the small tangerine." (difficulty β)2.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS said Got it. Logging the small tangerine instead.
2 Β· Card shown Got it. Logging the small tangerine instead.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:17.212Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong item. Pick the seared ahi." (difficulty β)5.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for wrong item pick the seared ahi? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for wrong item pick the seared ahi? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:26:34.337Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"That's not it; the plain one." (difficulty β)4.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.8s
1 Β· TTS said I couldn't find "plain one" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find "plain one" in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:00.884Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould complete the pending action"No, the other tortilla." (difficulty β)2.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Updated to the other tortilla.
2 Β· Card shown Updated the food entry from "Cherries" to "the other tortilla".
3 Β· App data rows written updated food_log_entry: Tortilla Γ1 (45 g) 140 cal Β· 3.8g P Β· 22.5g C Β· 3.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:14.295Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not those pistachios β the roasted ones." (difficulty β)3.9s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said What exact food and amount should I use for Pistachios? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pistachios? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:27:40.536Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the tangerine from earlier." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:03.000Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove that Aloha bar." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:14.216Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "Aloha Protein Bar" at 83% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the grits entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:25.444Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Instant grits" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:36.642Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "egg" at 90% confidence.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the cherries." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:47.843Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "cherries" at 90% confidence.
Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the shrimp log." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:28:59.093Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Shrimp" at 90% confidence.
Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Scratch the cashew butter." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:10.371Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cashew butter" at 90% confidence.
Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the almond milk entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:29:24.198Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Unsweetened almond milk" at 90% confidence.
Matched your past food logs to "Unsweetened Almond Milk" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete that churro I logged last night." (difficulty β)0.7s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Deleted churro.
2 Β· Card shown Deleted churro.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 3.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove yesterday's ice cream sandwich." (difficulty β)0.0s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "ice cream sandwich" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the leftover taco entry." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted taco.
2 Β· Card shown Deleted taco.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take out the margarita from last night." (difficulty β)5.5s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.5s
1 Β· TTS said I didn't make any changes to your food log. To remove an item, please specify the exact food and time to delete.
2 Β· Card shown I didn't make any changes to your food log. To remove an item, please specify the exact food and time to delete.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Remove the doughnut log from earlier this week." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted doughnut.
2 Β· Card shown Deleted doughnut.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the chips I shouldn't have logged." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted chips.
2 Β· Card shown Deleted chips.
3 Β· App data rows written deleted food_log_entry:
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Potato chips" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the sequence tangerine quantity to two." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:30:59.561Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "tangerine" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually make the Aloha bar two bars." (difficulty β)0.8s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which exact aloha bar two bars should replace Aloha Protein Bar, Chocolate Espresso?
2 Β· Card shown Which exact aloha bar two bars should replace Aloha Protein Bar, Chocolate Espresso?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:11.590Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Update the grits to one and a half cups." (difficulty β)0.3s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Cooked Grits to 1.5 cup.
2 Β· Card shown Updated Cooked Grits to 1.5 cup.
3 Β· App data rows written updated food_log_entry: Cooked Grits Γ1.5 (cup) 218 cal Β· 4.5g P Β· 46.5g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:22.924Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the eggs to three." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:34.133Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "egg" at 90% confidence.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make the cherries a half cup." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:45.359Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "cherries" at 90% confidence.
Matched the common-food list to "Cherries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Update the shrimp to eight ounces." (difficulty β)0.3s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Shrimp to 8 oz.
2 Β· Card shown Updated Shrimp to 8 oz.
3 Β· App data rows written updated food_log_entry: Shrimp Γ1.3333333333333335 (6 oz) 224 cal Β· 54.4g P Β· 0.4g C Β· 0.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:31:56.789Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Shrimp" at 90% confidence.
Matched your past food logs to "Shrimp" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change cashew butter to two tablespoons." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:08.004Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cashew butter" at 90% confidence.
Matched your past food logs to "Cashew butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually the almond milk was vanilla, not plain." (difficulty β)3.2s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.2s
1 Β· TTS said Updated to vanilla almond milk.
2 Β· Card shown Updated the food entry from "Unsweetened Almond Milk" to "vanilla almond milk".
3 Β· App data rows written updated food_log_entry: Unsweetened almond milk Γ1 (100 g) 13 cal Β· 0.4g P Β· 0.3g C Β· 1.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:32:22.502Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually that was mint, not chocolate." (difficulty β)0.2s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Which exact mint should replace Tortilla?
2 Β· Card shown Which exact mint should replace Tortilla?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the portion to one and a half cups." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make it a quarter cup instead." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Update that to eight ounces." (difficulty β)0.2s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Updated Tortilla to 8 oz.
2 Β· Card shown Updated Tortilla to 8 oz.
3 Β· App data rows written updated food_log_entry: Tortilla Γ1.4727012987012986 (154 g) 206 cal Β· 5.6g P Β· 33.1g C Β· 5.3g F
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually it was peanut butter, not cashew butter." (difficulty β)1.6s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said Updated to peanut butter.
2 Β· Card shown Updated the food entry from "Tortilla" to "peanut butter".
3 Β· App data rows written updated food_log_entry: Peanut butter Γ1 (32 g) 188 cal Β· 8g P Β· 6.3g C Β· 16.1g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the tangerine to a small." (difficulty β)2.6s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said Which exact small tangerine should replace tangerine?
2 Β· Card shown Which exact small tangerine should replace tangerine?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein remains for today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:33:45.681Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories have I tracked?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:08.564Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat two nights ago?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said No β I do not see two nights ago logged today.
2 Β· Card shown No β I do not see two nights ago logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:19.750Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much potassium today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:30.921Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's left in my protein budget?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You are about 8070 calories over today's 2200 calorie budget (10270 logged).
2 Β· Card shown You are about 8070 calories over today's 2200 calorie budget (10270 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:42.123Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log brunch yet?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said No β I do not see brunch logged today.
2 Β· Card shown No β I do not see brunch logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:34:53.526Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs are on the board?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:35:04.780Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)