food-corpus-mixed-D Β· preserved partial run Β· iOS sim
This is the preserved partial result for this run. Its original utterance evidence is shown below.
Rows
198
Pass
113 (57%)
Fail
56 (28%)
Unverified
29 (15%)
Pass rate
67%
Avg difficulty
β
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β needs a human look (that's you π/π-ing it). "Pass rate" = pass Γ· (pass + fail) β it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 29 unclassified β the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.
Why the fails happened β comprehension vs execution vs cosmetic
Comprehension β picked the wrong action/target (the hard problem)
56 (100%)
resolution β 53 (95% of comprehension)
"I had one cup steel cut oats with water only." β Over-asked: asked instead of logging (no saved row).
"Count twenty cashews." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
"Lunch included four ounces roast turkey." β Over-asked: asked instead of logging (no saved row).
"Ate a half cup dried cranberries." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
"Put in one hundred fifty grams skyr yogurt." β Over-asked: asked instead of logging (no saved row).
"Breakfast was three quarters cup ricotta." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
+ 47 more
context β 2 (4% of comprehension)
"Wrong one. The vanilla, not chocolate." β Did not complete the pending action (lost the follow-up context).
"Not those cashews β the raw ones." β Did not complete the pending action (lost the follow-up context).
routing β 1 (2% of comprehension)
"Open macro goals." β Did not navigate where asked.
Of 56 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.
Handled correctly? β by expected action
Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed to
N
Correct
Wrong
Unverified
βΈ LOG β log the entry
81
57 (70%)
24 (30%)
0 (0%)
24 handled wrong β click one to jump to its full detail below
"I had one cup steel cut oats with water only."
OVER-ASK β asked instead of logging (no saved row).
"Count twenty cashews."
WRITE-TRUTH FAIL β MACROS off for "cashews": logged 3140 kcal vs expected ~160 (Β§14 15pct/25cal band)
"Lunch included four ounces roast turkey."
OVER-ASK β asked instead of logging (no saved row).
"Ate a half cup dried cranberries."
WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
"Put in one hundred fifty grams skyr yogurt."
OVER-ASK β asked instead of logging (no saved row).
"Breakfast was three quarters cup ricotta."
WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
"I had eight ounces 90 percent lean ground beef."
OVER-ASK β asked instead of logging (no saved row).
"Log three whole wheat pancakes."
OVER-ASK β asked instead of logging (no saved row).
"I ate one plain bagel."
WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
"Record six ounces scallops."
WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
"Log one medium russet potato."
OVER-ASK β asked instead of logging (no saved row).
"I had one cup butternut squash soup."
WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
"Put down one cup couscous."
OVER-ASK β asked instead of logging (no saved row).
"Record five ounces chicken sausage."
OVER-ASK β asked instead of logging (no saved row).
"Add the same ricotta as yesterday."
WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
"Log the same soup I had last night."
OVER-ASK β asked instead of logging (no saved row).
"Add the same salmon I had earlier."
WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
"Snack was one chocolate Chip's Ahoy cookie pack mini."
OVER-ASK β asked instead of logging (no saved row).
"Log a medium orange and one RXBAR chocolate sea salt."
OVER-ASK β asked instead of logging (no saved row).
"I had a Kind bar and water."
WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Cookies & Cream Protein Bar, Water)
"Breakfast was avocado toast with egg and chili flakes."
OVER-ASK β asked instead of logging (no saved row).
"Dinner was a poke bowl with rice, tuna, avocado, and seaweed."
OVER-ASK β asked instead of logging (no saved row).
"Dinner was butter chicken with rice, naan, and cucumber salad."
OVER-ASK β asked instead of logging (no saved row).
"I drank a glass of orange juice."
OVER-ASK β asked instead of logging (no saved row).
βΈ CLARIFY β ask a clarifying question
53
43 (81%)
10 (19%)
0 (0%)
10 handled wrong β click one to jump to its full detail below
"Lunch was a tuna melt and an apple."
WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
"I ate a pear, string cheese, and pretzels."
Logged a BLIND guess β no stated assumption, no correction invited.
"Dinner was pork, farro, and Brussels sprouts."
Logged a BLIND guess β no stated assumption, no correction invited.
"I ate noodles and a side of spinach."
WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
"Breakfast was cereal and oat milk."
Logged a BLIND guess β no stated assumption, no correction invited.
"Log a smoothie with spinach, banana, and whey protein."
Logged a BLIND guess β no stated assumption, no correction invited.
"I had a grain bowl with quinoa, chickpeas, and tahini."
Logged a BLIND guess β no stated assumption, no correction invited.
"I had an energy bar."
WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar, Generic protein bar)
"I ate a deli sandwich."
Logged a BLIND guess β no stated assumption, no correction invited.
"Add a scone."
Logged a BLIND guess β no stated assumption, no correction invited.
βΈ QUERY β answer the query
18
0 (0%)
0 (0%)
18 (100%)
No errors β all handled correctly.
βΈ DELETE β delete the entry
14
5 (36%)
9 (64%)
0 (0%)
9 handled wrong β click one to jump to its full detail below
"Delete the banana from earlier."
Did not delete (not understood / no removal).
"Remove that Quest bar."
Did not delete (not understood / no removal).
"Delete the oats entry."
Did not delete (not understood / no removal).
"Take off the eggs."
Did not delete (not understood / no removal).
"Remove the raspberries."
Did not delete (not understood / no removal).
"Delete the chicken log."
Did not delete (not understood / no removal).
"Scratch the almond butter."
Did not delete (not understood / no removal).
"Remove the milk entry."
Did not delete (not understood / no removal).
"Take out the wine from last night."
Did not delete (not understood / no removal).
βΈ UPDATE β update the entry
14
5 (36%)
9 (64%)
0 (0%)
9 handled wrong β click one to jump to its full detail below
Pending A1's per-utterance difficulty score (requested 2026-07-05) β this bar chart lights up once that lands.
Clarification follow-ups β scored separately
Second turn: app asked, we replied β did it resolve correctly?
Follow-ups
13
Resolved
0 (0%)
Mishandled
2 (15%)
Unverified
11
"Wrong one. The vanilla, not chocolate."
Did not complete the pending action.
"Not those cashews β the raw ones."
Did not complete the pending action.
Cosmetic only
Not yet classified β pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.
System / infra
Not yet classified β pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.
Latency
Avg (time to ready)
0.9s
p90
2.7s
Max
8.9s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β click any dot to jump to its detail.
0s
1s
2s
5s
10s
9s
Response path β quick (single response) vs async (an ack like "Working on itβ¦" before the real answer).
Quick response
145
Sync clarification
53
Slowest 8 utterances (click to jump to detail):
"Not those cashews β the raw ones."8.9s
"No, the other cheese."6.5s
"Change the pear to a small."5.8s
"I drank a glass of orange juice."5.4s
"Not the medium β the large pear."5.3s
"I had eight ounces 90 percent lean ground beef."5.0s
"Lunch included four ounces roast turkey."4.7s
"I had flatbread pizza."4.5s
Filter β controls the list below
Pass / Fail / Unverified
PASS 113FAIL 56UNVERIFIED 29
Module (intended for)
Food (198)
Utterance sub-type (within module)
198 shown β 113 pass, 56 fail, 29 unverified
Per-utterance detail
PASSshould log the entry"Log one large banana for the sequence." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one large banana for the sequence. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one large banana for the sequence. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 large banana) 121 cal Β· 1.5g P Β· 31.3g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:34:52.276Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one Quest birthday cake protein bar." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Quest Birthday Cake Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Quest Birthday Cake Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Logged Quest Birthday Cake Protein Bar with an estimated macro range.
2 Β· Card shown Logged Quest Birthday Cake Protein Bar β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Quest Birthday Cake Protein Bar Γ1 (one) 136 cal Β· 19.8g P Β· 4.2g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:35:04.222Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had one cup steel cut oats with water only." (difficulty β)1.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said I couldn't find Steel Cut Oat's With Water Only Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find Steel Cut Oat's With Water Only Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:35:17.114Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add three scrambled eggs for lunch." (difficulty β)0.4s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged three scrambled eggs for lunch.
2 Β· Card shown Logged three scrambled eggs for lunch.
3 Β· App data rows written created food_log_entry: Egg Γ1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:35:28.626Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup raspberries as a snack." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Raspberries β card not captured.
Why verdict Logged (write-truth verified): Raspberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup raspberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup raspberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raspberries Γ1 (1 cup) 64 cal Β· 1.5g P Β· 14.6g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:35:40.115Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Raspberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record five ounces baked chicken thigh." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken thigh β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged five ounces baked chicken thigh.
2 Β· Card shown Logged five ounces baked chicken thigh.
3 Β· App data rows written created food_log_entry: Chicken thigh Γ1 (5 oz) 296 cal Β· 36.9g P Β· 0g C Β· 15.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:35:51.480Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Chicken thigh" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons almond butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Almond butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two tablespoons almond butter.
2 Β· Card shown Logged two tablespoons almond butter.
3 Β· App data rows written created food_log_entry: Almond butter Γ1 (2 tbsp) 196 cal Β· 6.7g P Β· 6.1g C Β· 17.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:02.808Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Almond butter" at 90% confidence.
Matched your past food logs to "almond butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I drank one cup whole milk." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Whole milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Whole milk Γ1 (1 cup) 149 cal Β· 7.8g P Β· 11.7g C Β· 8.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:14.202Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Whole milk" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one large banana." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one large banana. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one large banana. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 large banana) 121 cal Β· 1.5g P Β· 31.3g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:25.502Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
Matched your saved foods and aliases to "Banana" at 83% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Breakfast was three scrambled eggs." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three scrambled eggs.
2 Β· Card shown Logged three scrambled eggs.
3 Β· App data rows written created food_log_entry: Egg Γ1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:36.974Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Put down five ounces baked chicken thigh." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken thigh β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged five ounces baked chicken thigh.
2 Β· Card shown Logged five ounces baked chicken thigh.
3 Β· App data rows written created food_log_entry: Chicken thigh Γ1 (5 oz) 296 cal Β· 36.9g P Β· 0g C Β· 15.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:48.329Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "five ounces baked chicken thigh" at 90% confidence.
Matched the common-food list to "Chicken thigh" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked brown rice." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked brown rice β card not captured.
Why verdict Logged (write-truth verified): Cooked brown rice β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cooked brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked brown rice Γ1 (1 cup) 218 cal Β· 4.5g P Β· 45.8g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:36:59.666Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked brown rice" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Snack was a medium pear." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pear β card not captured.
Why verdict Logged (write-truth verified): Pear β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a medium pear. Assumed 1 pear as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a medium pear. Assumed 1 pear as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pear Γ1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:37:10.974Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pear" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate four ounces baked cod." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cod β card not captured.
Why verdict Logged (write-truth verified): Cod β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged four ounces baked cod.
2 Β· Card shown Logged four ounces baked cod.
3 Β· App data rows written created food_log_entry: Cod Γ1 (4 oz) 119 cal Β· 26.1g P Β· 0g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:37:22.326Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cod" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one cup raspberries." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Raspberries β card not captured.
Why verdict Logged (write-truth verified): Raspberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup raspberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup raspberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raspberries Γ1 (1 cup) 64 cal Β· 1.5g P Β· 14.6g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:37:33.679Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Raspberries" at 90% confidence.
Matched your past food logs to "Raspberries" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Count twenty cashews." (difficulty β)0.9s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "cashews": logged 3140 kcal vs expected ~160 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "cashews": logged 3140 kcal vs expected ~160 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Got it, I logged Cashews.
2 Β· Card shown I logged Cashews β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Cashews Γ20 (ounce) 3140 cal Β· 100g P Β· 180g C Β· 240g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:37:45.761Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Lunch included four ounces roast turkey." (difficulty β)4.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.7s
1 Β· TTS said What exact food and amount should I use for four ounces roast turkey? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for four ounces roast turkey? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:38:01.821Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one cup roasted Brussels sprouts." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Brussels sprouts β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup roasted brussels sprouts. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup roasted brussels sprouts. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Brussels sprouts Γ1 (1 cup) 70 cal Β· 5.4g P Β· 14.4g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:38:13.224Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Brussels sprouts" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I drank eight ounces apple juice." (difficulty β)0.4s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Apple Juice, 100% β card not captured.
Why verdict Logged (write-truth verified): Apple Juice, 100% β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Apple Juice, 100% (eight ounces (248 g)).
3 Β· App data rows written created food_log_entry: Apple Juice, 100% Γ1 (eight ounces (248 g)) 119 cal Β· 0.2g P Β· 28g C Β· 0.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:38:24.848Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Note three slices Canadian bacon." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Canadian bacon β card not captured.
Why verdict Logged (write-truth verified): Canadian bacon β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged note three slices canadian bacon.
2 Β· Card shown Logged note three slices canadian bacon.
3 Β· App data rows written created food_log_entry: Canadian bacon Γ1 (3 slices) 101 cal Β· 19.5g P Β· 1.2g C Β· 1.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:38:36.312Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Canadian bacon" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Supper was one cup chickpeas." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked chickpeas β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup chickpeas. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup chickpeas. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked chickpeas Γ1 (1 cup) 269 cal Β· 14.6g P Β· 44.9g C Β· 4.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:38:59.443Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked chickpeas" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Enter one medium grapefruit." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Grapefruit β card not captured.
Why verdict Logged (write-truth verified): Grapefruit β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium grapefruit. Assumed 1 grapefruit as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium grapefruit. Assumed 1 grapefruit as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Grapefruit Γ1 (1 grapefruit) 97 cal Β· 1.8g P Β· 24.6g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:39:10.845Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Grapefruit" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Ate a half cup dried cranberries." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged ate a half cup dried cranberries. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged ate a half cup dried cranberries. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Dried cranberries Γ1 (0.5 cup) 246 cal Β· 0.2g P Β· 66.2g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:39:22.206Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Dried cranberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons almond butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Almond butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two tablespoons almond butter.
2 Β· Card shown Logged two tablespoons almond butter.
3 Β· App data rows written created food_log_entry: Almond butter Γ1 (2 tbsp) 196 cal Β· 6.7g P Β· 6.1g C Β· 17.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:39:33.562Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "two tablespoons almond butter" at 90% confidence.
Matched the common-food list to "Almond butter" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner side was one cup asparagus." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Asparagus β card not captured.
Why verdict Logged (write-truth verified): Asparagus β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup asparagus. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup asparagus. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Asparagus Γ1 (1 cup) 40 cal Β· 4.3g P Β· 7.4g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:39:44.995Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Asparagus" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had two cups watermelon." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Watermelon β card not captured.
Why verdict Logged (write-truth verified): Watermelon β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two cups watermelon.
2 Β· Card shown Logged two cups watermelon.
3 Β· App data rows written created food_log_entry: Watermelon Γ1 (2 cup) 91 cal Β· 1.8g P Β· 23.1g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:39:56.306Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Watermelon" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put in one hundred fifty grams skyr yogurt." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said I found Plain Greek yogurt, but I also heard hundred fifty skyr yogurt. Should I log those separately too?
2 Β· Card shown I found Plain Greek yogurt, but I also heard hundred fifty skyr yogurt. Should I log those separately too?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:40:08.122Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup whole milk." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Whole milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Whole milk Γ1 (1 cup) 149 cal Β· 7.8g P Β· 11.7g C Β· 8.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:40:19.438Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "one cup whole milk" at 90% confidence.
Matched the common-food list to "Whole milk" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Breakfast was three quarters cup ricotta." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three quarters cup ricotta.
2 Β· Card shown Logged three quarters cup ricotta.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ1 (0.75 cup) 273 cal Β· 17.7g P Β· 11.1g C Β· 17.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:40:30.774Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Ricotta cheese" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count two small flour tortillas." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Flour tortilla β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two small flour tortillas.
2 Β· Card shown Logged two small flour tortillas.
3 Β· App data rows written created food_log_entry: Flour tortilla Γ1 (2 small flour tortillas) 149 cal Β· 4.1g P Β· 24g C Β· 3.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:40:42.128Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Flour tortilla" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had eight ounces 90 percent lean ground beef." (difficulty β)5.0s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.0s
1 Β· TTS said Which one did you mean? 1. Lean Ground Beef β BUTCHER'S BRAND, 2. Lean Ground Beef β FRESHLAST PACK, 3. Lean Ground Beef β The Kroger Co., 4. Lean Ground Beef β FPL Food LLC
2 Β· Card shown Which one did you mean? 1. Lean Ground Beef β BUTCHER'S BRAND, 2. Lean Ground Beef β FRESHLAST PACK, 3. Lean Ground Beef β The Kroger Co., 4. Lean Ground Beef β FPL Food LLC
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:40:58.281Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add one cup pinto beans." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pinto beans β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup pinto beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup pinto beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pinto beans Γ1 (1 cup) 245 cal Β· 15.4g P Β· 44.5g C Β· 1.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:41:09.614Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pinto beans" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one whole avocado." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Avocado β card not captured.
Why verdict Logged (write-truth verified): Avocado β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one whole avocado. Assumed 1 avocado as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one whole avocado. Assumed 1 avocado as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Avocado Γ1 (1 avocado) 240 cal Β· 3g P Β· 12.8g C Β· 22g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:41:20.930Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Avocado" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log three whole wheat pancakes." (difficulty β)1.4s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Which one did you mean? 1. Whole Wheat Pancakes β Echo Lake Foods, 2. Whole Wheat Pancakes β 365 EVERYDAY VALUE
2 Β· Card shown Which one did you mean? 1. Whole Wheat Pancakes β Echo Lake Foods, 2. Whole Wheat Pancakes β 365 EVERYDAY VALUE
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:41:33.461Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I ate one plain bagel." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one plain bagel. Assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Assumed 1 plain bagel as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one plain bagel. Assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Assumed 1 plain bagel as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Plain bagel Γ1 (1 plain bagel) 350 cal Β· 14g P Β· 67.2g C Β· 2.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:41:44.800Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain bagel" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Record six ounces scallops." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Got it, I logged Scallops, Baked or Broiled (six ounces (170.1 g)).
2 Β· Card shown I logged Scallops, Baked or Broiled (six ounces (170.1 g)) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Scallops, Baked or Broiled Γ1 (six ounces (170.1 g)) 214 cal Β· 25.5g P Β· 6.8g C Β· 8.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:41:56.684Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Snack was two Babybel cheeses." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Babybel β card not captured.
Why verdict Logged (write-truth verified): Babybel β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two babybel cheeses.
2 Β· Card shown Logged two babybel cheeses.
3 Β· App data rows written created food_log_entry: Babybel Γ1 (2 babybel) 140 cal Β· 10g P Β· 0g C Β· 11g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:42:08.081Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Babybel" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add two teaspoons butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Butter β card not captured.
Why verdict Logged (write-truth verified): Butter β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two teaspoons butter.
2 Β· Card shown Logged two teaspoons butter.
3 Β· App data rows written created food_log_entry: Butter Γ1 (2 tsp) 68 cal Β· 0.1g P Β· 0g C Β· 7.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:42:19.471Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Butter" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one cup farro." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked farro β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup farro. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup farro. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked farro Γ1 (1 cup) 240 cal Β· 8.6g P Β· 50.7g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:42:30.815Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked farro" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log one medium russet potato." (difficulty β)3.5s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.5s
1 Β· TTS said Was the potato plain, or did it have toppings like butter, sour cream, or cheese? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Was the potato plain, or did it have toppings like butter, sour cream, or cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:42:45.568Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track ten ounces green tea." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Green tea β card not captured.
Why verdict Logged (write-truth verified): Green tea β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged ten ounces green tea.
2 Β· Card shown Logged ten ounces green tea.
3 Β· App data rows written created food_log_entry: Green tea Γ1 (10 oz) 3 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:43:08.664Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Green tea" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count one cup cherry tomatoes." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cherry tomatoes β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cherry tomatoes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cherry tomatoes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherry tomatoes Γ1 (1 cup) 27 cal Β· 1.3g P Β· 5.8g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:43:20.016Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cherry tomatoes" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner was six ounces pork tenderloin." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pork tenderloin β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces pork tenderloin.
2 Β· Card shown Logged six ounces pork tenderloin.
3 Β· App data rows written created food_log_entry: Pork tenderloin Γ1 (6 oz) 243 cal Β· 44.2g P Β· 0g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:43:31.312Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pork tenderloin" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had one cup butternut squash soup." (difficulty β)1.4s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Logged The Cheesecake Factory Cup of Butternut Squash Soup with an estimated macro range.
2 Β· Card shown Logged The Cheesecake Factory Cup of Butternut Squash Soup β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: The Cheesecake Factory Cup of Butternut Squash Soup Γ1 (1 cup) 270 cal Β· 3g P Β· 21g C Β· 21g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:43:43.876Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add three rice cakes." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Plain rice cakes β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three rice cakes.
2 Β· Card shown Logged three rice cakes.
3 Β· App data rows written created food_log_entry: Plain rice cakes Γ1 (3 rice cakes) 104 cal Β· 2.2g P Β· 22g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:43:55.194Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain rice cakes" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup blackberries." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Blackberries β card not captured.
Why verdict Logged (write-truth verified): Blackberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup blackberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup blackberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blackberries Γ1 (1 cup) 62 cal Β· 2g P Β· 14.7g C Β· 0.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:44:06.515Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Blackberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons guacamole." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Guacamole β card not captured.
Why verdict Logged (write-truth verified): Guacamole β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Got it, I logged Guacamole.
2 Β· Card shown I logged Guacamole β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Guacamole Γ1 (tablespoon) 50 cal Β· 1g P Β· 3g C Β· 4.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:44:18.520Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate one medium nectarine." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Nectarine β card not captured.
Why verdict Logged (write-truth verified): Nectarine β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium nectarine. Assumed 1 nectarine as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium nectarine. Assumed 1 nectarine as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Nectarine Γ1 (1 nectarine) 62 cal Β· 1.5g P Β· 14.8g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:44:29.812Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Nectarine" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put down one cup couscous." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said I couldn't convert one cup of Couscous, Dry from the serving information I found. What does the label say for grams or calories? I did not log it yet.
2 Β· Card shown I couldn't convert one cup of Couscous, Dry from the serving information I found. What does the label say for grams or calories? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:44:41.763Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Record five ounces chicken sausage." (difficulty β)1.5s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said Which type of chicken sausage was it? There are several with different nutrition.
2 Β· Card shown Which type of chicken sausage was it? There are several with different nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:44:54.446Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual RXBAR." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): RXBAR Blueberry β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged RXBAR RXBAR Blueberry. Using your saved "my usual rxbar". Tell me if that is wrong.
2 Β· Card shown Logged RXBAR RXBAR Blueberry. Using your saved "my usual rxbar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: RXBAR Blueberry Γ1 (bar) 210 cal Β· 12g P Β· 25g C Β· 8g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual rxbar" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had my usual skyr." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Plain Skyr β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Dairy Plain Skyr. Using your saved "my usual skyr". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Plain Skyr. Using your saved "my usual skyr". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Plain Skyr Γ1 (cup) 110 cal Β· 19g P Β· 7g C Β· 0g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual skyr" at 96% confidence.
Matched the common-food list to "Skyr" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Lunch was my usual chicken salad." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken Salad Scoop β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Deli Chicken Salad Scoop. Using your saved "my usual chicken salad". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Deli Chicken Salad Scoop. Using your saved "my usual chicken salad". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Salad Scoop Γ1 (scoop) 280 cal Β· 22g P Β· 6g C Β· 18g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual chicken salad" at 96% confidence.
Matched the common-food list to "Chicken salad with mayonnaise" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner side was my usual quinoa." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked Quinoa β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Quinoa. Using your saved "my usual quinoa". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Quinoa. Using your saved "my usual quinoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Quinoa Γ1 (cup) 222 cal Β· 8g P Β· 39g C Β· 3.6g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual quinoa" at 96% confidence.
Matched the common-food list to "Cooked quinoa" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track my usual cashews." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cashews β card not captured.
Why verdict Logged (write-truth verified): Cashews β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cashews. Using your saved "my usual cashews". Tell me if that is wrong.
2 Β· Card shown Logged Cashews. Using your saved "my usual cashews". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cashews Γ1 (ounce) 157 cal Β· 5g P Β· 9g C Β· 12g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual cashews" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log my default oat milk." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Oat Milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Oat Milk. Using your saved "my default oat milk". Tell me if that is wrong.
2 Β· Card shown Logged Oat Milk. Using your saved "my default oat milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oat Milk Γ1 (cup) 120 cal Β· 3g P Β· 16g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my default oat milk" at 96% confidence.
Matched the common-food list to "Milk" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual evening cocoa." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Hot Cocoa β card not captured.
Why verdict Logged (write-truth verified): Hot Cocoa β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Hot Cocoa. Using your saved "my usual evening cocoa". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Hot Cocoa. Using your saved "my usual evening cocoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Hot Cocoa Γ1 (cup) 140 cal Β· 4g P Β· 24g C Β· 3g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual evening cocoa" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had my normal steel cut oats." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Steel Cut Oats. Using your saved "my normal steel cut oats". Tell me if that is wrong.
2 Β· Card shown Logged Steel Cut Oats. Using your saved "my normal steel cut oats". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Steel Cut Oats Γ1 (cup) 170 cal Β· 7g P Β· 29g C Β· 3g F
{
"type": "food_default",
"phrase": "my normal steel cut oats",
"foodItemId": "seed-d-oats",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "cup",
"displayLabel": "my normal steel cut oats",
"confirmBeforeLog": false
}
}
snapshot captured 2026-08-02T21:46:24.894Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my normal steel cut oats" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track my go-to latte." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Caffe Latte β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cafe Caffe Latte. Using your saved "my go to latte". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cafe Caffe Latte. Using your saved "my go to latte". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Caffe Latte Γ1 (cup) 150 cal Β· 8g P Β· 14g C Β· 6g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my go to latte" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log my usual bedtime tea." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chamomile Tea β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Chamomile Tea. Using your saved "my usual bedtime tea". Tell me if that is wrong.
2 Β· Card shown Logged Chamomile Tea. Using your saved "my usual bedtime tea". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chamomile Tea Γ1 (cup) 0 cal Β· 0g P Β· 0g C Β· 0g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual bedtime tea" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add the same ricotta as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Ricotta cheese. Using your recent Ricotta cheese history. Tell me if that is wrong.
2 Β· Card shown Logged Ricotta cheese. Using your recent Ricotta cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ1 (0.75 cup) 273 cal Β· 17.7g P Β· 11.1g C Β· 17.5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Ricotta cheese" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same granola as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Honey Granola β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Pantry Honey Granola. Using your recent Codex Test Pantry Honey Granola history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Pantry Honey Granola. Using your recent Codex Test Pantry Honey Granola history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Honey Granola Γ1 (cup) 240 cal Β· 6g P Β· 38g C Β· 8g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Granola" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log the same soup I had last night." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said I heard you want the same the same soup I had last night as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
2 Β· Card shown I heard you want the same the same soup I had last night as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same bagel as this morning." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Everything Bagel β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Everything Bagel. Using your recent Everything Bagel history. Tell me if that is wrong.
2 Β· Card shown Logged Everything Bagel. Using your recent Everything Bagel history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Everything Bagel Γ1 (bagel) 280 cal Β· 10g P Β· 54g C Β· 2g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain bagel" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add the same salmon I had earlier." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged salmon. Using your recent salmon history. Tell me if that is wrong.
2 Β· Card shown Logged salmon. Using your recent salmon history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: salmon Γ1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Salmon" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same smoothie as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Green Protein Smoothie β card not captured.
Why verdict Logged (write-truth verified): Green Protein Smoothie β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Recipe Green Protein Smoothie. Using your recent Codex Test Recipe Green Protein Smoothie history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Green Protein Smoothie. Using your recent Codex Test Recipe Green Protein Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Green Protein Smoothie Γ1 (smoothie) 260 cal Β· 24g P Β· 30g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Recipe Green Protein Smoothie
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log the tofu I had last time." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Firm Tofu β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Firm Tofu. Using your saved "Firm Tofu". Tell me if that is wrong.
2 Β· Card shown Logged Firm Tofu. Using your saved "Firm Tofu". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Firm Tofu Γ1 (serving) 140 cal Β· 15g P Β· 3g C Β· 8g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Firm tofu" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same toast as earlier today." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Sourdough Toast β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Sourdough Toast. Using your recent Sourdough Toast history. Tell me if that is wrong.
2 Β· Card shown Logged Sourdough Toast. Using your recent Sourdough Toast history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Sourdough Toast Γ1 (slice) 90 cal Β· 3g P Β· 17g C Β· 1g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Toast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Snack was one chocolate Chip's Ahoy cookie pack mini." (difficulty β)2.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:48:44.781Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Finished one Fairlife Core Power vanilla shake." (difficulty β)1.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Fairlife Core Power Elite Vanilla Protein Shake β card not captured.
Why verdict Logged (write-truth verified): Fairlife Core Power Elite Vanilla Protein Shake β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said Logged Fairlife Core Power Elite Vanilla Protein Shake with an estimated macro range.
2 Β· Card shown Logged Fairlife Core Power Elite Vanilla Protein Shake β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Fairlife Core Power Elite Vanilla Protein Shake Γ1 (one) 230 cal Β· 42g P Β· 8g C Β· 3.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:48:57.215Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one Chobani zero sugar strawberry cup." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chobani Greek Yogurt, Strawberry, Zero Sugar β card not captured.
Why verdict Logged (write-truth verified): Chobani Greek Yogurt, Strawberry, Zero Sugar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Chobani Greek Yogurt, Strawberry, Zero Sugar.
3 Β· App data rows written created food_log_entry: Chobani Greek Yogurt, Strawberry, Zero Sugar Γ1 (one) 60 cal Β· 12g P Β· 5g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:49:08.999Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one Quest cookies and cream protein bar." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cookies & Cream Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Cookies & Cream Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Cookies & Cream Protein Bar β Quest with an estimated macro range.
2 Β· Card shown Logged Cookies & Cream Protein Bar β Quest β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Cookies & Cream Protein Bar Γ1 (1 BAR) 200 cal Β· 21g P Β· 21g C Β· 8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:49:20.685Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate one KIND peanut butter dark chocolate bar." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): KIND Peanut Butter Dark Chocolate Bar β card not captured.
Why verdict Logged (write-truth verified): KIND Peanut Butter Dark Chocolate Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Got it, I logged KIND Peanut Butter Dark Chocolate Bar.
2 Β· Card shown I logged KIND Peanut Butter Dark Chocolate Bar β let me know if that's not right.
3 Β· App data rows written created food_log_entry: KIND Peanut Butter Dark Chocolate Bar Γ1 (1 kind peanut butter dark chocolate bar) 200 cal Β· 7g P Β· 17g C Β· 14g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:49:32.408Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log a medium orange and one RXBAR chocolate sea salt." (difficulty β)1.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said I need to resolve one RXBAR chocolate sea salt before I log this meal. What should I use for one RXBAR chocolate sea salt?
2 Β· Card shown I need to resolve one RXBAR chocolate sea salt before I log this meal. What should I use for one RXBAR chocolate sea salt?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:49:45.207Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had steel cut oats and green tea." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Steel Cut Oats and Green tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Steel Cut Oats and Green tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Steel Cut Oats Γ1 (cup) 170 cal Β· 7g P Β· 29g C Β· 3g F created food_log_entry: Green tea Γ1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:49:56.801Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was scrambled eggs and a bagel." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Egg? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Egg? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:50:08.417Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Plain bagel" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Lunch was a tuna melt and an apple." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
Why verdict WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Tuna melt sandwich and an apple. Assumed 1 apple as the default serving. Tell me if you want a different amount. Tell me if that is not right.
2 Β· Card shown Logged Tuna melt sandwich and an apple. Assumed 1 apple as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Tuna melt sandwich Γ1 (1 tuna melt) 550 cal Β· 30.8g P Β· 44g C Β· 26.4g F created food_log_entry: Apple Γ1 (1 apple) 95 cal Β· 0.5g P Β· 25.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:50:19.945Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was cashews and a pear." (difficulty β)2.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS said I need to resolve cashews before I log this meal. What should I use for cashews?
2 Β· Card shown I need to resolve cashews before I log this meal. What should I use for cashews?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:50:33.313Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was cod and asparagus." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Cod and Asparagus? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Cod and Asparagus? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:50:44.722Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Asparagus" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate skyr and raspberries." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Skyr and Raspberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Skyr and Raspberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:50:56.132Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Raspberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track turkey and quinoa." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Turkey breast and Cooked quinoa? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Turkey breast and Cooked quinoa? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:51:19.327Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked quinoa" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add ricotta and blackberries." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Ricotta cheese and Blackberries? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Ricotta cheese and Blackberries? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:51:30.874Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Blackberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had a Kind bar and water." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Cookies & Cream Protein Bar, Water)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Cookies & Cream Protein Bar, Water)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Logged QUEST Cookies & Cream Protein Bar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged QUEST Cookies & Cream Protein Bar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cookies & Cream Protein Bar Γ1 (1 BAR) 200 cal Β· 21g P Β· 21g C Β· 8g F created food_log_entry: Water Γ1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:51:42.921Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log miso soup and edamame." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Miso soup and Edamame? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Miso soup and Edamame? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:51:54.615Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Miso soup" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was granola, yogurt, and coffee." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Granola, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Granola, Plain Greek yogurt, and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Granola Γ1 (100 g) 471 cal Β· 10g P Β· 64g C Β· 20g F created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Coffee Γ1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:52:06.256Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I ate a pear, string cheese, and pretzels." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Mozzarella string cheese and Pretzels? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Mozzarella string cheese and Pretzels? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:52:17.654Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Dinner was pork, farro, and Brussels sprouts." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Pork, Cooked farro, and Brussels sprouts? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Pork, Cooked farro, and Brussels sprouts? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:52:29.192Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Brussels sprouts" at 90% confidence.
Matched your past food logs to "Brussels sprouts" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was snap peas and hummus." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said How much should I log for Snap peas and Hummus? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Snap peas and Hummus? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:52:40.658Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Snap peas" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a grain bowl and iced tea." (difficulty β)1.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Grain Bowl Γ1 (serving) 313 cal Β· 8.1g P Β· 55.7g C Β· 6.7g F created food_log_entry: Unsweetened iced tea Γ1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:52:53.082Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had rice, lentils, and tofu." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Cooked white rice, Lentils, and Firm tofu? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Cooked white rice, Lentils, and Firm tofu? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:53:04.722Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track skyr, honey, and walnuts." (difficulty β)0.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said How much should I log for Skyr, Honey, and Walnuts? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Skyr, Honey, and Walnuts? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:53:16.463Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Walnuts" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add eggs, Canadian bacon, and grapefruit juice." (difficulty β)0.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said How much should I log for Egg, Canadian bacon, and Grapefruit juice? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Egg, Canadian bacon, and Grapefruit juice? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:53:28.194Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Grapefruit juice" at 90% confidence.
Matched your past food logs to "Canadian bacon" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I ate noodles and a side of spinach." (difficulty β)0.7s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
Why verdict WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Cooked pasta and Spinach. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
2 Β· Card shown Logged Cooked pasta and Spinach. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:53:40.102Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a nectarine and almond butter." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said How much should I log for Almond butter? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Almond butter? I did not log them yet because the amounts were not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:53:51.827Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Almond butter" at 90% confidence.
Matched your past food logs to "Almond butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Breakfast was cereal and oat milk." (difficulty β)1.2s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said I need to resolve cereal before I log this meal. What should I use for cereal?
2 Β· Card shown I need to resolve cereal before I log this meal. What should I use for cereal?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:54:04.293Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had a frittata with four eggs, spinach, and feta" (difficulty β)2.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg, Frittata, Spinach, Feta cheese β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Logged Frittata. Includes four eggs, spinach, and Feta cheese.
2 Β· Card shown Logged Frittata. Includes four eggs, spinach, and Feta cheese.
3 Β· App data rows written created food_log_entry: Frittata Γ1 (serving) 557 cal Β· 40.3g P Β· 6.6g C Β· 40.4g F created food_log_entry: Egg Γ1 (4 eggs) 286 cal Β· 25.2g P Β· 1.4g C Β· 19g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Feta cheese Γ1 (100 g) 264 cal Β· 14.2g P Β· 4.1g C Β· 21.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:54:17.952Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Log a smoothie with spinach, banana, and whey protein." (difficulty β)1.2s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said Logged Smoothie. Includes spinach, one banana, and Whey protein powder.
2 Β· Card shown Logged Smoothie. Includes spinach, one banana, and Whey protein powder.
3 Β· App data rows written created food_log_entry: Smoothie Γ1 (serving) 222 cal Β· 27.1g P Β· 29.2g C Β· 1g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: Whey protein powder Γ1 (30 g) 110 cal Β· 24.9g P Β· 1g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:54:30.308Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had a grain bowl with quinoa, chickpeas, and tahini." (difficulty β)3.6s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS said Logging your grain bowl with quinoa, chickpeas, and tahini β still looking up the nutrition details; they'll appear in your log shortly.
2 Β· Card shown Logging your grain bowl with quinoa, chickpeas, and tahini β still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: a grain bowl with quinoa, chickpeas, and tahini (pending)
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:54:52.056Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Breakfast was avocado toast with egg and chili flakes." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said What exact ingredient should I use for chili flakes?
2 Β· Card shown What exact ingredient should I use for chili flakes?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:43.828Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Toast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I made stir fry with tofu, peppers, broccoli, and oil." (difficulty β)1.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said What should I use for tofu?
2 Β· Card shown What should I use for tofu?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:56:55.891Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was a poke bowl with rice, tuna, avocado, and seaweed." (difficulty β)1.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said What should I use for tuna?
2 Β· Card shown What should I use for tuna?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:20.391Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had pho with beef and basil." (difficulty β)2.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pho, Basil, Raw, Beef β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said Logged Pho. Includes Beef and Basil, Raw.
2 Β· Card shown Logged Pho. Includes Beef and Basil, Raw.
3 Β· App data rows written created food_log_entry: Pho Γ1 (serving) 219 cal Β· 22.9g P Β· 0.6g C Β· 12.9g F created food_log_entry: Beef Γ1 (85 g) 213 cal Β· 22.1g P Β· 0g C Β· 12.8g F created food_log_entry: Basil, Raw Γ1 (1 cup) 6 cal Β· 0.8g P Β· 0.6g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:33.842Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log a chicken wrap with hummus and cucumber." (difficulty β)2.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cucumber, Chicken Wrap, Hummus, Plain β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Logged Chicken Wrap. Includes Hummus, Plain and Cucumber.
2 Β· Card shown Logged Chicken Wrap. Includes Hummus, Plain and Cucumber.
3 Β· App data rows written created food_log_entry: Chicken Wrap Γ1 (serving) 51 cal Β· 1.8g P Β· 5.8g C Β· 2.7g F created food_log_entry: Hummus, Plain Γ1 (1 tablespoon) 36 cal Β· 1.1g P Β· 2.2g C Β· 2.6g F created food_log_entry: Cucumber Γ1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:57:47.533Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I built an acai bowl with granola, banana, and coconut." (difficulty β)3.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said Which coconut should I use?
2 Β· Card shown Which coconut should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:02.589Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was butter chicken with rice, naan, and cucumber salad." (difficulty β)0.9s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What exact ingredient should I use for butter chicken with rice naan?
2 Β· Card shown What exact ingredient should I use for butter chicken with rice naan?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:14.600Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "cucumber" at 90% confidence.
Matched the common-food list to "Butter" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add some porridge." (difficulty β)1.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said How much some porridge did you have?
2 Β· Card shown How much some porridge did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:26.781Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had muesli." (difficulty β)0.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Did you have milk, yogurt, fruit, or honey with the cereal or granola? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Did you have milk, yogurt, fruit, or honey with the cereal or granola? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:39.438Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log couscous for dinner." (difficulty β)1.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said How much couscous did you have?
2 Β· Card shown How much couscous did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:58:52.215Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track noodles." (difficulty β)2.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS said How much noodles did you have?
2 Β· Card shown How much noodles did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:05.737Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate pretzels." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Pretzels? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pretzels? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:16.941Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pretzels" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add walnuts." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Walnuts? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Walnuts? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:28.416Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Walnuts" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of chili." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a bowl of chili? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bowl of chili? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:42.812Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of risotto." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a plate of risotto? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a plate of risotto? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T21:59:56.632Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track lemonade." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said What exact food and amount should I use for lemonade? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for lemonade? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:08.304Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add tea." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much tea did you have?
2 Β· Card shown How much tea did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:20.003Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I drank beer." (difficulty β)0.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What exact food and amount should I use for beer? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for beer? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:32.039Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log gelato." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said What food did you log? Could you be more specific?
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:43.327Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Had some mixed nuts." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Mixed nuts? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Mixed nuts? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:00:54.985Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Mixed nuts" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add kettle corn." (difficulty β)4.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.3s
1 Β· TTS said How much kettle corn did you have?
2 Β· Card shown How much kettle corn did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:11.435Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had an energy bar." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar, Generic protein bar)
Why verdict WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar, Generic protein bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged an energy bar. Assumed 1 energy bar as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged an energy bar. Assumed 1 energy bar as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Generic protein bar Γ1 (1 energy bar) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Generic protein bar Γ1 (1 energy bar) 200 cal Β· 20g P Β· 22g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:22.752Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Generic protein bar" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a dairy cup." (difficulty β)0.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:01:46.428Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track a milk alternative." (difficulty β)3.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.5s
1 Β· TTS said Which one did you mean? 1. Low Fat Milk Alternative β AUGASON FARMS (17 g), 2. Low Fat Milk Alternative β AUGASON FARMS (35 g)
2 Β· Card shown Which one did you mean? 1. Low Fat Milk Alternative β AUGASON FARMS (17 g), 2. Low Fat Milk Alternative β AUGASON FARMS (35 g)
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:01.140Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I ate a deli sandwich." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Logged tuna melt sandwich with an estimated macro range.
2 Β· Card shown Logged tuna melt sandwich β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Tuna melt sandwich Γ1 (1 tuna melt) 550 cal Β· 30.8g P Β· 44g C Β· 26.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:13.696Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a protein shake." (difficulty β)3.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said I couldn't find Add A Protein Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
2 Β· Card shown I couldn't find Add A Protein Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:28.764Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a latte." (difficulty β)0.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Got it, I logged latte.
2 Β· Card shown I logged latte β let me know if that's not right.
3 Β· App data rows written created food_log_entry: latte Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:40.814Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a roll." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Got it, I logged Roll, White, Hot Dog Bun (1 roll (1 hot dog bun)).
2 Β· Card shown I logged Roll, White, Hot Dog Bun (1 roll (1 hot dog bun)) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Roll, White, Hot Dog Bun Γ1 (1 roll (1 hot dog bun)) 120 cal Β· 4.2g P Β· 22.1g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:02:52.381Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track a veggie burger." (difficulty β)3.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said What exact food and amount should I use for a veggie burger? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a veggie burger? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:06.995Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had flatbread pizza." (difficulty β)4.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said How much flatbread pizza did you have?
2 Β· Card shown How much flatbread pizza did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:22.185Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Add a scone." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Scone, with Fruit.
2 Β· Card shown Logged Scone, with Fruit.
3 Β· App data rows written created food_log_entry: Scone, with Fruit Γ1 (1 regular) 262 cal Β· 4.4g P Β· 35.8g C Β· 11.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:03:33.714Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual latte size." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged latte. Using your saved "log my usual latte size". Tell me if that is wrong.
2 Β· Card shown Logged latte. Using your saved "log my usual latte size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: latte Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "log my usual latte size" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add the regular dinner portion." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
2 Β· Card shown Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: dinner portion Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "add the regular dinner portion" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track my default afternoon snack." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
2 Β· Card shown Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "track my default afternoon snack" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had the usual breakfast size." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
2 Β· Card shown Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
{
"type": "food_default",
"phrase": "i had the usual breakfast size",
"foodItemId": "seed-d-bfast-size",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "serving",
"displayLabel": "i had the usual breakfast size",
"confirmBeforeLog": false
}
}
snapshot captured 2026-08-02T22:04:19.020Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "i had the usual breakfast size" at 96% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Three quarters of a cup." (difficulty β)2.4s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:32.644Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One and a half cups, plain." (difficulty β)1.4s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
2 Β· Card shown I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:45.218Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"The RXBAR blueberry." (difficulty β)1.0s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said How much The RXBAR blueberry did you have?
2 Β· Card shown How much The RXBAR blueberry did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:04:57.352Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Oat milk." (difficulty β)4.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.1s
1 Β· TTS said How much Oat milk did you have?
2 Β· Card shown How much Oat milk did you have?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:12.671Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not it β the unsweetened one." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about breakfast?
2 Β· Card shown What should I change about breakfast?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:23.892Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"Wrong one. The vanilla, not chocolate." (difficulty β)2.7s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said I didn't log any latte. Please use the exact app command to log your drink, like "Log a vanilla latte."
2 Β· Card shown I didn't log any latte. Please use the exact app command to log your drink, like "Log a vanilla latte."
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:37.763Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, not the flavored skyr." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about breakfast?
2 Β· Card shown What should I change about breakfast?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:05:49.034Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Skyr" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould decline"Cancel that entry." (difficulty β)0.1s
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said Understood. Your last entry has been cleared.
2 Β· Card shown Understood. Your last entry has been cleared.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not the bar I meant." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What should I change about breakfast?
2 Β· Card shown What should I change about breakfast?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:36.783Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not the medium β the large pear." (difficulty β)5.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS said What exact food and amount should I use for Pear? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Pear? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:06:53.281Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong item. Pick the baked cod." (difficulty β)3.7s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS said What exact food and amount should I use for Cod? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Cod? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:07:08.159Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"That's not it; the plain one." (difficulty β)2.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said What would you like me to do with that?
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:07:33.321Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, the other cheese." (difficulty β)6.5s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 6.5s
1 Β· TTS said Which exact other cheese should replace breakfast?
2 Β· Card shown Which exact other cheese should replace breakfast?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:07:50.964Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"Not those cashews β the raw ones." (difficulty β)8.9s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.9s
1 Β· TTS said Got it β raw cashews, not the others. To log them, say exactly: "Log raw cashews" followed by the amount.
2 Β· Card shown Got it β raw cashews, not the others. To log them, say exactly: "Log raw cashews" followed by the amount.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:08:22.197Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "cashews" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the banana from earlier." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not find a list matching earlier. Which list has banana?
2 Β· Card shown I could not find a list matching earlier. Which list has banana?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:08:44.594Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
Matched your saved foods and aliases to "one banana" at 64% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove that Quest bar." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:08:55.800Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "QUEST Cookies & Cream Protein Bar" at 77% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the oats entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:07.217Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Dry oats" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:18.464Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the raspberries." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:29.661Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Raspberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the chicken log." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:40.886Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Scratch the almond butter." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:09:52.132Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Almond butter" at 90% confidence.
Matched your past food logs to "Almond butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the milk entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:10:03.349Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Milk" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete that brownie I logged last night." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted brownie.
2 Β· Card shown Deleted brownie.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Remove yesterday's gelato." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted gelato.
2 Β· Card shown Deleted gelato.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the leftover burrito entry." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted burrito.
2 Β· Card shown Deleted burrito.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take out the wine from last night." (difficulty β)3.4s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.4s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Remove the pastry log from earlier this week." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted pastry.
2 Β· Card shown Deleted pastry.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the chips I shouldn't have logged." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Deleted chips.
2 Β· Card shown Deleted chips.
3 Β· App data rows written deleted food_log_entry:
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Potato chips" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the sequence banana quantity to two." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:37.487Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
Matched your saved foods and aliases to "one banana" at 61% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually make the Quest bar two bars." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:11:48.707Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your past food logs to "QUEST Cookies & Cream Protein Bar" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update the oats to one and a half cups." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:00.229Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Dry oats" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the eggs to four." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:11.244Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make the raspberries a half cup." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:22.446Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Raspberries" at 90% confidence.
Matched your past food logs to "Raspberries" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Update the chicken to seven ounces." (difficulty β)0.3s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated Chicken Wrap to 7 oz.
2 Β· Card shown Updated Chicken Wrap to 7 oz.
3 Β· App data rows written updated food_log_entry: Chicken Wrap Γ13.229766666666666 (1 tablespoon) 476 cal Β· 14.6g P Β· 29.1g C Β· 34.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:33.977Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change almond butter to one tablespoon." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:45.232Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Almond butter" at 90% confidence.
Matched your past food logs to "Almond butter" at 82% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually the milk was two percent, not whole." (difficulty β)3.1s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS said Updated to two percent milk.
2 Β· Card shown Updated the food entry from "Oat Milk" to "two percent milk".
3 Β· App data rows written updated food_log_entry: Milk Γ2 (100 g) 100 cal Β· 6.6g P Β· 9.6g C Β· 4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:12:59.517Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually that was strawberry, not vanilla." (difficulty β)0.3s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Updated to strawberry.
2 Β· Card shown Updated the food entry from "breakfast" to "strawberry".
3 Β· App data rows written updated food_log_entry: Chobani Greek Yogurt, Strawberry, Zero Sugar Γ1 (one) 60 cal Β· 12g P Β· 5g C Β· 0g F
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Strawberries" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the portion to one and a half cups." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make it a quarter cup instead." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update that to eight ounces." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually it was cashew butter, not almond butter." (difficulty β)2.5s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said Updated to cashew butter.
2 Β· Card shown Updated the food entry from "Chobani Greek Yogurt, Strawberry, Zero Sugar" to "cashew butter".
3 Β· App data rows written updated food_log_entry: Cashew Butter Γ1 (1 tablespoon) 97 cal Β· 1.9g P Β· 4.8g C Β· 8.5g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Change the pear to a small." (difficulty β)5.8s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS said Updated Pear to 1 small.
2 Β· Card shown Updated Pear to 1 small.
3 Β· App data rows written updated food_log_entry: Pear Γ1 (178 g) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein is left for today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You are about 898.1 grams of protein over today's 160 gram protein target (1058.1 logged).
2 Β· Card shown You are about 898.1 grams of protein over today's 160 gram protein target (1058.1 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:26.851Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories have I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I do not see calories in today's food log.
2 Β· Card shown I do not see calories in today's food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:14:49.864Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat last night?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I do not see any food logged yesterday.
2 Β· Card shown I do not see any food logged yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:01.284Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much fiber today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:12.212Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's left in my calorie budget?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You are about 16492 calories over today's 2200 calorie budget (18692 logged).
2 Β· Card shown You are about 16492 calories over today's 2200 calorie budget (18692 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:23.460Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log lunch yet?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I do not see lunch logged today.
2 Β· Card shown I do not see lunch logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:34.614Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs so far?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:45.798Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat before the gym?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said No β I do not see before the gym logged today.
2 Β· Card shown No β I do not see before the gym logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:15:56.994Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Show me yesterday's food log." (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food History.
2 Β· Card shown Opening Food History.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:08.285Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Am I under my fat goal?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:19.516Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories in the pear I just logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Pear has about 101 calories per 178 g.
2 Β· Card shown Pear has about 101 calories per 178 g.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:30.923Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Pear" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What was my first meal today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Your first food entry today was 1 1 large banana Banana.
2 Β· Card shown Your first food entry today was 1 1 large banana Banana.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:42.424Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much coffee have I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Today you logged 1 100 g Coffee (1 calories).
2 Β· Card shown Today you logged 1 100 g Coffee (1 calories).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:16:53.817Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "coffee" at 90% confidence.
Matched the common-food list to "Coffee" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Calories left for a snack?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You are about 16492 calories over today's 2200 calorie budget (18692 logged).
2 Β· Card shown You are about 16492 calories over today's 2200 calorie budget (18692 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:05.047Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I already log my usual RXBAR?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Yes. Today you logged 1 bar RXBAR RXBAR Blueberry.
2 Β· Card shown Yes. Today you logged 1 bar RXBAR RXBAR Blueberry.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:16.466Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched your saved foods and aliases to "my usual rxbar" at 96% confidence.
Matched your saved foods and aliases to "RXBAR Blueberry" at 80% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's my average calories this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:27.751Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.3 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many food entries today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have 89 food entries logged today.
2 Β· Card shown You have 89 food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:39.035Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I have mid-afternoon?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I do not see any food logged mid-afternoon today.
2 Β· Card shown I do not see any food logged mid-afternoon today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:17:50.322Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Show the food diary screen." (difficulty β)0.1s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food.
2 Β· Card shown Opening Food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:01.553Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected NAVIGATE β should navigate. FAIL: Did not navigate β misrouted into a food/workout clarification or dead-ended.
Why verdict Did not navigate β misrouted into a food/workout clarification or dead-ended.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said What would you like me to do with that?
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:12.915Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould apply the setting"Set my protein goal to one hundred sixty grams." (difficulty β)0.1s
Verdict Expected SETTINGS β should apply the setting. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
2 Β· Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:24.277Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 2.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I drank a glass of orange juice." (difficulty β)5.4s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said What exact food and amount should I use for Orange juice? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Orange juice? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T22:18:52.480Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)