"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β needs a human look (that's you π/π-ing it). "Pass rate" = pass Γ· (pass + fail) β it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 29 unclassified β the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.
Why the fails happened β comprehension vs execution vs cosmetic
Comprehension β picked the wrong action/target (the hard problem)
59 (100%)
resolution β 57 (97% of comprehension)
"I had one cup steel cut oats with water only." β Over-asked: asked instead of logging (no saved row).
"Count twenty cashews." β Over-asked: asked instead of logging (no saved row).
"Lunch included four ounces roast turkey." β Over-asked: asked instead of logging (no saved row).
"I drank eight ounces apple juice." β Over-asked: asked instead of logging (no saved row).
"Ate a half cup dried cranberries." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
"Put in one hundred fifty grams skyr yogurt." β Over-asked: asked instead of logging (no saved row).
+ 51 more
context β 1 (2% of comprehension)
"Wrong one. The vanilla, not chocolate." β Did not complete the pending action (lost the follow-up context).
routing β 1 (2% of comprehension)
"Open macro goals." β Did not navigate where asked.
Of 59 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.
Handled correctly? β by expected action
Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed to
N
Correct
Wrong
Unverified
βΈ LOG β log the entry
80
51 (64%)
29 (36%)
0 (0%)
29 handled wrong β click one to jump to its full detail below
"I had one cup steel cut oats with water only."
OVER-ASK β asked instead of logging (no saved row).
"Count twenty cashews."
OVER-ASK β asked instead of logging (no saved row).
"Lunch included four ounces roast turkey."
OVER-ASK β asked instead of logging (no saved row).
"I drank eight ounces apple juice."
OVER-ASK β asked instead of logging (no saved row).
"Ate a half cup dried cranberries."
WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
"Put in one hundred fifty grams skyr yogurt."
OVER-ASK β asked instead of logging (no saved row).
"Breakfast was three quarters cup ricotta."
WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
"I had eight ounces 90 percent lean ground beef."
OVER-ASK β asked instead of logging (no saved row).
"Log three whole wheat pancakes."
OVER-ASK β asked instead of logging (no saved row).
"I ate one plain bagel."
WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
"Record six ounces scallops."
WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
"Log one medium russet potato."
OVER-ASK β asked instead of logging (no saved row).
"I had one cup butternut squash soup."
WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
"Track two tablespoons guacamole."
OVER-ASK β asked instead of logging (no saved row).
"Put down one cup couscous."
OVER-ASK β asked instead of logging (no saved row).
"Record five ounces chicken sausage."
OVER-ASK β asked instead of logging (no saved row).
"Add the same ricotta as yesterday."
WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
"Same granola as yesterday."
WRITE-TRUTH FAIL β MACROS off for "Honey Granola": logged 120 kcal vs expected ~240 (Β§14 15pct/25cal band)
"Log the same soup I had last night."
OVER-ASK β asked instead of logging (no saved row).
"Add the same salmon I had earlier."
WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
"Same toast as earlier today."
WRITE-TRUTH FAIL β MACROS off for "Sourdough Toast": logged 180 kcal vs expected ~90 (Β§14 15pct/25cal band)
"Snack was one chocolate Chip's Ahoy cookie pack mini."
OVER-ASK β asked instead of logging (no saved row).
"Finished one Fairlife Core Power vanilla shake."
OVER-ASK β asked instead of logging (no saved row).
"Track one Chobani zero sugar strawberry cup."
OVER-ASK β asked instead of logging (no saved row).
"Log a medium orange and one RXBAR chocolate sea salt."
OVER-ASK β asked instead of logging (no saved row).
"I had a Kind bar and water."
WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Water, Cookies & Cream Protein Bar)
"Breakfast was avocado toast with egg and chili flakes."
OVER-ASK β asked instead of logging (no saved row).
"Dinner was a poke bowl with rice, tuna, avocado, and seaweed."
OVER-ASK β asked instead of logging (no saved row).
"Dinner was butter chicken with rice, naan, and cucumber salad."
OVER-ASK β asked instead of logging (no saved row).
βΈ CLARIFY β ask a clarifying question
53
46 (87%)
7 (13%)
0 (0%)
7 handled wrong β click one to jump to its full detail below
"Lunch was a tuna melt and an apple."
WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
"I ate noodles and a side of spinach."
WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
"Log a smoothie with spinach, banana, and whey protein."
Logged a BLIND guess β no stated assumption, no correction invited.
"I had a grain bowl with quinoa, chickpeas, and tahini."
Logged a BLIND guess β no stated assumption, no correction invited.
"I built an acai bowl with granola, banana, and coconut."
Logged a BLIND guess β no stated assumption, no correction invited.
"Log gelato."
Logged a BLIND guess β no stated assumption, no correction invited.
"I had an energy bar."
WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar)
βΈ QUERY β answer the query
18
0 (0%)
0 (0%)
18 (100%)
No errors β all handled correctly.
βΈ DELETE β delete the entry
14
4 (29%)
10 (71%)
0 (0%)
10 handled wrong β click one to jump to its full detail below
"Delete the banana from earlier."
Did not delete (not understood / no removal).
"Remove that Quest bar."
Did not delete (not understood / no removal).
"Delete the oats entry."
Did not delete (not understood / no removal).
"Take off the eggs."
Did not delete (not understood / no removal).
"Remove the raspberries."
Did not delete (not understood / no removal).
"Delete the chicken log."
Did not delete (not understood / no removal).
"Scratch the almond butter."
Did not delete (not understood / no removal).
"Remove the milk entry."
Did not delete (not understood / no removal).
"Remove yesterday's gelato."
Did not delete (not understood / no removal).
"Take out the wine from last night."
Did not delete (not understood / no removal).
βΈ UPDATE β update the entry
14
4 (29%)
10 (71%)
0 (0%)
10 handled wrong β click one to jump to its full detail below
Not yet classified β pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.
System / infra
Not yet classified β pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.
Latency
Avg (time to ready)
0.9s
p90
2.7s
Max
7.1s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β click any dot to jump to its detail.
0s
1s
2s
5s
8s
Response path β quick (single response) vs async (an ack like "Working on itβ¦" before the real answer).
Quick response
144
Sync clarification
53
Slowest 8 utterances (click to jump to detail):
"No, the other cheese."7.1s
"Change the pear to a small."5.8s
"Not the medium β the large pear."5.3s
"Log one medium russet potato."5.3s
"Track a milk alternative."5.3s
"I had eight ounces 90 percent lean ground beef."4.9s
"Lunch included four ounces roast turkey."4.6s
"I had flatbread pizza."4.5s
Filter β controls the list below
Pass / Fail / Unverified
PASS 109FAIL 59UNVERIFIED 29
Module (intended for)
Food (197)
Utterance sub-type (within module)
197 shown β 109 pass, 59 fail, 29 unverified
Per-utterance detail
PASSshould log the entry"Log one large banana for the sequence." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one large banana for the sequence. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 large banana) 121 cal Β· 1.5g P Β· 31.3g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:10:43.094Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one Quest birthday cake protein bar." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Quest Birthday Cake Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Quest Birthday Cake Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Quest Birthday Cake Protein Bar β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Quest Birthday Cake Protein Bar Γ1 (one) 136 cal Β· 19.8g P Β· 4.2g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:10:54.728Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had one cup steel cut oats with water only." (difficulty β)2.0s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. my normal steel cut oats, 2. Steel Cut Oats (1 cup)
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:11:07.912Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add three scrambled eggs for lunch." (difficulty β)0.4s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three scrambled eggs for lunch.
3 Β· App data rows written created food_log_entry: Egg Γ1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:11:19.396Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup raspberries as a snack." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Raspberries β card not captured.
Why verdict Logged (write-truth verified): Raspberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup raspberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raspberries Γ1 (1 cup) 64 cal Β· 1.5g P Β· 14.6g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:11:30.829Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record five ounces baked chicken thigh." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken thigh β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged five ounces baked chicken thigh.
3 Β· App data rows written created food_log_entry: Chicken thigh Γ1 (5 oz) 296 cal Β· 36.9g P Β· 0g C Β· 15.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:11:42.112Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons almond butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Almond butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two tablespoons almond butter.
3 Β· App data rows written created food_log_entry: Almond butter Γ1 (2 tbsp) 196 cal Β· 6.7g P Β· 6.1g C Β· 17.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:11:53.428Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I drank one cup whole milk." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Whole milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Whole milk Γ1 (1 cup) 149 cal Β· 7.8g P Β· 11.7g C Β· 8.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:12:04.712Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one large banana." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one large banana. Assumed 1 large banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 large banana) 121 cal Β· 1.5g P Β· 31.3g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:12:16.794Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Breakfast was three scrambled eggs." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three scrambled eggs.
3 Β· App data rows written created food_log_entry: Egg Γ1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:12:28.096Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Put down five ounces baked chicken thigh." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Chicken thigh β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged five ounces baked chicken thigh.
3 Β· App data rows written created food_log_entry: Chicken thigh Γ1 (5 oz) 296 cal Β· 36.9g P Β· 0g C Β· 15.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:12:39.396Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked brown rice." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked brown rice β card not captured.
Why verdict Logged (write-truth verified): Cooked brown rice β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup cooked brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked brown rice Γ1 (1 cup) 218 cal Β· 4.5g P Β· 45.8g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:12:50.695Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Snack was a medium pear." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pear β card not captured.
Why verdict Logged (write-truth verified): Pear β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a medium pear. Assumed 1 pear as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pear Γ1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:13:01.980Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate four ounces baked cod." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cod β card not captured.
Why verdict Logged (write-truth verified): Cod β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged four ounces baked cod.
3 Β· App data rows written created food_log_entry: Cod Γ1 (4 oz) 119 cal Β· 26.1g P Β· 0g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:13:13.245Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one cup raspberries." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Raspberries β card not captured.
Why verdict Logged (write-truth verified): Raspberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup raspberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raspberries Γ1 (1 cup) 64 cal Β· 1.5g P Β· 14.6g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:13:24.579Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Count twenty cashews." (difficulty β)1.4s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:13:37.130Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Lunch included four ounces roast turkey." (difficulty β)4.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.6s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Turkey breast? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:13:52.863Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one cup roasted Brussels sprouts." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Brussels sprouts β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup roasted brussels sprouts. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Brussels sprouts Γ1 (1 cup) 70 cal Β· 5.4g P Β· 14.4g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:14:04.247Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I drank eight ounces apple juice." (difficulty β)2.0s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:14:17.346Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Note three slices Canadian bacon." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Canadian bacon β card not captured.
Why verdict Logged (write-truth verified): Canadian bacon β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged note three slices canadian bacon.
3 Β· App data rows written created food_log_entry: Canadian bacon Γ1 (3 slices) 101 cal Β· 19.5g P Β· 1.2g C Β· 1.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:14:28.780Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Supper was one cup chickpeas." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked chickpeas β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup chickpeas. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked chickpeas Γ1 (1 cup) 269 cal Β· 14.6g P Β· 44.9g C Β· 4.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:14:51.663Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Enter one medium grapefruit." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Grapefruit β card not captured.
Why verdict Logged (write-truth verified): Grapefruit β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one medium grapefruit. Assumed 1 grapefruit as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Grapefruit Γ1 (1 grapefruit) 97 cal Β· 1.8g P Β· 24.6g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:02.963Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Ate a half cup dried cranberries." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "dried cranberries": logged 246 kcal vs expected ~185 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged ate a half cup dried cranberries. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Dried cranberries Γ1 (0.5 cup) 246 cal Β· 0.2g P Β· 66.2g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:14.429Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track two tablespoons almond butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Almond butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two tablespoons almond butter.
3 Β· App data rows written created food_log_entry: Almond butter Γ1 (2 tbsp) 196 cal Β· 6.7g P Β· 6.1g C Β· 17.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:25.730Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner side was one cup asparagus." (difficulty β)0.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Asparagus β card not captured.
Why verdict Logged (write-truth verified): Asparagus β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup asparagus. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Asparagus Γ1 (1 cup) 40 cal Β· 4.3g P Β· 7.4g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:37.165Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had two cups watermelon." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Watermelon β card not captured.
Why verdict Logged (write-truth verified): Watermelon β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two cups watermelon.
3 Β· App data rows written created food_log_entry: Watermelon Γ1 (2 cup) 91 cal Β· 1.8g P Β· 23.1g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:48.448Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put in one hundred fifty grams skyr yogurt." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown I found Plain Greek yogurt, but I also heard hundred fifty skyr yogurt. Should I log those separately too?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:15:59.830Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup whole milk." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Whole milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup whole milk. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Whole milk Γ1 (1 cup) 149 cal Β· 7.8g P Β· 11.7g C Β· 8.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:16:11.131Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Breakfast was three quarters cup ricotta." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "ricotta": logged 273 kcal vs expected ~180 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three quarters cup ricotta.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ1 (0.75 cup) 273 cal Β· 17.7g P Β· 11.1g C Β· 17.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:16:22.415Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count two small flour tortillas." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Flour tortilla β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two small flour tortillas.
3 Β· App data rows written created food_log_entry: Flour tortilla Γ1 (2 small flour tortillas) 149 cal Β· 4.1g P Β· 24g C Β· 3.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:16:33.731Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had eight ounces 90 percent lean ground beef." (difficulty β)4.9s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.9s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Lean Ground Beef β BUTCHER'S BRAND, 2. Lean Ground Beef β FRESHLAST PACK, 3. Lean Ground Beef β The Kroger Co., 4. Lean Ground Beef β FPL Food LLC
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:16:49.764Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add one cup pinto beans." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pinto beans β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup pinto beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pinto beans Γ1 (1 cup) 245 cal Β· 15.4g P Β· 44.5g C Β· 1.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:17:01.081Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track one whole avocado." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Avocado β card not captured.
Why verdict Logged (write-truth verified): Avocado β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one whole avocado. Assumed 1 avocado as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Avocado Γ1 (1 avocado) 240 cal Β· 3g P Β· 12.8g C Β· 22g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:17:12.365Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log three whole wheat pancakes." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Did you have syrup, butter, or another topping with it? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:17:26.380Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I ate one plain bagel." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "plain bagel": logged 350 kcal vs expected ~270 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one plain bagel. Assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Assumed 1 plain bagel as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Plain bagel Γ1 (1 plain bagel) 350 cal Β· 14g P Β· 67.2g C Β· 2.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:17:37.648Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Record six ounces scallops." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "scallops": logged 214 kcal vs expected ~150 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged Scallops, Baked or Broiled (six ounces (170.1 g)) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Scallops, Baked or Broiled Γ1 (six ounces (170.1 g)) 214 cal Β· 25.5g P Β· 6.8g C Β· 8.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:17:49.429Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Snack was two Babybel cheeses." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Babybel β card not captured.
Why verdict Logged (write-truth verified): Babybel β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two babybel cheeses.
3 Β· App data rows written created food_log_entry: Babybel Γ1 (2 babybel) 140 cal Β· 10g P Β· 0g C Β· 11g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:18:00.713Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add two teaspoons butter." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Butter β card not captured.
Why verdict Logged (write-truth verified): Butter β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two teaspoons butter.
3 Β· App data rows written created food_log_entry: Butter Γ1 (2 tsp) 68 cal Β· 0.1g P Β· 0g C Β· 7.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:18:11.981Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had one cup farro." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cooked farro β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup farro. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked farro Γ1 (1 cup) 240 cal Β· 8.6g P Β· 50.7g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:18:23.281Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log one medium russet potato." (difficulty β)5.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Was the potato plain, or did it have toppings like butter, sour cream, or cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:18:39.765Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track ten ounces green tea." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Green tea β card not captured.
Why verdict Logged (write-truth verified): Green tea β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged ten ounces green tea.
3 Β· App data rows written created food_log_entry: Green tea Γ1 (10 oz) 3 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:19:02.499Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Count one cup cherry tomatoes." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cherry tomatoes β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup cherry tomatoes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cherry tomatoes Γ1 (1 cup) 27 cal Β· 1.3g P Β· 5.8g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:19:13.799Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Dinner was six ounces pork tenderloin." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pork tenderloin β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged six ounces pork tenderloin.
3 Β· App data rows written created food_log_entry: Pork tenderloin Γ1 (6 oz) 243 cal Β· 44.2g P Β· 0g C Β· 6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:19:25.065Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had one cup butternut squash soup." (difficulty β)1.4s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "butternut squash soup": logged 270 kcal vs expected ~110 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged The Cheesecake Factory Cup of Butternut Squash Soup β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: The Cheesecake Factory Cup of Butternut Squash Soup Γ1 (1 cup) 270 cal Β· 3g P Β· 21g C Β· 21g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:19:37.547Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add three rice cakes." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Plain rice cakes β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three rice cakes.
3 Β· App data rows written created food_log_entry: Plain rice cakes Γ1 (3 rice cakes) 104 cal Β· 2.2g P Β· 22g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:19:48.898Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log one cup blackberries." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Blackberries β card not captured.
Why verdict Logged (write-truth verified): Blackberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup blackberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blackberries Γ1 (1 cup) 62 cal Β· 2g P Β· 14.7g C Β· 0.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:20:00.202Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Track two tablespoons guacamole." (difficulty β)1.0s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Guacamole (tablespoon), 2. Guacamole, NFS, 3. Guacamole (2 tablespoon)
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:20:12.282Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate one medium nectarine." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Nectarine β card not captured.
Why verdict Logged (write-truth verified): Nectarine β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one medium nectarine. Assumed 1 nectarine as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Nectarine Γ1 (1 nectarine) 62 cal Β· 1.5g P Β· 14.8g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:20:23.547Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Put down one cup couscous." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for one cup couscous? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:20:37.399Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Record five ounces chicken sausage." (difficulty β)1.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:20:49.865Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual RXBAR." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): RXBAR Blueberry β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged RXBAR RXBAR Blueberry. Using your saved "my usual rxbar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: RXBAR Blueberry Γ1 (bar) 210 cal Β· 12g P Β· 25g C Β· 8g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Dairy Plain Skyr. Using your saved "my usual skyr". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Plain Skyr Γ1 (cup) 110 cal Β· 19g P Β· 7g C Β· 0g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Deli Chicken Salad Scoop. Using your saved "my usual chicken salad". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chicken Salad Scoop Γ1 (scoop) 280 cal Β· 22g P Β· 6g C Β· 18g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked Quinoa. Using your saved "my usual quinoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Quinoa Γ1 (cup) 222 cal Β· 8g P Β· 39g C Β· 3.6g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Track my usual cashews." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cashews β card not captured.
Why verdict Logged (write-truth verified): Cashews β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cashews. Using your saved "my usual cashews". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cashews Γ1 (ounce) 157 cal Β· 5g P Β· 9g C Β· 12g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Oat Milk. Using your saved "my default oat milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oat Milk Γ1 (cup) 120 cal Β· 3g P Β· 16g C Β· 5g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Add my usual evening cocoa." (difficulty β)0.1s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Hot Cocoa β card not captured.
Why verdict Logged (write-truth verified): Hot Cocoa β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Cafe Hot Cocoa. Using your saved "my usual evening cocoa". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Hot Cocoa Γ1 (cup) 140 cal Β· 4g P Β· 24g C Β· 3g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Steel Cut Oats. Using your saved "my normal steel cut oats". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Steel Cut Oats Γ1 (cup) 170 cal Β· 7g P Β· 29g C Β· 3g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Cafe Caffe Latte. Using your saved "my go to latte". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Caffe Latte Γ1 (cup) 150 cal Β· 8g P Β· 14g C Β· 6g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Chamomile Tea. Using your saved "my usual bedtime tea". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Chamomile Tea Γ1 (cup) 0 cal Β· 0g P Β· 0g C Β· 0g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add the same ricotta as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "Part Skim Ricotta" β no saved row with matching identity (rows: Ricotta cheese)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Ricotta cheese. Using your recent Ricotta cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ1 (0.75 cup) 273 cal Β· 17.7g P Β· 11.1g C Β· 17.5g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Same granola as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "Honey Granola": logged 120 kcal vs expected ~240 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "Honey Granola": logged 120 kcal vs expected ~240 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Pantry Honey Granola. Using your recent Codex Test Pantry Honey Granola history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Honey Granola Γ0.5 (cup) 120 cal Β· 3g P Β· 19g C Β· 4g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log the same soup I had last night." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown I heard you want the same the same soup i had last night as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Everything Bagel. Using your recent Everything Bagel history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Everything Bagel Γ1 (bagel) 280 cal Β· 10g P Β· 54g C Β· 2g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Add the same salmon I had earlier." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "Baked Salmon Fillet": logged 180 kcal vs expected ~280 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged salmon. Using your recent salmon history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: salmon Γ1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Same smoothie as yesterday." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Green Protein Smoothie β card not captured.
Why verdict Logged (write-truth verified): Green Protein Smoothie β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Recipe Green Protein Smoothie. Using your recent Codex Test Recipe Green Protein Smoothie history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Green Protein Smoothie Γ1 (smoothie) 260 cal Β· 24g P Β· 30g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Recipe Green Protein Smoothie
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Firm Tofu. Using your saved "Firm Tofu". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Firm Tofu Γ1 (serving) 140 cal Β· 15g P Β· 3g C Β· 8g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Same toast as earlier today." (difficulty β)0.2s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β MACROS off for "Sourdough Toast": logged 180 kcal vs expected ~90 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "Sourdough Toast": logged 180 kcal vs expected ~90 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Sourdough Toast. Using your recent Sourdough Toast history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Sourdough Toast Γ2 (slice) 180 cal Β· 6g P Β· 34g C Β· 2g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Snack was one chocolate Chip's Ahoy cookie pack mini." (difficulty β)2.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for one chocolate chips ahoy cookie pack mini? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:24:38.600Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Finished one Fairlife Core Power vanilla shake." (difficulty β)2.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Core Power Vanilla Protein Shake β Fairlife (bottle), 2. Core Power Vanilla Protein Shake β Fairlife (1 shake)
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:24:52.432Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Track one Chobani zero sugar strawberry cup." (difficulty β)1.4s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Zero Sugar Strawberry Yogurt β CHOBANI, 2. Zero Sugar Strawberry Flavor Yogurt β CHOBANI, 3. Strawberry Zero Sugar Nonfat Greek Yogurt β CHOBANI, 4. Strawberry Zero Sugar Yogurt-Cultured Ultra-Filtered Nonfat Milk β CHOBANI
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:25:05.082Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Save one Quest cookies and cream protein bar." (difficulty β)0.5s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Cookies & Cream Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Cookies & Cream Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cookies & Cream Protein Bar β Quest β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Cookies & Cream Protein Bar Γ1 (1 BAR) 200 cal Β· 21g P Β· 21g C Β· 8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:25:16.731Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I ate one KIND peanut butter dark chocolate bar." (difficulty β)0.6s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): KIND Peanut Butter Dark Chocolate Bar β card not captured.
Why verdict Logged (write-truth verified): KIND Peanut Butter Dark Chocolate Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged KIND Peanut Butter Dark Chocolate Bar β let me know if that's not right.
3 Β· App data rows written created food_log_entry: KIND Peanut Butter Dark Chocolate Bar Γ1 (1 kind peanut butter dark chocolate bar) 200 cal Β· 7g P Β· 17g C Β· 14g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:25:28.415Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Log a medium orange and one RXBAR chocolate sea salt." (difficulty β)1.6s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS saidno speech captured
2 Β· Card shown I need to resolve one RXBAR chocolate sea salt before I log this meal. What should I use for one RXBAR chocolate sea salt?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:25:41.166Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had steel cut oats and green tea." (difficulty β)0.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Steel Cut Oats and Green tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Steel Cut Oats Γ1 (cup) 170 cal Β· 7g P Β· 29g C Β· 3g F created food_log_entry: Green tea Γ1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:25:52.817Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was scrambled eggs and a bagel." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two scrambled eggs and a bagel. assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F created food_log_entry: Plain bagel Γ1 (1 bagel) 350 cal Β· 14g P Β· 67.2g C Β· 2.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:26:04.216Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Lunch was a tuna melt and an apple." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
Why verdict WRONG item vs seeded default/key β IMPLAUSIBLE: 550 kcal is implausibly HIGH for 1 count of Tuna melt sandwich (typical 60-120 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Tuna melt sandwich and an apple. Assumed 1 apple as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Tuna melt sandwich Γ1 (1 tuna melt) 550 cal Β· 30.8g P Β· 44g C Β· 26.4g F created food_log_entry: Apple Γ1 (1 apple) 95 cal Β· 0.5g P Β· 25.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:26:15.734Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was cashews and a pear." (difficulty β)1.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cashews (1 serving) and a pear. Assumed 1 pear as the default serving. Tell me if you want a different amount. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cashews Γ1 (ounce) 157 cal Β· 5g P Β· 9g C Β· 12g F created food_log_entry: Pear Γ1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:26:28.131Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was cod and asparagus." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cod and Asparagus. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cod Γ1 (100 g) 105 cal Β· 23g P Β· 0g C Β· 0.9g F created food_log_entry: Asparagus Γ1 (100 g) 22 cal Β· 2.4g P Β· 4.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:26:39.448Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate skyr and raspberries." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Skyr and Raspberries. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Skyr Γ1 (170 g) 107 cal Β· 18.7g P Β· 6.8g C Β· 0.3g F created food_log_entry: Raspberries Γ1 (1 oz) 15 cal Β· 0.3g P Β· 3.3g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:26:50.767Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track turkey and quinoa." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Turkey breast and Cooked quinoa. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Turkey breast Γ1 (100 g) 135 cal Β· 29g P Β· 0g C Β· 1.7g F created food_log_entry: Cooked quinoa Γ1 (100 g) 120 cal Β· 4.4g P Β· 21.3g C Β· 1.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:27:13.667Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add ricotta and blackberries." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Ricotta cheese and Blackberries. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Ricotta cheese Γ1 (100 g) 148 cal Β· 9.6g P Β· 6g C Β· 9.5g F created food_log_entry: Blackberries Γ1 (100 g) 43 cal Β· 1.4g P Β· 10.2g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:27:25.115Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"I had a Kind bar and water." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Water, Cookies & Cream Protein Bar)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "a kind bar" β no saved row with matching identity (rows: Water, Cookies & Cream Protein Bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged QUEST Cookies & Cream Protein Bar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cookies & Cream Protein Bar Γ1 (1 BAR) 200 cal Β· 21g P Β· 21g C Β· 8g F created food_log_entry: Water Γ1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:27:37.083Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log miso soup and edamame." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Miso soup and Edamame. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Miso soup Γ1 (100 g) 20 cal Β· 1.5g P Β· 2.7g C Β· 0.6g F created food_log_entry: Edamame Γ1 (100 g) 121 cal Β· 11.9g P Β· 8.9g C Β· 5.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:27:48.515Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was granola, yogurt, and coffee." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:27:59.700Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a pear, string cheese, and pretzels." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a pear, Mozzarella string cheese, and Pretzels. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Pear Γ1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F created food_log_entry: Mozzarella string cheese Γ1 (28 g) 80 cal Β· 7g P Β· 1g C Β· 5g F created food_log_entry: Pretzels Γ1 (28 g) 106 cal Β· 2.5g P Β· 22.1g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:28:11.133Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Dinner was pork, farro, and Brussels sprouts." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Pork, Cooked farro, and Brussels sprouts. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Pork Γ1 (85 g) 145 cal Β· 23.8g P Β· 0g C Β· 5g F created food_log_entry: Cooked farro Γ1 (100 g) 123 cal Β· 4.4g P Β· 26g C Β· 0.8g F created food_log_entry: Brussels sprouts Γ1 (155 g) 70 cal Β· 5.4g P Β· 14.4g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:28:22.515Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was snap peas and hummus." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Snap peas and Hummus. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Snap peas Γ1 (98 g) 41 cal Β· 2.7g P Β· 7.4g C Β· 0.2g F created food_log_entry: Hummus Γ1 (100 g) 166 cal Β· 7.9g P Β· 14.3g C Β· 9.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:28:33.850Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a grain bowl and iced tea." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Grain Bowl (serving) and Unsweetened iced tea. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Grain Bowl Γ1 (serving) 313 cal Β· 8.1g P Β· 55.7g C Β· 6.7g F created food_log_entry: Unsweetened iced tea Γ1 (240 g) 2 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:28:46.317Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had rice, lentils, and tofu." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked white rice, Lentils, and Firm tofu. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F created food_log_entry: Lentils Γ1 (100 g) 116 cal Β· 9g P Β· 20.1g C Β· 0.4g F created food_log_entry: Firm tofu Γ1 (100 g) 144 cal Β· 17g P Β· 2.8g C Β· 8.7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:28:57.731Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track skyr, honey, and walnuts." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Skyr, Honey, and Walnuts. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Skyr Γ1 (170 g) 107 cal Β· 18.7g P Β· 6.8g C Β· 0.3g F created food_log_entry: Honey Γ1 (21 g) 64 cal Β· 0.1g P Β· 17.3g C Β· 0g F created food_log_entry: Walnuts Γ1 (28 g) 183 cal Β· 4.3g P Β· 3.8g C Β· 18.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:29:09.233Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add eggs, Canadian bacon, and grapefruit juice." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two eggs, Canadian bacon, and Grapefruit juice. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F created food_log_entry: Canadian bacon Γ1 (46 g) 67 cal Β· 13g P Β· 0.8g C Β· 1.3g F created food_log_entry: Grapefruit juice Γ1 (247 g) 96 cal Β· 1.2g P Β· 22.7g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:29:20.734Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I ate noodles and a side of spinach." (difficulty β)0.7s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
Why verdict WRONG item vs seeded default/key β WRONG/MISSING item "noodles" β no saved row with matching identity (rows: Cooked pasta, Spinach, Cooked pasta, Spinach)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked pasta and Spinach. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:29:32.550Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a nectarine and almond butter." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a nectarine and Almond butter. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Nectarine Γ1 (1 nectarine) 62 cal Β· 1.5g P Β· 14.8g C Β· 0.4g F created food_log_entry: Almond butter Γ1 (32 g) 196 cal Β· 6.7g P Β· 6.1g C Β· 17.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:29:43.967Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was cereal and oat milk." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:29:55.149Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had a frittata with four eggs, spinach, and feta" (difficulty β)2.4s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Egg, Feta cheese, Frittata, Spinach β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Frittata. Includes four eggs, spinach, and Feta cheese.
3 Β· App data rows written created food_log_entry: Frittata Γ1 (serving) 557 cal Β· 40.3g P Β· 6.6g C Β· 40.4g F created food_log_entry: Egg Γ1 (4 eggs) 286 cal Β· 25.2g P Β· 1.4g C Β· 19g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Feta cheese Γ1 (100 g) 264 cal Β· 14.2g P Β· 4.1g C Β· 21.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:30:08.718Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Log a smoothie with spinach, banana, and whey protein." (difficulty β)1.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Smoothie. Includes spinach, one banana, and Whey protein powder.
3 Β· App data rows written created food_log_entry: Smoothie Γ1 (serving) 222 cal Β· 27.1g P Β· 29.2g C Β· 1g F created food_log_entry: Spinach Γ1 (30 g) 7 cal Β· 0.9g P Β· 1.1g C Β· 0.1g F created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: Whey protein powder Γ1 (30 g) 110 cal Β· 24.9g P Β· 1g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:32:05.067Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had a grain bowl with quinoa, chickpeas, and tahini." (difficulty β)3.7s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Logging your grain bowl with quinoa, chickpeas, and tahini β still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: a grain bowl with quinoa, chickpeas, and tahini (pending)
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:32:26.599Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Breakfast was avocado toast with egg and chili flakes." (difficulty β)0.7s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact ingredient should I use for chili flakes?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:32:31.817Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I made stir fry with tofu, peppers, broccoli, and oil." (difficulty β)3.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I can help you log your stir fry. For accurate nutrition tracking, I need to know: what kind of oil did you use, and can you estimate how much? For example, "a tablespoon of olive oil."
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:32:46.085Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was a poke bowl with rice, tuna, avocado, and seaweed." (difficulty β)1.3s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I use for tuna?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:33:10.118Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"I had pho with beef and basil." (difficulty β)2.3s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Pho, Beef, Basil, Raw β card not captured.
Why verdict Logged (write-truth verified): Pho, Beef, Basil, Raw β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Pho. Includes Beef and Basil, Raw.
3 Β· App data rows written created food_log_entry: Pho Γ1 (serving) 219 cal Β· 22.9g P Β· 0.6g C Β· 12.9g F created food_log_entry: Beef Γ1 (85 g) 213 cal Β· 22.1g P Β· 0g C Β· 12.8g F created food_log_entry: Basil, Raw Γ1 (1 cup) 6 cal Β· 0.8g P Β· 0.6g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:33:23.534Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the entry"Log a chicken wrap with hummus and cucumber." (difficulty β)1.0s
Verdict Expected LOG β should log the entry. PASS: Logged (write-truth verified): Hummus, Chicken Wrap, Cucumber β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Chicken Wrap. Includes hummus and Cucumber.
3 Β· App data rows written created food_log_entry: Chicken Wrap Γ1 (serving) 181 cal Β· 8.6g P Β· 17.9g C Β· 9.7g F created food_log_entry: Hummus Γ1 (100 g) 166 cal Β· 7.9g P Β· 14.3g C Β· 9.6g F created food_log_entry: Cucumber Γ1 (100 g) 15 cal Β· 0.7g P Β· 3.6g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:33:35.635Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I built an acai bowl with granola, banana, and coconut." (difficulty β)3.6s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Logging your I built an acai bowl with granola, banana, and coconut β still looking up the nutrition details; they'll appear in your log shortly.
3 Β· App data rows written pending_created food_log_entry: I built an acai bowl with granola, banana, and coconut (pending)
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:33:57.232Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the entry"Dinner was butter chicken with rice, naan, and cucumber salad." (difficulty β)0.8s
Verdict Expected LOG β should log the entry. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact ingredient should I use for butter chicken with rice naan?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:34:02.251Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add some porridge." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for some porridge? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:34:16.135Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had muesli." (difficulty β)1.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Did you have milk, yogurt, fruit, or honey with the cereal or granola? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:34:28.251Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log couscous for dinner." (difficulty β)2.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for couscous for dinner? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:34:41.402Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track noodles." (difficulty β)4.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Beef, Noodles, and Vegetables Including Carrots, Broccoli, and/or Dark-Green Leafy; No Sauce, 2. Chow Mein or Chop Suey, Meatless, with Noodles, 3. Beef and Noodles with Tomato-Based Sauce
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:34:56.518Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate pretzels." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Pretzels? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:35:07.786Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add walnuts." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged walnuts. Assumed about 28 g as a typical serving because no amount was stated.
3 Β· App data rows written created food_log_entry: Walnuts Γ1 (28 g) 183 cal Β· 4.3g P Β· 3.8g C Β· 18.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:35:19.019Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of chili." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a bowl of chili? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:35:32.869Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of risotto." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a plate of risotto? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:35:46.718Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track lemonade." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for lemonade? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:35:58.252Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add tea." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:36:09.785Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I drank beer." (difficulty β)1.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for beer? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:36:22.035Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Log gelato." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged gelato β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: gelato Γ1 (serving) 200 cal Β· 5g P Β· 20g C Β· 10g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:36:33.452Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Had some mixed nuts." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Mixed nuts? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:36:44.668Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add kettle corn." (difficulty β)4.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.4s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:37:00.186Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had an energy bar." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar)
Why verdict WRONG item vs seeded default/key β WRONG/MISSING item "energy bar" β no saved row with matching identity (rows: Generic protein bar, Generic protein bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged an energy bar. Assumed 1 energy bar as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Generic protein bar Γ1 (1 energy bar) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Generic protein bar Γ1 (1 energy bar) 200 cal Β· 20g P Β· 22g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:37:11.601Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a dairy cup." (difficulty β)1.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS saidno speech captured
2 Β· Card shown I couldn't find Dairy Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:37:35.935Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track a milk alternative." (difficulty β)5.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What fat level or type of milk should I use? I did not log it yet because milk fat level can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:37:52.418Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a deli sandwich." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a deli sandwich? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:38:06.302Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a protein shake." (difficulty β)3.6s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.6s
1 Β· TTS saidno speech captured
2 Β· Card shown I couldn't find Add A Protein Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:38:21.003Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a latte." (difficulty β)1.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged latte β let me know if that's not right.
3 Β· App data rows written created food_log_entry: latte Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:38:33.085Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a roll." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged Roll, White, Hot Dog Bun (1 roll (1 hot dog bun)) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Roll, White, Hot Dog Bun Γ1 (1 roll (1 hot dog bun)) 120 cal Β· 4.2g P Β· 22.1g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:38:44.617Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track a veggie burger." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a veggie burger? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:38:58.519Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had flatbread pizza." (difficulty β)4.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:39:14.252Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a scone." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a scone? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:39:28.087Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual latte size." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged latte. Using your saved "log my usual latte size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: latte Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged dinner portion. Using your saved "add the regular dinner portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: dinner portion Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged snack. Using your saved "track my default afternoon snack". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged breakfast. Using your saved "i had the usual breakfast size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
{
"type": "food_default",
"phrase": "i had the usual breakfast size",
"foodItemId": "seed-d-bfast-size",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "serving",
"displayLabel": "i had the usual breakfast size",
"confirmBeforeLog": false
}
}
snapshot captured 2026-08-01T12:40:13.037Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Three quarters of a cup." (difficulty β)1.9s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. three quarters cup ricotta, 2. the cheesecake factory cup of butternut squash soup
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:40:26.087Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One and a half cups, plain." (difficulty β)1.4s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I couldn't find A Half Half Packaged Food in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:40:38.620Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"The RXBAR blueberry." (difficulty β)1.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I found a likely match for rxbar rxbar blueberry, but I still need a clearer amount or product detail before I can log it. What exact food and amount should I use? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:40:50.804Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould complete the pending action"Oat milk." (difficulty β)2.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged Oat Milk (1 serving) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Oat Milk Γ1 (250 milliliters) 114 cal Β· 1.8g P Β· 13.7g C Β· 5.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:41:04.071Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not it β the unsweetened one." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I change about Oat Milk?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:41:15.301Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"Wrong one. The vanilla, not chocolate." (difficulty β)0.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:41:27.269Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, not the flavored skyr." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I change about Oat Milk?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:41:38.505Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould decline"Cancel that entry." (difficulty β)0.1s
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, that's not the bar I meant." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I change about Oat Milk?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:42:25.820Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not the medium β the large pear." (difficulty β)5.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Pear? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:42:42.269Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong item. Pick the baked cod." (difficulty β)4.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.1s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Cod? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:42:57.518Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"That's not it; the plain one." (difficulty β)2.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS saidno speech captured
2 Β· Card shown I don't see a "plain" one in your recent food logs. Could you tell me the exact food name and amount you'd like me to adjust? For example, "change my oatmeal to 1 cup" or "delete the yogurt entry."
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:43:22.605Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"No, the other cheese." (difficulty β)7.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 7.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which exact other cheese should replace Oat Milk?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:43:40.803Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not those cashews β the raw ones." (difficulty β)2.4s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I donβt see βraw cashewsβ in your recent food logs. Could you tell me the exact food name and amount youβd like me to adjust? For example, βchange my cashews to raw cashews, 1 ounceβ or βdelete the roasted cashews entry.β
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:44:05.568Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the banana from earlier." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not find a list matching earlier. Which list has banana?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:44:27.901Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove that Quest bar." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:44:39.083Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the oats entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:44:50.284Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:45:01.467Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the raspberries." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:45:12.651Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the chicken log." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:45:23.917Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Scratch the almond butter." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:45:35.098Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the milk entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:45:46.301Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete that brownie I logged last night." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted brownie.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove yesterday's gelato." (difficulty β)0.0s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the leftover burrito entry." (difficulty β)0.3s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted burrito.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take out the wine from last night." (difficulty β)2.2s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS saidno speech captured
2 Β· Card shown I donβt see βwineβ in your recent food logs. Could you tell me the exact food name and amount youβd like me to remove? For example, βdelete the red wine entryβ or βremove the Pinot Grigio from yesterday.β
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Remove the pastry log from earlier this week." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted pastry.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould delete the entry"Delete the chips I shouldn't have logged." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted chips.
3 Β· App data rows written deleted food_log_entry:
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:47:18.983Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually make the Quest bar two bars." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:47:30.217Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update the oats to one and a half cups." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:47:41.434Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the eggs to four." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:47:52.634Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make the raspberries a half cup." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:48:03.900Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update the chicken to seven ounces." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:48:15.151Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change almond butter to one tablespoon." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:48:26.384Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually the milk was two percent, not whole." (difficulty β)2.3s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Updated the food entry from "Oat Milk" to "two percent milk".
3 Β· App data rows written updated food_log_entry: Milk Γ2 (100 g) 100 cal Β· 6.6g P Β· 9.6g C Β· 4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:48:39.899Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually that was strawberry, not vanilla." (difficulty β)1.4s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Updated the food entry from "Milk" to "strawberry".
3 Β· App data rows written updated food_log_entry: Strawberries Γ1 (12 g) 4 cal Β· 0.1g P Β· 0.9g C Β· 0g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Actually it was cashew butter, not almond butter." (difficulty β)2.6s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Updated the food entry from "Strawberries" to "cashew butter".
3 Β· App data rows written updated food_log_entry: Cashew Butter Γ1 (1 tablespoon) 97 cal Β· 1.9g P Β· 4.8g C Β· 8.5g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould update the entry"Change the pear to a small." (difficulty β)5.8s
Verdict Expected UPDATE β should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS saidno speech captured
2 Β· Card shown Updated Pear to 1 small.
3 Β· App data rows written updated food_log_entry: Pear Γ1 (178 g) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein is left for today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You are about 974 grams of protein over today's 160 gram protein target (1134 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:50:07.768Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories have I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see calories in today's food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:50:30.536Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat last night?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see any food logged yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:50:41.717Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much fiber today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:50:52.950Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's left in my calorie budget?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You are about 15467 calories over today's 2200 calorie budget (17667 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:51:04.135Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log lunch yet?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see lunch logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:51:15.318Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs so far?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:51:26.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat before the gym?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown No β I do not see before the gym logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:51:37.735Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Show me yesterday's food log." (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:51:49.019Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Am I under my fat goal?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:00.235Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories in the pear I just logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Pear has about 101 calories per 178 g.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:11.519Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What was my first meal today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Your first food entry today was 1 1 large banana Banana.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:22.785Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much coffee have I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see coffee in today's food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:34.032Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Calories left for a snack?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You are about 15467 calories over today's 2200 calorie budget (17667 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:45.401Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I already log my usual RXBAR?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Yes. Today you logged 1 bar RXBAR RXBAR Blueberry.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:52:56.684Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's my average calories this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:53:07.952Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many food entries today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You have 115 food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:53:19.201Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I have mid-afternoon?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see any food logged mid-afternoon today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:53:30.468Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Show the food diary screen." (difficulty β)0.1s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Opening Food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:53:41.719Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected NAVIGATE β should navigate. FAIL: Did not navigate β misrouted into a food/workout clarification or dead-ended.
Why verdict Did not navigate β misrouted into a food/workout clarification or dead-ended.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:53:52.951Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould apply the setting"Set my protein goal to one hundred sixty grams." (difficulty β)0.1s
Verdict Expected SETTINGS β should apply the setting. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-01T12:54:04.334Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)