"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β needs a human look (that's you π/π-ing it). "Pass rate" = pass Γ· (pass + fail) β it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 25 unclassified β the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.
Why the fails happened β comprehension vs execution vs cosmetic
Comprehension β picked the wrong action/target (the hard problem)
54 (90%)
resolution β 52 (96% of comprehension)
"I had one cup cooked oatmeal with no toppings." β Over-asked: asked instead of logging (no saved row).
"Dinner side was three quarters cup green beans." β Over-asked: asked instead of logging (no saved row).
"Dinner was five ounces tilapia." β Right food, WRONG MACROS (saved calories/macros outside the tolerance).
"Log the same salad I had last night." β Over-asked: asked instead of logging (no saved row).
"Add the same eggs I had earlier." β Over-asked: asked instead of logging (no saved row).
"Log the chicken I had last time." β Over-asked: asked instead of logging (no saved row).
+ 46 more
context β 2 (4% of comprehension)
"The Quest chocolate brownie." β Did not complete the pending action (lost the follow-up context).
"No, that's not it β the plain one." β Did not complete the pending action (lost the follow-up context).
Execution β right decision, output broke (plumbing)
6 (10%)
data-write β 6 (100% of execution)
"Lunch was a turkey sandwich and an apple." β Decided to log but the write did not confirm/persist (write-path failure).
"Lunch was a salad and a roll." β Decided to log but the write did not confirm/persist (write-path failure).
"Breakfast was cereal and milk." β Decided to log but the write did not confirm/persist (write-path failure).
"No, not the sweetened yogurt." β Completed the pending action but the output was flagged.
"No, that's not the bar I meant." β Completed the pending action but the output was flagged.
"No, the other yogurt." β Completed the pending action but the output was flagged.
Of 60 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.
Handled correctly? β by expected action
Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed to
N
Correct
Wrong
Unverified
βΈ LOG β log the food
104
81 (78%)
22 (21%)
1 (1%)
22 handled wrong β click one to jump to its full detail below
"I had one cup cooked oatmeal with no toppings."
OVER-ASK β asked instead of logging (no saved row).
"Dinner side was three quarters cup green beans."
OVER-ASK β asked instead of logging (no saved row).
"Dinner was five ounces tilapia."
WRITE-TRUTH FAIL β MACROS off for "tilapia": logged 183 kcal vs expected ~128 (Β§14 15pct/25cal band)
"Log the same salad I had last night."
OVER-ASK β asked instead of logging (no saved row).
"Add the same eggs I had earlier."
OVER-ASK β asked instead of logging (no saved row).
"Log the chicken I had last time."
OVER-ASK β asked instead of logging (no saved row).
"Snack was one blueberry RX bar."
OVER-ASK β asked instead of logging (no saved row).
"Finished one Fairlife Core Power chocolate 42 gram bottle."
WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
"Track one Chobani zero sugar vanilla cup."
OVER-ASK β asked instead of logging (no saved row).
"Save one Quest chocolate brownie protein bar."
OVER-ASK β asked instead of logging (no saved row).
"I ate one KIND dark chocolate nuts and sea salt bar."
WRITE-TRUTH FAIL β WRONG item/product identity "kind dark chocolate nuts sea salt" β saved row does not hit product alias (rows: No Cow Chocolate Sea Salt Bar, Dark chocolate)
"Log a medium Fuji apple and one KIND peanut butter dark chocolate bar."
WRITE-TRUTH FAIL β WRONG/MISSING item "one kind peanut butter dark chocolat" β no saved row with matching identity (rows: Chocolate Candy, Peanut Butter Filled, Apple)
Not yet classified β pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.
System / infra
Not yet classified β pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.
Latency
Avg (time to ready)
0.9s
p90
2.7s
Max
12.0s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β click any dot to jump to its detail.
0s
1s
2s
5s
10s
12s
Response path β quick (single response) vs async (an ack like "Working on itβ¦" before the real answer).
Quick response
167
Sync clarification
29
Slowest 8 utterances (click to jump to detail):
"I had a plate of pasta."12.0s
"Not those almonds β the dry roasted."8.0s
"Dinner side was three quarters cup green beans."7.9s
"No, that's not it β the plain one."5.8s
"The Quest chocolate brownie."5.8s
"Wrong item. Pick the grilled chicken."5.6s
"I had one cup cooked oatmeal with no toppings."5.5s
"Make the blueberries a half cup."5.5s
Filter β controls the list below
Pass / Fail / Unverified
PASS 111FAIL 60UNVERIFIED 25
Module (intended for)
Food (196)
Utterance sub-type (within module)
196 shown β 111 pass, 60 fail, 25 unverified
Per-utterance detail
PASSshould log the food"Log one medium banana for the sequence." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one medium banana for the sequence. Assumed 1 medium banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 medium banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:46:49.653Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track one Quest chocolate chip cookie dough bar." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Quest chocolate chip cookie dough bar β card not captured.
Why verdict Logged (write-truth verified): Quest chocolate chip cookie dough bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Quest chocolate chip cookie dough bar β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Quest chocolate chip cookie dough bar Γ1 (1 bar) 190 cal Β· 21g P Β· 22g C Β· 9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:47:01.215Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"I had one cup cooked oatmeal with no toppings." (difficulty β)5.5s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.5s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Cooked oatmeal? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:47:17.899Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add two hard boiled eggs for lunch." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two hard boiled eggs for lunch.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:47:29.530Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log one cup blueberries as a snack." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Blueberries β card not captured.
Why verdict Logged (write-truth verified): Blueberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup blueberries as a snack. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blueberries Γ1 (1 cup) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:47:40.981Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Record four ounces grilled chicken." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Chicken breast β card not captured.
Why verdict Logged (write-truth verified): Chicken breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged four ounces grilled chicken.
3 Β· App data rows written created food_log_entry: Chicken breast Γ1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:47:52.280Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track one tablespoon peanut butter." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Peanut butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one tablespoon peanut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Peanut butter Γ1 (1 tbsp) 88 cal Β· 3.8g P Β· 2.9g C Β· 7.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:48:03.631Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I drank one cup two percent milk." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): 2% milk β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup two percent milk.
3 Β· App data rows written created food_log_entry: 2% milk Γ1 (1 cup) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:48:15.097Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had one medium banana." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Banana β card not captured.
Why verdict Logged (write-truth verified): Banana β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one medium banana. Assumed 1 medium banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 medium banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:48:26.400Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Breakfast was two hard boiled eggs." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Egg β card not captured.
Why verdict Logged (write-truth verified): Egg β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two hard boiled eggs.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:48:37.732Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Put down four ounces grilled chicken breast." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Chicken breast β card not captured.
Why verdict Logged (write-truth verified): Chicken breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged four ounces grilled chicken breast.
3 Β· App data rows written created food_log_entry: Chicken breast Γ1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:48:49.050Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Record one cup cooked white rice." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cooked white rice β card not captured.
Why verdict Logged (write-truth verified): Cooked white rice β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup cooked white rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ1 (1 cup) 205 cal Β· 4.3g P Β· 44.2g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:00.364Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Snack was a small apple." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Apple β card not captured.
Why verdict Logged (write-truth verified): Apple β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a small apple. Assumed 1 small apple as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Apple Γ1 (1 small apple) 77 cal Β· 0.4g P Β· 20.9g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:11.682Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate five ounces baked salmon." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Salmon β card not captured.
Why verdict Logged (write-truth verified): Salmon β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged five ounces baked salmon.
3 Β· App data rows written created food_log_entry: Salmon Γ1 (5 oz) 295 cal Β· 28.3g P Β· 0g C Β· 18.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:22.982Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track one cup blueberries." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Blueberries β card not captured.
Why verdict Logged (write-truth verified): Blueberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup blueberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blueberries Γ1 (1 cup) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:34.299Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Count twelve almonds." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Almonds β card not captured.
Why verdict Logged (write-truth verified): Almonds β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged twelve almonds.
3 Β· App data rows written created food_log_entry: Almonds Γ1 (12 almonds) 83 cal Β· 3.1g P Β· 3.1g C Β· 7.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:45.615Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Lunch included three ounces turkey breast." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Turkey breast β card not captured.
Why verdict Logged (write-truth verified): Turkey breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three ounces turkey breast.
3 Β· App data rows written created food_log_entry: Turkey breast Γ1 (3 oz) 115 cal Β· 24.7g P Β· 0g C Β· 1.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:49:56.898Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Save one cup steamed broccoli." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Broccoli β card not captured.
Why verdict Logged (write-truth verified): Broccoli β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup steamed broccoli. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Broccoli Γ1 (1 cup) 55 cal Β· 3.8g P Β· 11.3g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:50:08.232Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Orange juice β card not captured.
Why verdict Logged (write-truth verified): Orange juice β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged eight ounces orange juice.
3 Β· App data rows written created food_log_entry: Orange juice Γ1 (8 oz) 102 cal Β· 1.6g P Β· 23.6g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:50:19.563Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Note two slices turkey bacon." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Turkey bacon β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged note two slices turkey bacon.
3 Β· App data rows written created food_log_entry: Turkey bacon Γ1 (2 slices) 60 cal Β· 8.1g P Β· 1g C Β· 3.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:50:31.099Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Supper was one cup cooked lentils." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Lentils β card not captured.
Why verdict Logged (write-truth verified): Lentils β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup cooked lentils. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Lentils Γ1 (1 cup) 230 cal Β· 17.8g P Β· 39.8g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:50:57.999Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Enter one large orange." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Orange β card not captured.
Why verdict Logged (write-truth verified): Orange β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one large orange. Assumed 1 large orange as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Orange Γ1 (1 large orange) 86 cal Β· 1.7g P Β· 21.7g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:51:09.365Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Ate a quarter cup raisins." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Raisins β card not captured.
Why verdict Logged (write-truth verified): Raisins β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged ate a quarter cup raisins. Assumed 0.25 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raisins Γ1 (0.25 cup) 108 cal Β· 1.1g P Β· 28.7g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:51:20.865Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track one tablespoon peanut butter." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Peanut butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one tablespoon peanut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Peanut butter Γ1 (1 tbsp) 88 cal Β· 3.8g P Β· 2.9g C Β· 7.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:51:32.249Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Dinner side was three quarters cup green beans." (difficulty β)7.9s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 7.9s
1 Β· TTS saidno speech captured
2 Β· Card shown I need to resolve Dinner side was before I log this meal. What should I use for Dinner side was?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:51:51.282Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had one and a quarter cups strawberries." (difficulty β)0.5s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Strawberries β card not captured.
Why verdict Logged (write-truth verified): Strawberries β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one and a quarter cups strawberries. Assumed 1.25 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Strawberries Γ1 (1.25 cup) 61 cal Β· 1.3g P Β· 14.6g C Β· 0.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:52:03.868Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Put in two hundred grams nonfat Greek yogurt." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Nonfat Greek yogurt β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup two percent milk.
3 Β· App data rows written created food_log_entry: 2% milk Γ1 (1 cup) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:52:25.716Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Breakfast was one cup low fat cottage cheese." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): 1% cottage cheese β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup low fat cottage cheese. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: 1% cottage cheese Γ1 (1 cup) 163 cal Β· 28g P Β· 6.1g C Β· 2.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:52:37.065Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Count one medium corn tortilla." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Corn tortilla, Corn tortilla β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one medium corn tortilla. Assumed 1 corn tortilla as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ1 (1 corn tortilla) 61 cal Β· 1.6g P Β· 12.5g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:52:48.465Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had six ounces sirloin steak." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Sirloin steak β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged six ounces sirloin steak.
3 Β· App data rows written created food_log_entry: Sirloin steak Γ1 (6 oz) 364 cal Β· 49.3g P Β· 0g C Β· 17g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:52:59.816Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add one cup black beans." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Black beans β card not captured.
Why verdict Logged (write-truth verified): Black beans β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup black beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Black beans Γ1 (1 cup) 227 cal Β· 15.3g P Β· 40.8g C Β· 0.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:53:11.164Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track half an avocado." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Avocado β card not captured.
Why verdict Logged (write-truth verified): Avocado β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged half an avocado. Assumed half an avocado as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Avocado Γ1 (half an avocado) 120 cal Β· 1.5g P Β· 6.4g C Β· 11g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:53:22.699Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log two Eggo waffles." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Kellogg's Homestyle Eggo Waffles β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged Kellogg's Homestyle Eggo Waffles (2 waffles (70 g)) β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Kellogg's Homestyle Eggo Waffles Γ1 (2 waffles (70 g)) 180 cal Β· 4g P Β· 30g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:53:34.332Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate one English muffin." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Muffin, English β card not captured.
Why verdict Logged (write-truth verified): Muffin, English β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Muffin, English β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Muffin, English Γ1 (1 muffin) 132 cal Β· 5.2g P Β· 25.6g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:53:45.833Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the USDA nutrition database.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Record three ounces shrimp." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Shrimp β card not captured.
Why verdict Logged (write-truth verified): Shrimp β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged three ounces shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ1 (3 oz) 84 cal Β· 20.4g P Β· 0.2g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:53:57.269Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Snack was one string cheese." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Mozzarella string cheese β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one string cheese. Assumed 1 string cheese as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Mozzarella string cheese Γ1 (1 string cheese) 80 cal Β· 7g P Β· 1g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:54:08.599Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add one tablespoon olive oil." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Olive oil β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one tablespoon olive oil. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Olive oil Γ1 (1 tbsp) 120 cal Β· 0g P Β· 0g C Β· 13.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:54:19.983Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had one cup brown rice." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cooked brown rice β card not captured.
Why verdict Logged (write-truth verified): Cooked brown rice β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked brown rice Γ1 (1 cup) 218 cal Β· 4.5g P Β· 45.8g C Β· 1.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:54:31.382Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log one medium sweet potato." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Sweet potato β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Sweet potato.
3 Β· App data rows written created food_log_entry: Sweet potato Γ1 (130 g) 117 cal Β· 2.6g P Β· 26.9g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:54:42.983Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track eight ounces black coffee." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Coffee β card not captured.
Why verdict Logged (write-truth verified): Coffee β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged eight ounces black coffee.
3 Β· App data rows written created food_log_entry: Coffee Γ1 (8 oz) 2 cal Β· 0.2g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:55:10.351Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Count ten baby carrots." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Baby carrots β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged ten baby carrots.
3 Β· App data rows written created food_log_entry: Baby carrots Γ1 (10 baby carrots) 35 cal Β· 0.6g P Β· 8.2g C Β· 0.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:55:21.666Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Dinner was five ounces tilapia." (difficulty β)0.1s
Verdict Expected LOG β should log the food. FAIL: WRITE-TRUTH FAIL β MACROS off for "tilapia": logged 183 kcal vs expected ~128 (Β§14 15pct/25cal band)
Why verdict WRITE-TRUTH FAIL β MACROS off for "tilapia": logged 183 kcal vs expected ~128 (Β§14 15pct/25cal band)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged five ounces tilapia.
3 Β· App data rows written created food_log_entry: Tilapia Γ1 (5 oz) 183 cal Β· 36.9g P Β· 0g C Β· 3.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:55:32.950Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had one cup tomato soup." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Tomato soup β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup tomato soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Tomato soup Γ1 (1 cup) 93 cal Β· 2g P Β· 18.9g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:55:44.266Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add two rice cakes." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Plain rice cakes β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two rice cakes.
3 Β· App data rows written created food_log_entry: Plain rice cakes Γ1 (2 rice cakes) 70 cal Β· 1.4g P Β· 14.7g C Β· 0.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:55:55.584Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log one cup grapes." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Grapes β card not captured.
Why verdict Logged (write-truth verified): Grapes β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup grapes. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Grapes Γ1 (1 cup) 104 cal Β· 1.1g P Β· 27.3g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:56:06.866Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track one tablespoon hummus." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Hummus β card not captured.
Why verdict Logged (write-truth verified): Hummus β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one tablespoon hummus. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Hummus Γ1 (1 tbsp) 25 cal Β· 1.2g P Β· 2.1g C Β· 1.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:56:18.149Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate one small pear." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Pear β card not captured.
Why verdict Logged (write-truth verified): Pear β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one small pear. Assumed 1 pear as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pear Γ1 (1 pear) 101 cal Β· 0.7g P Β· 27.1g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:56:29.500Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Put down one cup cooked quinoa." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cooked quinoa β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged one cup cooked quinoa. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked quinoa Γ1 (1 cup) 222 cal Β· 8.1g P Β· 39.4g C Β· 3.5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:56:40.817Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Record four ounces 93 percent lean ground turkey." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Lean ground turkey β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows written created food_log_entry: Lean ground turkey Γ1 (4 oz) 193 cal Β· 30.6g P Β· 0g C Β· 7.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T19:56:52.298Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add my usual Quest bar." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Quest Chocolate Brownie Protein Bar, Quest Chocolate Brownie Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Quest Chocolate Brownie Protein Bar, Quest Chocolate Brownie Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Quest Quest Chocolate Brownie Protein Bar. Using your saved "my usual quest bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Quest Chocolate Brownie Protein Bar Γ1 (bar) 190 cal Β· 20g P Β· 21g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Quest Quest Chocolate Brownie Protein Bar
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had my usual yogurt." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Vanilla Greek Yogurt Cup β card not captured.
Why verdict Logged (write-truth verified): Vanilla Greek Yogurt Cup β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Dairy Vanilla Greek Yogurt Cup. Using your saved "my usual yogurt". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Vanilla Greek Yogurt Cup Γ1 (cup) 130 cal Β· 15g P Β· 12g C Β· 0g F created food_log_entry: Vanilla Greek Yogurt Cup Γ1 (cup) 130 cal Β· 15g P Β· 12g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Dairy Vanilla Greek Yogurt Cup
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Pantry Tuna Packet. Using your saved "my usual tuna packet". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Tuna Packet Γ1 (packet) 100 cal Β· 22g P Β· 0g C Β· 1g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Jasmine Rice Γ1 (cup) 205 cal Β· 4g P Β· 45g C Β· 0g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Almonds. Using your saved "my usual almonds". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Almonds Γ1 (20 almonds) 140 cal Β· 5g P Β· 5g C Β· 12g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged 2 Percent Milk. Using your saved "my default milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: 2 Percent Milk Γ1 (cup) 122 cal Β· 8g P Β· 12g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Recipe Morning Shake Recipe. Using your saved "my usual morning shake". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Morning Shake Recipe Γ1 (shake) 310 cal Β· 32g P Β· 28g C Β· 9g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked Oatmeal. Using your saved "my normal oatmeal". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Oatmeal Γ1 (cup) 150 cal Β· 6g P Β· 27g C Β· 3g F
{
"type": "food_default",
"phrase": "my normal oatmeal",
"foodItemId": "seed-c-oatmeal",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "cup",
"displayLabel": "my normal oatmeal",
"confirmBeforeLog": false
}
}
snapshot captured 2026-07-30T19:58:22.401Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track my go-to protein coffee." (difficulty β)0.1s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Protein Coffee, Protein Coffee β card not captured.
Why verdict Logged (write-truth verified): Protein Coffee, Protein Coffee β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Codex Test Cafe Protein Coffee. Using your saved "my go to protein coffee". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Protein Coffee Γ1 (cup) 120 cal Β· 15g P Β· 8g C Β· 2g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Herbal Tea. Using your saved "my usual evening herbal tea". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Herbal Tea Γ1 (cup) 2 cal Β· 0g P Β· 0g C Β· 0g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged 1% cottage cheese. Using your recent 1% cottage cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: 1% cottage cheese Γ1 (1 cup) 163 cal Β· 28g P Β· 6.1g C Β· 2.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Dairy Low Fat Cottage Cheese
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Same protein bar as yesterday." (difficulty β)0.6s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β card not captured.
Why verdict Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Quest Quest Chocolate Brownie Protein Bar. Using your recent Quest Quest Chocolate Brownie Protein Bar history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Quest Chocolate Brownie Protein Bar Γ1 (bar) 190 cal Β· 20g P Β· 21g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Pantry Chocolate Peanut Protein Bar
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Log the same salad I had last night." (difficulty β)0.5s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown I heard you want the same the same salad i had last night as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Kitchen Chicken Garden Salad
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked Oatmeal. Using your saved "my normal oatmeal". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Oatmeal Γ1 (cup) 150 cal Β· 6g P Β· 27g C Β· 3g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Add the same eggs I had earlier." (difficulty β)0.4s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I hear more than one saved version that could match "the same eggs i had earlier". Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould log the food"Same smoothie as yesterday." (difficulty β)0.3s
Verdict Expected LOG β should log the food. UNVERIFIED: CONTEXT-FRAGMENT β app asked for missing context; needs multi-turn replay (not a single-shot fail).
Why verdict CONTEXT-FRAGMENT β app asked for missing context; needs multi-turn replay (not a single-shot fail).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown I hear more than one saved version that could match "same smoothie as yesterday". Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state:
Seed food: Codex Test Recipe Berry Protein Smoothie
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Log the chicken I had last time." (difficulty β)0.1s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I heard you want the same the chicken i had last time as before, but I do not have a matching saved log yet. Which exact food and amount should I log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Whole Wheat Toast. Using your recent Whole Wheat Toast history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Whole Wheat Toast Γ1 (slice) 80 cal Β· 4g P Β· 14g C Β· 1g F
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Snack was one blueberry RX bar." (difficulty β)2.7s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for one blueberry rx bar? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:00:44.766Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Finished one Fairlife Core Power chocolate 42 gram bottle." (difficulty β)0.1s
Verdict Expected LOG β should log the food. FAIL: WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β expected food write missing β local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not find a to-do matching one Fairlife Core Power chocolate 42 gram bottle.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:00:55.967Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Track one Chobani zero sugar vanilla cup." (difficulty β)0.4s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown I couldn't find Track One Chobani Zero Sugar Vanilla Yogurt Cup in my nutrition database, so I haven't logged it β I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic yogurt.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:01:07.600Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Save one Quest chocolate brownie protein bar." (difficulty β)1.1s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I found a likely match for quest quest chocolate brownie protein bar, but I still need a clearer amount or product detail before I can log it. What exact food and amount should I use? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:01:19.983Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"I ate one KIND dark chocolate nuts and sea salt bar." (difficulty β)0.5s
Verdict Expected LOG β should log the food. FAIL: WRITE-TRUTH FAIL β WRONG item/product identity "kind dark chocolate nuts sea salt" β saved row does not hit product alias (rows: No Cow Chocolate Sea Salt Bar, Dark chocolate)
Why verdict WRITE-TRUTH FAIL β WRONG item/product identity "kind dark chocolate nuts sea salt" β saved row does not hit product alias (rows: No Cow Chocolate Sea Salt Bar, Dark chocolate)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Dark chocolate and No Cow Chocolate Sea Salt Bar β No Cow. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Dark chocolate Γ1 (100 g) 550 cal Β· 5.1g P Β· 60g C Β· 32.2g F created food_log_entry: No Cow Chocolate Sea Salt Bar Γ1 (1 bar (60 g)) 210 cal Β· 20g P Β· 23g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:01:31.649Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Log a medium Fuji apple and one KIND peanut butter dark chocolate bar." (difficulty β)0.8s
Verdict Expected LOG β should log the food. FAIL: WRITE-TRUTH FAIL β WRONG/MISSING item "one kind peanut butter dark chocolat" β no saved row with matching identity (rows: Chocolate Candy, Peanut Butter Filled, Apple)
Why verdict WRITE-TRUTH FAIL β WRONG/MISSING item "one kind peanut butter dark chocolat" β no saved row with matching identity (rows: Chocolate Candy, Peanut Butter Filled, Apple)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Apple and Chocolate Candy, Peanut Butter Filled. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Apple Γ1 (182 g) 95 cal Β· 0.5g P Β· 25.5g C Β· 0.4g F created food_log_entry: Chocolate Candy, Peanut Butter Filled Γ1 (1 large/king size) 438 cal Β· 7g P Β· 57.7g C Β· 22.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:01:43.634Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had oatmeal and black coffee." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cooked oatmeal, Coffee β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked oatmeal and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F created food_log_entry: Coffee Γ1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:01:55.151Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Breakfast was two eggs and one slice toast." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Egg, Toast β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two eggs and Toast.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F created food_log_entry: Toast Γ1 (1 slice) 69 cal Β· 2.3g P Β· 12.7g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:02:06.618Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Lunch was a turkey sandwich and an apple." (difficulty β)2.3s
Verdict Expected LOG β should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:02:20.066Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Snack was almonds and a banana." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Almonds, Banana β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Almonds and a banana. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Almonds Γ1 (28 g) 162 cal Β· 5.9g P Β· 6g C Β· 14g F created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:02:31.449Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Dinner was salmon and steamed broccoli." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Broccoli, Salmon β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Salmon and Broccoli. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Salmon Γ1 (100 g) 208 cal Β· 20g P Β· 0g C Β· 13g F created food_log_entry: Broccoli Γ1 (100 g) 35 cal Β· 2.4g P Β· 7.2g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:02:42.815Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate Greek yogurt and blueberries." (difficulty β)0.6s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Blueberries, Plain Greek yogurt, Plain Greek yogurt, Blueberries β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Plain Greek yogurt and Blueberries. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Blueberries Γ1 (148 g) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Blueberries Γ1 (148 g) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:02:54.634Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track chicken breast and brown rice." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cooked brown rice, Chicken breast β card not captured.
Why verdict Logged (write-truth verified): Cooked brown rice, Chicken breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Chicken breast and Cooked brown rice. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Chicken breast Γ1 (100 g) 165 cal Β· 31g P Β· 0g C Β· 3.6g F created food_log_entry: Cooked brown rice Γ1 (100 g) 112 cal Β· 2.3g P Β· 23.5g C Β· 0.8g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:03:21.402Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add cottage cheese and strawberries." (difficulty β)0.5s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Strawberries, Cottage cheese β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cottage cheese and Strawberries. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cottage cheese Γ1 (100 g) 98 cal Β· 11.1g P Β· 3.4g C Β· 4.3g F created food_log_entry: Strawberries Γ1 (12 g) 4 cal Β· 0.1g P Β· 0.9g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:03:33.017Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had a protein bar and sparkling water." (difficulty β)0.5s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Water, Generic protein bar, Generic protein bar, Water β card not captured.
Why verdict Logged (write-truth verified): Water, Generic protein bar, Generic protein bar, Water β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a protein bar and Water. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Generic protein bar Γ1 (1 protein bar) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Water Γ1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F created food_log_entry: Generic protein bar Γ1 (1 protein bar) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Water Γ1 (240 g) 0 cal Β· 0g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:03:44.699Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log soup and a side salad." (difficulty β)0.6s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Side salad, Soup β card not captured.
Why verdict Logged (write-truth verified): Side salad, Soup β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Soup and Side salad. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Soup Γ1 (245 g) 123 cal Β· 6.1g P Β· 15.9g C Β· 4.4g F created food_log_entry: Side salad Γ1 (85 g) 17 cal Β· 1g P Β· 3.4g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:03:56.450Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Breakfast was oatmeal, banana, and coffee." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Coffee, Banana, Cooked oatmeal β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked oatmeal, Banana, and Coffee. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ1 (100 g) 71 cal Β· 2.5g P Β· 12g C Β· 1.5g F created food_log_entry: Banana Γ1 (118 g) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: Coffee Γ1 (100 g) 1 cal Β· 0.1g P Β· 0g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:04:08.018Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate an apple, a cheese stick, and crackers." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Crackers, Mozzarella stick, Apple, Apple, Mozzarella stick β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged an apple, a cheese stick, and Crackers. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Apple Γ1 (1 apple) 95 cal Β· 0.5g P Β· 25.5g C Β· 0.4g F created food_log_entry: Mozzarella stick Γ1 (1 cheese stick) 91 cal Β· 4.2g P Β· 7g C Β· 5g F created food_log_entry: Crackers Γ1 (15 g) 63 cal Β· 1.4g P Β· 11.1g C Β· 1.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:04:19.417Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Dinner was steak, potatoes, and green beans." (difficulty β)0.5s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Green beans, Potato, Steak β card not captured.
Why verdict Logged (write-truth verified): Green beans, Potato, Steak β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Steak, Potato, and Green beans. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Steak Γ1 (85 g) 213 cal Β· 23g P Β· 0g C Β· 12.8g F created food_log_entry: Potato Γ1 (138 g) 120 cal Β· 2.6g P Β· 27.7g C Β· 0.1g F created food_log_entry: Green beans Γ1 (100 g) 35 cal Β· 1.9g P Β· 7.9g C Β· 0.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:04:31.016Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Snack was carrots and hummus." (difficulty β)0.2s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Baby carrots, Hummus β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Baby carrots and Hummus. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Baby carrots Γ1 (10 g) 4 cal Β· 0.1g P Β· 0.8g C Β· 0g F created food_log_entry: Hummus Γ1 (100 g) 166 cal Β· 7.9g P Β· 14.3g C Β· 9.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:04:42.418Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Lunch was a salad and a roll." (difficulty β)5.3s
Verdict Expected LOG β should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:04:58.866Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had rice, beans, and chicken." (difficulty β)0.4s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Beans, Cooked white rice, Chicken breast β card not captured.
Why verdict Logged (write-truth verified): Beans, Cooked white rice, Chicken breast β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked white rice, Beans, and Chicken breast. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ1 (100 g) 130 cal Β· 2.7g P Β· 28g C Β· 0.3g F created food_log_entry: Beans Γ1 (86 g) 109 cal Β· 7.5g P Β· 19.6g C Β· 0.4g F created food_log_entry: Chicken breast Γ1 (100 g) 165 cal Β· 31g P Β· 0g C Β· 3.6g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:05:10.468Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Track yogurt, granola, and honey." (difficulty β)0.7s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Honey, Plain Greek yogurt, Granola β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Plain Greek yogurt, Granola, and Honey. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Granola Γ1 (100 g) 471 cal Β· 10g P Β· 64g C Β· 20g F created food_log_entry: Honey Γ1 (21 g) 64 cal Β· 0.1g P Β· 17.3g C Β· 0g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:05:22.387Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Add eggs, bacon, and orange juice." (difficulty β)0.6s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Orange juice, Egg, Orange juice, Bacon β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged two eggs, Bacon, and Orange juice. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Egg Γ1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F created food_log_entry: Bacon Γ1 (24 g) 130 cal Β· 8.9g P Β· 0.3g C Β· 10.1g F created food_log_entry: Orange juice Γ1 (100 g) 45 cal Β· 0.7g P Β· 10.4g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:05:34.168Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I ate pasta and a side of broccoli." (difficulty β)0.7s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Broccoli, Cooked pasta, Cooked pasta, Broccoli β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Cooked pasta and Broccoli. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Broccoli Γ1 (100 g) 35 cal Β· 2.4g P Β· 7.2g C Β· 0.4g F created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F created food_log_entry: Broccoli Γ1 (100 g) 35 cal Β· 2.4g P Β· 7.2g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:05:46.034Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log a banana and peanut butter." (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Banana, Peanut butter β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a banana and Peanut butter. Assumed catalog default servings where you did not say an amount β tell me if that is not right.
3 Β· App data rows written created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: Peanut butter Γ1 (32 g) 188 cal Β· 8g P Β· 6.3g C Β· 16.1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:05:57.499Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Breakfast was cereal and milk." (difficulty β)1.6s
Verdict Expected LOG β should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:06:10.268Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I had an omelet with three eggs, one ounce of cheddar cheese and a tomato" (difficulty β)0.3s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Cheddar cheese, Egg, Tomato, Omelet β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Omelet. Includes three eggs, one ounce of cheddar cheese, and a tomato.
3 Β· App data rows written created food_log_entry: Omelet Γ1 (serving) 351 cal Β· 26.5g P Β· 6.8g C Β· 23.9g F created food_log_entry: Egg Γ1 (3 eggs) 215 cal Β· 18.9g P Β· 1g C Β· 14.3g F created food_log_entry: Cheddar cheese Γ1 (1 oz) 114 cal Β· 6.5g P Β· 1g C Β· 9.4g F created food_log_entry: Tomato Γ1 (1 tomato) 22 cal Β· 1.1g P Β· 4.8g C Β· 0.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:08:08.268Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"Log a protein shake with banana, peanut butter, and oats." (difficulty β)3.8s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Dry oats, Banana, peanut butter, Protein Shake β card not captured.
Why verdict Logged (write-truth verified): Dry oats, Banana, peanut butter, Protein Shake β card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.8s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Protein Shake. Includes one banana, peanut butter (1 serving), and Dry oats.
3 Β· App data rows written created food_log_entry: Protein Shake Γ1 (serving) 674 cal Β· 26.2g P Β· 111.4g C Β· 13.3g F created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: peanut butter Γ1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F created food_log_entry: Dry oats Γ1 (100 g) 389 cal Β· 16.9g P Β· 66.3g C Β· 6.9g F created food_log_entry: Protein Shake Γ1 (serving) 674 cal Β· 26.2g P Β· 111.4g C Β· 13.3g F created food_log_entry: Banana Γ1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F created food_log_entry: peanut butter Γ1 (serving) 180 cal Β· 8g P Β· 18g C Β· 6g F created food_log_entry: Dry oats Γ1 (100 g) 389 cal Β· 16.9g P Β· 66.3g C Β· 6.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:08:23.200Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"I had a salad with chicken, walnuts, and ranch." (difficulty β)2.1s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which walnuts should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:08:36.452Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Breakfast was an omelet with cheddar and olive oil." (difficulty β)1.7s
Verdict Expected LOG β should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:08:49.368Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"I made chili with beef, beans, tomatoes, and oil." (difficulty β)1.9s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS saidno speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:09:02.416Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Dinner was a burrito bowl with rice, beans, steak, and queso." (difficulty β)2.1s
Verdict Expected LOG β should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not finish that request safely.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:09:31.269Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"I had ramen with pork and egg." (difficulty β)0.4s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Pork? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:09:42.752Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Log a turkey sandwich with mayo and cheddar." (difficulty β)1.0s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I use for mayo?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:09:54.885Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould log the food"I built a yogurt bowl with granola, honey, and blueberries." (difficulty β)0.9s
Verdict Expected LOG β should log the food. PASS: Logged (write-truth verified): Honey, Blueberries, Yogurt Bowl, Granola β card not captured.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Yogurt Bowl. Includes granola, honey, and blueberries.
3 Β· App data rows written created food_log_entry: Yogurt Bowl Γ1 (serving) 619 cal Β· 11.1g P Β· 102.8g C Β· 20.4g F created food_log_entry: Granola Γ1 (100 g) 471 cal Β· 10g P Β· 64g C Β· 20g F created food_log_entry: Honey Γ1 (21 g) 64 cal Β· 0.1g P Β· 17.3g C Β· 0g F created food_log_entry: Blueberries Γ1 (148 g) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:10:06.950Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from a manually curated nutrition entry.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould log the food"Dinner was pad thai with chicken, peanuts, and bean sprouts." (difficulty β)1.8s
Verdict Expected LOG β should log the food. FAIL: OVER-ASK β asked instead of logging (no saved row).
Why verdict OVER-ASK β asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS saidno speech captured
2 Β· Card shown What should I use for peanuts?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:10:19.935Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add some oatmeal." (difficulty β)5.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Was the oatmeal or hot cereal plain, or did it have toppings like brown sugar, honey, fruit, or nuts? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:10:36.335Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had cereal." (difficulty β)0.3s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged High Fiber Bran Cereal β Codex Test Cereal β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: High Fiber Bran Cereal Γ1 (cup) 170 cal Β· 6g P Β· 38g C Β· 1g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:10:47.752Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log rice for dinner." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Cooked white rice? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:11:00.320Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track pasta." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged cooked pasta β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ1 (140 g) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:11:11.600Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate chips." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Was the potato plain, or did it have toppings like butter, sour cream, or cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:11:22.923Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add nuts." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for nuts? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:11:34.251Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log a bowl of soup." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a bowl of soup? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:11:48.236Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a plate of pasta." (difficulty β)12.0s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 12.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Was the pasta plain, or did it have sauce, butter, or oil? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:12:11.373Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track juice." (difficulty β)0.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Fruit Juice Blend, 100% Juice, 2. Apple Juice Beverage, 40-50% Juice, Light, 3. Orange Juice Beverage, 40-50% Juice, Light
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:12:22.949Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add coffee." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Coffee? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:12:34.219Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I drank wine." (difficulty β)0.9s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for wine? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:12:46.251Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log ice cream." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for Vanilla ice cream? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:12:57.517Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Had some trail mix." (difficulty β)1.4s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:13:10.168Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add popcorn." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown How much popcorn was it, and was it air-popped, microwave, movie theater, or made with oil or butter? I did not log it yet because popcorn amount and preparation can change the nutrition.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:13:21.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had a protein bar." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged a protein bar. Assumed 1 protein bar as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Generic protein bar Γ1 (1 protein bar) 200 cal Β· 20g P Β· 22g C Β· 7g F created food_log_entry: Generic protein bar Γ1 (1 protein bar) 200 cal Β· 20g P Β· 22g C Β· 7g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:13:32.816Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"Log a yogurt." (difficulty β)0.2s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged Plain Greek yogurt.
3 Β· App data rows written created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F created food_log_entry: Plain Greek yogurt Γ1 (100 g) 97 cal Β· 9g P Β· 3.9g C Β· 5g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:13:59.584Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track milk." (difficulty β)0.8s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged 2% milk β let me know if that's not right.
3 Β· App data rows written created food_log_entry: 2% milk Γ1 (1 cup) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:14:11.586Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a sandwich." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a sandwich? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:14:25.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a shake." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a shake? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:14:39.317Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"I had coffee with milk." (difficulty β)5.1s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. Coffee, Cappuccino, with Non-Dairy Milk, 2. Coffee, Latte, with Non-Dairy Milk, 3. Coffee, Latte, with Non-Dairy Milk, Flavored, 4. Coffee, Iced Latte, with Non-Dairy Milk, Flavored
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:14:55.535Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log bread." (difficulty β)1.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS saidno speech captured
2 Β· Card shown I logged Bread β let me know if that's not right.
3 Β· App data rows written created food_log_entry: Bread Γ1 (100 g) 265 cal Β· 9g P Β· 49g C Β· 3.2g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:15:08.418Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from the common-food list.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Track a burger." (difficulty β)5.3s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Hamburger? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:15:24.902Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould ask a clarifying question"I had pizza." (difficulty β)0.1s
Verdict Expected CLARIFY β should ask a clarifying question. FAIL: Logged a BLIND guess β no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged pizza β the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: pizza Γ1 (serving) 200 cal Β· 5g P Β· 20g C Β· 10g F
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:15:36.302Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Add a muffin." (difficulty β)2.7s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for a muffin? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:15:50.133Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould ask a clarifying question"Log my usual coffee size." (difficulty β)4.5s
Verdict Expected CLARIFY β should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS saidno speech captured
2 Β· Card shown I found a likely match for i had the usual lunch size, but I still need a clearer amount or product detail before I can log it. What exact food and amount should I use? I did not log it yet.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged breakfast portion. Using your saved "add the regular breakfast portion". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: breakfast portion Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged snack. Using your saved "track my default snack amount". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: snack Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Logged lunch. Using your saved "i had the usual lunch size". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: lunch Γ1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
{
"type": "food_default",
"phrase": "i had the usual lunch size",
"foodItemId": "seed-c-lunch-size",
"settings": {
"quickLogMode": "fixed",
"defaultQuantity": 1,
"defaultServingLabel": "serving",
"displayLabel": "i had the usual lunch size",
"confirmBeforeLog": false
}
}
snapshot captured 2026-07-30T20:16:39.468Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup method The answer used provisional food evidence from user default.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould complete the pending action"Half a cup." (difficulty β)1.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS saidno speech captured
2 Β· Card shown I couldn't find Half A Packaged Food in my nutrition database, so I haven't logged it β I'd only be guessing the nutrition. Say the exact name on the package, or tell me to log a generic packaged food.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:16:52.068Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"One cup, plain." (difficulty β)0.0s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:17:03.266Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"The Quest chocolate brownie." (difficulty β)5.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS saidno speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:17:20.252Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Two percent milk." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown How much should I log for 2% milk? I did not log it yet because the amount was not clear.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:17:31.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"No, that's not it β the plain one." (difficulty β)5.8s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.8s
1 Β· TTS saidno speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:17:48.485Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong one. The chocolate, not vanilla." (difficulty β)2.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.3s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not log chocolate β I still need the exact food name and amount. What should I use?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:18:02.035Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"No, not the sweetened yogurt." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:18:13.252Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
Verdict Expected DECLINE β should decline. PASS: Declined / no unwanted write.
Why verdict Declined / no unwanted write.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:19:00.052Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not the large β the small apple." (difficulty β)5.3s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.3s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Apple? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:19:16.502Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Wrong item. Pick the grilled chicken." (difficulty β)5.6s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.6s
1 Β· TTS saidno speech captured
2 Β· Card shown What exact food and amount should I use for Chicken breast? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:19:33.318Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"That's not it; the unsweetened one." (difficulty β)1.5s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not log it yet β the app needs the exact name and amount. What should I use for the unsweetened version?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:19:57.151Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould complete the pending action"No, the other yogurt." (difficulty β)0.1s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:20:08.382Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Not those almonds β the dry roasted." (difficulty β)8.0s
Verdict Expected CLARIFY_ANSWER β should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.0s
1 Β· TTS saidno speech captured
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:20:38.668Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the banana from earlier." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not find a list matching earlier. Which list has banana?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:01.068Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove that Quest bar." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:12.301Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the oatmeal entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:23.669Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take off the eggs." (difficulty β)0.3s
Verdict Expected DELETE β should delete the entry. FAIL: WRONG ACTION β created/logged a NEW entry on a DELETE request.
Why verdict WRONG ACTION β created/logged a NEW entry on a DELETE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted lunch.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:41.749Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the blueberries." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:46.332Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the chicken log." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:21:57.586Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Scratch the peanut butter." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:22:08.785Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the milk entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:22:19.985Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete that avocado I logged last night." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. FAIL: WRONG ACTION β created/logged a NEW entry on a DELETE request.
Why verdict WRONG ACTION β created/logged a NEW entry on a DELETE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted Avocado.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove yesterday's ice cream." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. FAIL: WRONG ACTION β created/logged a NEW entry on a DELETE request.
Why verdict WRONG ACTION β created/logged a NEW entry on a DELETE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted ice cream.
3 Β· App data rows written deleted food_log_entry:
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the leftover pizza entry." (difficulty β)0.1s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Take out the beer from last night." (difficulty β)1.2s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Remove the cookie log from earlier this week." (difficulty β)0.0s
Verdict Expected DELETE β should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not find a list matching earlier this week. Which list has cookie log?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould delete the entry"Delete the fries I shouldn't have logged." (difficulty β)0.2s
Verdict Expected DELETE β should delete the entry. FAIL: WRONG ACTION β created/logged a NEW entry on a DELETE request.
Why verdict WRONG ACTION β created/logged a NEW entry on a DELETE request.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS saidno speech captured
2 Β· Card shown Deleted fries.
3 Β· App data rows written deleted food_log_entry:
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:23:55.552Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually make the Quest bar two bars." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:06.752Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update the oatmeal to one and a half cups." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:17.985Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change the eggs to three." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:29.234Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Make the blueberries a half cup." (difficulty β)5.5s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.5s
1 Β· TTS saidno speech captured
2 Β· Card shown Which one did you mean? 1. blueberries, 2. one cup blueberries, 3. one cup blueberries as a snack
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:45.868Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update the chicken to six ounces." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:24:57.085Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Change peanut butter to two tablespoons." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:08.301Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually the milk was skim, not two percent." (difficulty β)0.1s
Verdict Expected UPDATE β should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:25:19.502Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Actually that was vanilla, not chocolate." (difficulty β)5.2s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.2s
1 Β· TTS saidno speech captured
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould update the entry"Update that to six ounces." (difficulty β)1.2s
Verdict Expected UPDATE β should update the entry. FAIL: Did not update (treated as new / not understood).
Why verdict Did not update (treated as new / not understood).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not find a list matching earlier. Which list has six ounces?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much protein have I had today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You logged 1125.6 grams of protein today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:26:44.335Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories so far?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:11.119Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I eat yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown No β I do not see yesterday logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:22.284Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much fat have I logged today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You logged 542.1 grams of fat today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:33.502Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's my remaining calorie budget?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown You are about 14940 calories over today's 2200 calorie budget (17140 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:44.701Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I log breakfast yet?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see breakfast logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:27:55.901Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many carbs today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You logged 2045.4 grams of carbs today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:07.102Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould answer the query"What did I eat after my workout?" (difficulty β)2.2s
Verdict Expected QUERY β should answer the query. FAIL: Query not answered β asked back instead of answering.
Why verdict Query not answered β asked back instead of answering.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS saidno speech captured
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:20.552Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Show me today's food log." (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:31.819Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Am I over my protein goal?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:43.134Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many calories in the banana I just logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Banana has about 105 calories per 118 g.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:28:54.452Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What was my last meal?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Your last food entry today was 1 serving snack.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:05.735Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How much water have I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Today you logged 1 240 g Water (0 calories).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:17.053Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Calories left for dinner?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You are about 14940 calories over today's 2200 calorie budget (17140 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:28.386Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"Did I already log my usual yogurt?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Yes. Today you logged 1 200 g Nonfat Greek yogurt, 1 cup Codex Test Dairy Vanilla Greek Yogurt Cup, 1 100 g Plain Greek yogurt, 1 100 g Plain Greek yogurt, 1 serving Yogurt Bowl, 1 100 g Plain Greek yogurt.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:39.685Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What's my average protein this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:29:50.952Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"How many entries do I have today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown You have 119 food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:02.235Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
UNVERIFIEDunclassifiedshould answer the query"What did I snack on earlier?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. UNVERIFIED: answer key has no expected values
Why verdict answer key has no expected values
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I do not see any snacks logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:13.520Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Open my food log." (difficulty β)0.1s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Opening Food History.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:24.852Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Go to nutrition settings." (difficulty β)0.1s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown Opening Food Prefs.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:36.120Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould apply the setting"Set my calorie goal to twenty two hundred." (difficulty β)0.1s
Verdict Expected SETTINGS β should apply the setting. FAIL: Reported could-not-confirm (write-confirmation false negative).
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS saidno speech captured
2 Β· Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-07-30T20:30:47.386Z
6 Β· Why this foodNo food-decision explanation was captured for this path.
7 Β· Lookup methodNo lookup method was captured for this path.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)