πŸ“Š Status Dashboard ↑ all runs

food-corpus-a-14385762-c56-20260802

food-corpus-a Β· 2 minutes ago Β· iOS sim
Rows
200
Pass
148 (74%)
Fail
50 (25%)
Unverified
2 (1%)
Pass rate
75%
Avg difficulty
β€”
"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β€” needs a human look (that's you πŸ‘/πŸ‘Ž-ing it). "Pass rate" = pass Γ· (pass + fail) β€” it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows). Unverified breaks down as: 2 unclassified β€” the "grader coverage gap" ones aren't ambiguous, the grader just doesn't fully score that intent type yet.

Why the fails happened β€” comprehension vs execution vs cosmetic

Comprehension β€” picked the wrong action/target (the hard problem)
49 (98%)
Execution β€” right decision, output broke (plumbing)
1 (2%)
Of 50 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.

Handled correctly? β€” by expected action

Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed toNCorrectWrongUnverified
β–Έ LOG β€” log the entry 12288 (72%) 34 (28%) 0 (0%)
β–Έ CLARIFY β€” ask a clarifying question 6152 (85%) 9 (15%) 0 (0%)
β–Έ CLARIFY_ANSWER β€” complete the pending action 51 (20%) 3 (60%) 1 (20%)
β–Έ NAVIGATE β€” navigate 44 (100%) 0 (0%) 0 (0%)
β–Έ SETTINGS β€” apply the setting 41 (25%) 3 (75%) 0 (0%)
β–Έ DELETE β€” delete the entry 21 (50%) 1 (50%) 0 (0%)
β–Έ UPDATE β€” update the entry 11 (100%) 0 (0%) 0 (0%)
β–Έ OTHER β€” handle appropriately 10 (0%) 0 (0%) 1 (100%)
Total200148 (75%)502

Accuracy by difficulty

Pending A1's per-utterance difficulty score (requested 2026-07-05) β€” this bar chart lights up once that lands.

Clarification follow-ups β€” scored separately

Second turn: app asked, we replied β€” did it resolve correctly?
Follow-ups
5
Resolved
1 (20%)
Mishandled
3 (60%)
Unverified
1

Cosmetic only

Not yet classified β€” pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.

System / infra

Not yet classified β€” pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.

Latency

Avg (time to ready)
0.9s
p90
2.6s
Max
9.5s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β€” click any dot to jump to its detail.
0s
1s
2s
5s
10s
Response path β€” quick (single response) vs async (an ack like "Working on it…" before the real answer).
Quick response
139
Sync clarification
61
Slowest 8 utterances (click to jump to detail):
"I had a bowl of cooked jasmine rice."9.5s
"I had a bowl of oatmeal."8.1s
"Stop asking me about bread."8.0s
"Search for low sugar protein bars."5.6s
"Track chicken salad on sourdough."5.4s
"Dinner was mac and cheese with bacon."5.2s
"Add some cottage cheese."4.5s
"I ate a bagel with cream cheese."4.5s

Filter β€” controls the list below

Pass / Fail / Unverified
PASS 148 FAIL 50 UNVERIFIED 2
Module (intended for)
Food (200)
Utterance sub-type (within module)
200 shown β€” 148 pass, 50 fail, 2 unverified

Per-utterance detail

PASSshould log the entry"I had one medium banana." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Banana β€” card not captured.
Why verdict Logged (write-truth verified): Banana β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium banana. Assumed 1 medium banana as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium banana. Assumed 1 medium banana as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Banana Γ—1 (1 medium banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:17:41.447Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Banana" at 90% confidence.
  • Matched your past food logs to "Medium Banana" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast was two hard boiled eggs." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Egg β€” card not captured.
Why verdict Logged (write-truth verified): Egg β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two hard boiled eggs.
2 Β· Card shown Logged two hard boiled eggs.
3 Β· App data rows written created food_log_entry: Egg Γ—1 (2 eggs) 143 cal Β· 12.6g P Β· 0.7g C Β· 9.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:17:52.757Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Egg" at 90% confidence.
  • Matched your past food logs to "Hard Boiled Eggs" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down four ounces grilled chicken breast." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Chicken breast β€” card not captured.
Why verdict Logged (write-truth verified): Chicken breast β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged four ounces grilled chicken breast.
2 Β· Card shown Logged four ounces grilled chicken breast.
3 Β· App data rows written created food_log_entry: Chicken breast Γ—1 (4 oz) 187 cal Β· 35.2g P Β· 0g C Β· 4.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:18:04.067Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one cup cooked white rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked white rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked white rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cooked white rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked white rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked white rice Γ—1 (1 cup) 205 cal Β· 4.3g P Β· 44.2g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:18:15.418Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked white rice" at 90% confidence.
  • Matched your past food logs to "Cooked Jasmine Rice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was a small apple." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Apple β€” card not captured.
Why verdict Logged (write-truth verified): Apple β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a small apple. Assumed 1 small apple as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a small apple. Assumed 1 small apple as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Apple Γ—1 (1 small apple) 77 cal Β· 0.4g P Β· 20.9g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:18:26.629Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Apple" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add half a cup cooked oatmeal." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged half a cup cooked oatmeal. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged half a cup cooked oatmeal. Assumed 0.5 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked oatmeal Γ—1 (0.5 cup) 83 cal Β· 2.9g P Β· 14g C Β· 1.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:18:38.100Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked oatmeal" at 90% confidence.
  • Matched your past food logs to "Cooked Oatmeal" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate five ounces baked salmon." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Salmon β€” card not captured.
Why verdict Logged (write-truth verified): Salmon β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged five ounces baked salmon.
2 Β· Card shown Logged five ounces baked salmon.
3 Β· App data rows written created food_log_entry: Salmon Γ—1 (5 oz) 295 cal Β· 28.3g P Β· 0g C Β· 18.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:18:49.382Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Salmon" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one cup blueberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blueberries, Blueberries β€” card not captured.
Why verdict Logged (write-truth verified): Blueberries, Blueberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup blueberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup blueberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Blueberries Γ—1 (1 cup) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:00.677Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Blueberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count twelve almonds." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Almonds β€” card not captured.
Why verdict Logged (write-truth verified): Almonds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged twelve almonds.
2 Β· Card shown Logged twelve almonds.
3 Β· App data rows written created food_log_entry: Almonds Γ—1 (12 almonds) 83 cal Β· 3.1g P Β· 3.1g C Β· 7.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:11.967Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Almonds" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Lunch included three ounces turkey breast." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey breast β€” card not captured.
Why verdict Logged (write-truth verified): Turkey breast β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three ounces turkey breast.
2 Β· Card shown Logged three ounces turkey breast.
3 Β· App data rows written created food_log_entry: Turkey breast Γ—1 (3 oz) 115 cal Β· 24.7g P Β· 0g C Β· 1.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:23.232Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Turkey breast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Finished one plain bagel." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Plain bagel β€” card not captured.
Why verdict Logged (write-truth verified): Plain bagel β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one plain bagel. Assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Assumed 1 plain bagel as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one plain bagel. Assumed a fresh/deli-size bagel; say packaged or Lender's if it was a bread-aisle bagel Assumed 1 plain bagel as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Plain bagel Γ—1 (1 plain bagel) 350 cal Β· 14g P Β· 67.2g C Β· 2.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:34.535Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain bagel" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Dinner was six ounces baked potato." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces baked potato.
2 Β· Card shown Logged six ounces baked potato.
3 Β· App data rows written created food_log_entry: Potato Γ—1 (6 oz) 148 cal Β· 3.2g P Β· 34.2g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:45.881Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Potato" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save one cup steamed broccoli." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Broccoli β€” card not captured.
Why verdict Logged (write-truth verified): Broccoli β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup steamed broccoli. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup steamed broccoli. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Broccoli Γ—1 (1 cup) 55 cal Β· 3.8g P Β· 11.3g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:19:57.199Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Broccoli" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I drank eight ounces orange juice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Orange juice β€” card not captured.
Why verdict Logged (write-truth verified): Orange juice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged eight ounces orange juice.
2 Β· Card shown Logged eight ounces orange juice.
3 Β· App data rows written created food_log_entry: Orange juice Γ—1 (8 oz) 102 cal Β· 1.6g P Β· 23.6g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:20:08.515Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Orange juice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Note two slices turkey bacon." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey bacon β€” card not captured.
Why verdict Logged (write-truth verified): Turkey bacon β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged note two slices turkey bacon.
2 Β· Card shown Logged note two slices turkey bacon.
3 Β· App data rows written created food_log_entry: Turkey bacon Γ—1 (2 slices) 60 cal Β· 8.1g P Β· 1g C Β· 3.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:20:19.973Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Turkey bacon" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Supper was one cup cooked lentils." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Lentils β€” card not captured.
Why verdict Logged (write-truth verified): Lentils β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup cooked lentils. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked lentils. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Lentils Γ—1 (1 cup) 230 cal Β· 17.8g P Β· 39.8g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:20:31.377Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Lentils" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Enter one large orange." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Orange β€” card not captured.
Why verdict Logged (write-truth verified): Orange β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one large orange. Assumed 1 large orange as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one large orange. Assumed 1 large orange as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Orange Γ—1 (1 large orange) 86 cal Β· 1.7g P Β· 21.7g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:20:42.669Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Orange" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Ate a quarter cup raisins." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Raisins β€” card not captured.
Why verdict Logged (write-truth verified): Raisins β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged ate a quarter cup raisins. Assumed 0.25 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged ate a quarter cup raisins. Assumed 0.25 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Raisins Γ—1 (0.25 cup) 108 cal Β· 1.1g P Β· 28.7g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:20:54.103Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Raisins" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one tablespoon peanut butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Peanut butter β€” card not captured.
Why verdict Logged (write-truth verified): Peanut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon peanut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon peanut butter. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Peanut butter Γ—1 (1 tbsp) 88 cal Β· 3.8g P Β· 2.9g C Β· 7.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:21:05.387Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Peanut butter" at 90% confidence.
  • Matched your past food logs to "Home default Cooked Oatmeal with Peanut Butter" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was three quarters cup green beans." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Green beans β€” card not captured.
Why verdict Logged (write-truth verified): Green beans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged three quarters cup green beans.
2 Β· Card shown Logged three quarters cup green beans.
3 Β· App data rows written created food_log_entry: Green beans Γ—1 (0.75 cup) 33 cal Β· 1.8g P Β· 7.4g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:21:16.970Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Green beans" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one and a quarter cups strawberries." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Strawberries β€” card not captured.
Why verdict Logged (write-truth verified): Strawberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged one and a quarter cups strawberries. Assumed 1.25 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one and a quarter cups strawberries. Assumed 1.25 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Strawberries Γ—1 (1.25 cup) 61 cal Β· 1.3g P Β· 14.6g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:21:39.984Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Strawberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put in two hundred grams nonfat Greek yogurt." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Nonfat Greek yogurt β€” card not captured.
Why verdict Logged (write-truth verified): Nonfat Greek yogurt β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two hundred grams nonfat greek yogurt.
2 Β· Card shown Logged two hundred grams nonfat greek yogurt.
3 Β· App data rows written created food_log_entry: Nonfat Greek yogurt Γ—1 (200 g) 118 cal Β· 20.6g P Β· 7.2g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:21:51.286Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Nonfat Greek yogurt" at 90% confidence.
  • Matched your past food logs to "Greek Yogurt" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one cup two percent milk." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): 2% milk β€” card not captured.
Why verdict Logged (write-truth verified): 2% milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged one cup two percent milk.
2 Β· Card shown Logged one cup two percent milk.
3 Β· App data rows written created food_log_entry: 2% milk Γ—1 (1 cup) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:22:02.724Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "2% milk" at 90% confidence.
  • Matched your past food logs to "2 Percent Milk" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast was one cup low fat cottage cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): 1% cottage cheese β€” card not captured.
Why verdict Logged (write-truth verified): 1% cottage cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup low fat cottage cheese. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup low fat cottage cheese. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: 1% cottage cheese Γ—1 (1 cup) 163 cal Β· 28g P Β· 6.1g C Β· 2.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:22:14.032Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "1% cottage cheese" at 90% confidence.
  • Matched your past food logs to "Codex Test Dairy Low Fat Cottage Cheese" at 82% confidence.
  • Matched your saved foods and aliases to "Generic Low-Fat Cottage Cheese" at 59% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count one medium corn tortilla." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Corn tortilla β€” card not captured.
Why verdict Logged (write-truth verified): Corn tortilla β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one medium corn tortilla. Assumed 1 medium corn tortilla as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one medium corn tortilla. Assumed 1 medium corn tortilla as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Corn tortilla Γ—1 (1 medium corn tortilla) 61 cal Β· 1.6g P Β· 12.5g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:22:25.341Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Corn tortilla" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was one blueberry RX bar." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one blueberry rx bar? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one blueberry rx bar? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:22:39.194Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had one blueberry are ex bar." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for one blueberry are ex bar? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one blueberry are ex bar? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:22:53.046Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Finished one Fairlife Core Power chocolate 42 gram bottle." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:23:06.097Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count one fare life core power vanilla shake." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Fairlife Core Power Elite Vanilla Protein Shake β€” card not captured.
Why verdict Logged (write-truth verified): Fairlife Core Power Elite Vanilla Protein Shake β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Logged Fairlife Core Power Elite Vanilla Protein Shake with an estimated macro range.
2 Β· Card shown Logged Fairlife Core Power Elite Vanilla Protein Shake β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Fairlife Core Power Elite Vanilla Protein Shake Γ—1 (one) 230 cal Β· 42g P Β· 8g C Β· 3.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:23:18.248Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one Chobani zero sugar vanilla cup." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Zero Sugar Vanilla Yogurt β€” card not captured.
Why verdict Logged (write-truth verified): Zero Sugar Vanilla Yogurt β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Got it, I logged Zero Sugar Vanilla Yogurt β€” Chobani.
2 Β· Card shown I logged Zero Sugar Vanilla Yogurt β€” Chobani β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Zero Sugar Vanilla Yogurt Γ—1 (cup) 120 cal Β· 15g P Β· 9g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:23:29.841Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Enter one shobani zero sugar strawberry yogurt." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG item/product identity "chobani zero sugar strawberry yogurt" β€” saved row does not hit product alias (rows: Zero Sugar Vanilla Yogurt)
Why verdict WRITE-TRUTH FAIL β€” WRONG item/product identity "chobani zero sugar strawberry yogurt" β€” saved row does not hit product alias (rows: Zero Sugar Vanilla Yogurt)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Got it, I logged Chobani Zero Sugar Vanilla Yogurt.
2 Β· Card shown I logged Chobani Zero Sugar Vanilla Yogurt β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Zero Sugar Vanilla Yogurt Γ—1 (cup) 120 cal Β· 15g P Β· 9g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:23:41.213Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save one Quest chocolate brownie protein bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Quest Chocolate Brownie Protein Bar with an estimated macro range.
2 Β· Card shown Logged Quest Chocolate Brownie Protein Bar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Quest Chocolate Brownie Protein Bar Γ—1 (1 serving) 170 cal Β· 20g P Β· 19g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:23:53.001Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Had one kwest cookies cream bar." (difficulty β€”)2.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for had one kwest cookies cream bar? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for had one kwest cookies cream bar? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:24:06.835Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was two slices Dave's Killer Bread 21 Whole Grains." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 2310 kcal is implausibly HIGH for 2 count of Dave's Killer Bread 21 Whole Grains (typical 160-260 kcal [per-serving])
Why verdict WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 2310 kcal is implausibly HIGH for 2 count of Dave's Killer Bread 21 Whole Grains (typical 160-260 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Bread and Dave's Killer Bread 21 Whole Grains β€” Dave's Killer Bread. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Bread and Dave's Killer Bread 21 Whole Grains β€” Dave's Killer Bread. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Bread Γ—2 (100 g) 530 cal Β· 18g P Β· 98g C Β· 6.4g F
created food_log_entry: Dave's Killer Bread 21 Whole Grains Γ—21 (slice) 2310 cal Β· 105g P Β· 462g C Β· 42g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:24:18.650Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Record two slices Dave's killer bred twenty one whole grains." (difficulty β€”)2.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I need to resolve one whole grains before I log this meal. What should I use for one whole grains?
2 Β· Card shown I need to resolve one whole grains before I log this meal. What should I use for one whole grains?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:24:31.765Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate one KIND dark chocolate nuts and sea salt bar." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): No Cow Chocolate Sea Salt Bar, Dark chocolate β€” card not captured.
Why verdict Logged (write-truth verified): No Cow Chocolate Sea Salt Bar, Dark chocolate β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Dark chocolate and No Cow Chocolate Sea Salt Bar β€” No Cow. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
2 Β· Card shown Logged Dark chocolate and No Cow Chocolate Sea Salt Bar β€” No Cow. Assumed catalog default servings where you did not say an amount β€” tell me if that is not right.
3 Β· App data rows written created food_log_entry: Dark chocolate Γ—1 (100 g) 550 cal Β· 5.1g P Β· 60g C Β· 32.2g F
created food_log_entry: No Cow Chocolate Sea Salt Bar Γ—1 (1 bar (60 g)) 210 cal Β· 20g P Β· 23g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:24:43.311Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was one Larabar apple pie bar." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 198 kcal is implausibly HIGH for 1 count of Apple Pie Fruit & Nut Bar (typical 60-130 kcal [per-serving])
Why verdict WRITE-TRUTH FAIL β€” IMPLAUSIBLE: 198 kcal is implausibly HIGH for 1 count of Apple Pie Fruit & Nut Bar (typical 60-130 kcal [per-serving])
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Apple Pie Fruit & Nut Bar β€” Larabar with an estimated macro range.
2 Β· Card shown Logged Apple Pie Fruit & Nut Bar β€” Larabar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Apple Pie Fruit & Nut Bar Γ—1 (1 bar (45 g)) 198 cal Β· 4.1g P Β· 24.8g C Β· 9.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:24:54.852Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add one packet Quaker instant oatmeal maple brown sugar." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Quaker Maple & Brown Sugar Instant Oatmeal β€” card not captured.
Why verdict Logged (write-truth verified): Quaker Maple & Brown Sugar Instant Oatmeal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Quaker Maple & Brown Sugar Instant Oatmeal.
2 Β· Card shown Logged Quaker Maple & Brown Sugar Instant Oatmeal.
3 Β· App data rows written created food_log_entry: Quaker Maple & Brown Sugar Instant Oatmeal Γ—1 (one packet) 160 cal Β· 4g P Β· 33g C Β· 2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:25:06.665Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was one Siggi's vanilla skyr cup." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Which one did you mean? 1. Vanilla Simple Ingredient Skyr Lowfat Yogurt β€” SIGGI'S, 2. Vanilla Icelandic Cream-Skyr Strained Lowfat Yogurt β€” SIGGI'S, 3. Vanilla Icelandic Cream-Skyr Strained Whole Milk Yogurt β€” SIGGI'S, 4. Skyr Vanilla Yogurt β€” Siggi’s
2 Β· Card shown Which one did you mean? 1. Vanilla Simple Ingredient Skyr Lowfat Yogurt β€” SIGGI'S, 2. Vanilla Icelandic Cream-Skyr Strained Lowfat Yogurt β€” SIGGI'S, 3. Vanilla Icelandic Cream-Skyr Strained Whole Milk Yogurt β€” SIGGI'S, 4. Skyr Vanilla Yogurt β€” Siggi’s
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:25:18.747Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put down one Fage total 0 percent Greek yogurt cup." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/EXTRA item(s) written in addition to the requested food: Nonfat Greek yogurt
Why verdict WRITE-TRUTH FAIL β€” WRONG/EXTRA item(s) written in addition to the requested food: Nonfat Greek yogurt
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Fage Total 0% Milkfat β€” FAGE and Nonfat Greek yogurt. Assumed a typical serving of Nonfat Greek yogurt while logging the rest of this meal. Tell me if that is not right.
2 Β· Card shown Logged Fage Total 0% Milkfat β€” FAGE and Nonfat Greek yogurt. Assumed a typical serving of Nonfat Greek yogurt while logging the rest of this meal. Tell me if that is not right.
3 Β· App data rows written created food_log_entry: Fage Total 0% Milkfat Γ—1 (1 portion (170 g)) 90 cal Β· 18g P Β· 4.9g C Β· 0g F
created food_log_entry: Nonfat Greek yogurt Γ—1 (1 cup) 145 cal Β· 25.2g P Β· 8.8g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:25:30.528Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I drank one Premier Protein caramel shake." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Caramel High Protein Shake β€” card not captured.
Why verdict Logged (write-truth verified): Caramel High Protein Shake β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Logged Caramel High Protein Shake β€” premier protein with an estimated macro range.
2 Β· Card shown Logged Caramel High Protein Shake β€” premier protein β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Caramel High Protein Shake Γ—1 (1 portion (311.844 g)) 159 cal Β· 29.9g P Β· 1.9g C Β· 3.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:25:54.137Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Finished one Clif chocolate chip bar." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Which type of Clif chocolate chip bar was it? There are several with different nutrition.
2 Β· Card shown Which type of Clif chocolate chip bar was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:26:05.785Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Ate one Babybel original cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Babybel β€” card not captured.
Why verdict Logged (write-truth verified): Babybel β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged ate one babybel original cheese. Assumed 1 babybel original cheese as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged ate one babybel original cheese. Assumed 1 babybel original cheese as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Babybel Γ—1 (1 babybel original cheese) 70 cal Β· 5g P Β· 0g C Β· 5.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:26:17.060Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Babybel" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one packet Justin's almond butter." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): JUSTIN'S Classic Almond Butter, Classic β€” card not captured.
Why verdict Logged (write-truth verified): JUSTIN'S Classic Almond Butter, Classic β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged JUSTIN'S Classic Almond Butter, Classic.
2 Β· Card shown Logged JUSTIN'S Classic Almond Butter, Classic.
3 Β· App data rows written created food_log_entry: JUSTIN'S Classic Almond Butter, Classic Γ—1 (one tablespoon) 110 cal Β· 3g P Β· 2.5g C Β· 9.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:26:28.623Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count one Stonyfield organic strawberry yogurt cup." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Organic Nonfat Greek Yogurt Strawberry β€” card not captured.
Why verdict Logged (write-truth verified): Organic Nonfat Greek Yogurt Strawberry β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Logged Organic Nonfat Greek Yogurt Strawberry β€” Stonyfield.
2 Β· Card shown Logged Organic Nonfat Greek Yogurt Strawberry β€” Stonyfield.
3 Β· App data rows written created food_log_entry: Organic Nonfat Greek Yogurt Strawberry Γ—1 (1 container (113 g)) 90 cal Β· 9g P Β· 14g C Β· 0g F
created food_log_entry: Organic Nonfat Greek Yogurt Strawberry Γ—1 (1 container (113 g)) 90 cal Β· 9g P Β· 14g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:26:40.794Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my usual Quest bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): Quest Chocolate Brownie Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Quest Quest Chocolate Brownie Protein Bar. Using your saved "my usual quest bar". Tell me if that is wrong.
2 Β· Card shown Logged Quest Quest Chocolate Brownie Protein Bar. Using your saved "my usual quest bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Quest Chocolate Brownie Protein Bar Γ—1 (bar) 190 cal Β· 20g P Β· 21g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Quest Quest Chocolate Brownie Protein Bar
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-quest-chocolate-brownie-bar",
        "name": "Quest Chocolate Brownie Protein Bar",
        "brand": "Quest",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 190,
          "proteinGrams": 20,
          "fatGrams": 7,
          "carbsGrams": 21
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual Quest bar",
      "foodItemId": "seed-quest-chocolate-brownie-bar",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bar",
        "displayLabel": "my usual Quest bar",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-quest-chocolate-brownie-bar at 2026-06-09T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-quest-chocolate-brownie-bar",
      "quantity": 1,
      "loggedAt": "2026-06-09T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:26:52.038Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual quest bar" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my blue RX." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): RXBAR Blueberry β€” card not captured.
Why verdict Logged (write-truth verified): RXBAR Blueberry β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged RXBAR RXBAR Blueberry. Using your saved "my blue rx". Tell me if that is wrong.
2 Β· Card shown Logged RXBAR RXBAR Blueberry. Using your saved "my blue rx". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: RXBAR Blueberry Γ—1 (bar) 210 cal Β· 12g P Β· 25g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: RXBAR RXBAR Blueberry
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-rxbar-blueberry-bar",
        "name": "RXBAR Blueberry",
        "brand": "RXBAR",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 210,
          "proteinGrams": 12,
          "fatGrams": 8,
          "carbsGrams": 25
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my blue RX",
      "foodItemId": "seed-rxbar-blueberry-bar",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bar",
        "displayLabel": "my blue RX",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:27:03.279Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was my normal oatmeal." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Oatmeal. Using your saved "my normal oatmeal". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Oatmeal. Using your saved "my normal oatmeal". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Oatmeal Γ—1 (cup) 150 cal Β· 6g P Β· 27g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Oatmeal
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-cooked-oatmeal",
        "name": "Cooked Oatmeal",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 6,
          "fatGrams": 3,
          "carbsGrams": 27
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my normal oatmeal",
      "foodItemId": "seed-cooked-oatmeal",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my normal oatmeal",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:27:14.485Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my normal oatmeal" at 96% confidence.
  • Matched the common-food list to "Cooked oatmeal" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put down my protein powder." (difficulty β€”)1.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said What would you like me to do with that?
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Nutrition Vanilla Protein Powder
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-vanilla-protein-powder",
        "name": "Vanilla Protein Powder",
        "brand": "Codex Test Nutrition",
        "source": "manual",
        "servingLabel": "scoop",
        "servingQuantity": 1,
        "servingUnit": "scoop",
        "macrosPerServing": {
          "calories": 120,
          "proteinGrams": 24,
          "fatGrams": 2,
          "carbsGrams": 3
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my protein powder",
      "foodItemId": "seed-vanilla-protein-powder",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "scoop",
        "displayLabel": "my protein powder",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:27:27.546Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my protein powder" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had my usual yogurt." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Vanilla Greek Yogurt Cup β€” card not captured.
Why verdict Logged (write-truth verified): Vanilla Greek Yogurt Cup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Dairy Vanilla Greek Yogurt Cup. Using your saved "my usual yogurt". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Vanilla Greek Yogurt Cup. Using your saved "my usual yogurt". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Vanilla Greek Yogurt Cup Γ—1 (cup) 130 cal Β· 15g P Β· 12g C Β· 0g F
created food_log_entry: Vanilla Greek Yogurt Cup Γ—1 (cup) 130 cal Β· 15g P Β· 12g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Vanilla Greek Yogurt Cup
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-vanilla-greek-yogurt-cup",
        "name": "Vanilla Greek Yogurt Cup",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 130,
          "proteinGrams": 15,
          "fatGrams": 0,
          "carbsGrams": 12
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual yogurt",
      "foodItemId": "seed-vanilla-greek-yogurt-cup",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual yogurt",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:27:38.801Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual yogurt" at 96% confidence.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
  • Matched your past food logs to "Nonfat Greek yogurt" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Snack was my trail mix serving." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Pantry House Trail Mix
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-trail-mix-30g",
        "name": "House Trail Mix",
        "brand": "Codex Test Pantry",
        "source": "manual",
        "servingLabel": "30 grams",
        "servingQuantity": 1,
        "servingUnit": "grams",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 5,
          "fatGrams": 10,
          "carbsGrams": 14
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my trail mix serving",
      "foodItemId": "seed-trail-mix-30g",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "30 grams",
        "displayLabel": "my trail mix serving",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:27:50.000Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my trail mix serving" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count my morning shake." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Morning Shake Recipe β€” card not captured.
Why verdict Logged (write-truth verified): Morning Shake Recipe β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Recipe Morning Shake Recipe. Using your saved "my morning shake". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Morning Shake Recipe. Using your saved "my morning shake". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Morning Shake Recipe Γ—1 (shake) 310 cal Β· 32g P Β· 28g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Recipe Morning Shake Recipe
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-morning-shake-recipe",
        "name": "Morning Shake Recipe",
        "brand": "Codex Test Recipe",
        "source": "manual",
        "servingLabel": "shake",
        "servingQuantity": 1,
        "servingUnit": "shake",
        "macrosPerServing": {
          "calories": 310,
          "proteinGrams": 32,
          "fatGrams": 9,
          "carbsGrams": 28
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my morning shake",
      "foodItemId": "seed-morning-shake-recipe",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "shake",
        "displayLabel": "my morning shake",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:28:01.228Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my morning shake" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Lunch was my usual tuna packet." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Tuna Packet β€” card not captured.
Why verdict Logged (write-truth verified): Tuna Packet β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Pantry Tuna Packet. Using your saved "my usual tuna packet". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Pantry Tuna Packet. Using your saved "my usual tuna packet". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Tuna Packet Γ—1 (packet) 100 cal Β· 22g P Β· 0g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Pantry Tuna Packet
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-tuna-packet",
        "name": "Tuna Packet",
        "brand": "Codex Test Pantry",
        "source": "manual",
        "servingLabel": "packet",
        "servingQuantity": 1,
        "servingUnit": "packet",
        "macrosPerServing": {
          "calories": 100,
          "proteinGrams": 22,
          "fatGrams": 1,
          "carbsGrams": 0
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual tuna packet",
      "foodItemId": "seed-tuna-packet",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "packet",
        "displayLabel": "my usual tuna packet",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:28:12.488Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual tuna packet" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add the same cottage cheese as yesterday." (difficulty β€”)1.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said I hear more than one saved version that could match "the same cottage cheese as yesterday". Which exact food and amount should I log?
2 Β· Card shown I hear more than one saved version that could match "the same cottage cheese as yesterday". Which exact food and amount should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Dairy Low Fat Cottage Cheese
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-low-fat-cottage-cheese",
        "name": "Low Fat Cottage Cheese",
        "brand": "Codex Test Dairy",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 28,
          "fatGrams": 2,
          "carbsGrams": 8
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • Seed food history: 0.5 for seed-low-fat-cottage-cheese at 2026-06-09T13:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-low-fat-cottage-cheese",
      "quantity": 0.5,
      "loggedAt": "2026-06-09T13:00:00.000Z"
    }
snapshot captured 2026-08-02T10:28:24.577Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cottage cheese" at 90% confidence.
  • Matched your past food logs to "1% cottage cheese" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record the same cereal as Monday." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): High Fiber Bran Cereal β€” card not captured.
Why verdict Logged (write-truth verified): High Fiber Bran Cereal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Cereal High Fiber Bran Cereal. Using your recent Codex Test Cereal High Fiber Bran Cereal history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cereal High Fiber Bran Cereal. Using your recent Codex Test Cereal High Fiber Bran Cereal history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: High Fiber Bran Cereal Γ—1 (cup) 170 cal Β· 6g P Β· 38g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Cereal High Fiber Bran Cereal
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-bran-cereal",
        "name": "High Fiber Bran Cereal",
        "brand": "Codex Test Cereal",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 170,
          "proteinGrams": 6,
          "fatGrams": 1,
          "carbsGrams": 38
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-bran-cereal at 2026-06-08T12:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-bran-cereal",
      "quantity": 1,
      "loggedAt": "2026-06-08T12:00:00.000Z"
    }
snapshot captured 2026-08-02T10:28:35.938Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I had my standard toast." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: WRONG item vs seeded default/key β€” WRONG/MISSING item "seeded toast" β€” no saved row with matching identity (rows: Dave's Killer Bread 21 Whole Grains)
Why verdict WRONG item vs seeded default/key β€” WRONG/MISSING item "seeded toast" β€” no saved row with matching identity (rows: Dave's Killer Bread 21 Whole Grains)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Dave's Killer Bread Dave's Killer Bread 21 Whole Grains. Using your saved "my standard toast". Tell me if that is wrong.
2 Β· Card shown Logged Dave's Killer Bread Dave's Killer Bread 21 Whole Grains. Using your saved "my standard toast". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Dave's Killer Bread 21 Whole Grains Γ—2 (slice) 220 cal Β· 10g P Β· 44g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Dave's Killer Bread Dave's Killer Bread 21 Whole Grains
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-daves-killer-bread-21-whole-grains",
        "name": "Dave's Killer Bread 21 Whole Grains",
        "brand": "Dave's Killer Bread",
        "source": "manual",
        "servingLabel": "slice",
        "servingQuantity": 1,
        "servingUnit": "slice",
        "macrosPerServing": {
          "calories": 110,
          "proteinGrams": 5,
          "fatGrams": 2,
          "carbsGrams": 22
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my standard toast",
      "foodItemId": "seed-daves-killer-bread-21-whole-grains",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 2,
        "defaultServingLabel": "slice",
        "displayLabel": "my standard toast",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:28:47.187Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Toast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Save my afternoon bar." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Afternoon Bar β€” card not captured.
Why verdict Logged (write-truth verified): Afternoon Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Afternoon Bar. Using your saved "afternoon bar". Tell me if that is wrong.
2 Β· Card shown Logged Afternoon Bar. Using your saved "afternoon bar". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Afternoon Bar Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_alias
    {
      "type": "saved_food_alias",
      "phrase": "afternoon bar",
      "expected_item": "seeded afternoon bar"
    }
snapshot captured 2026-08-02T10:28:58.437Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "afternoon bar" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner side was my usual rice." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked Jasmine Rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Jasmine Rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
2 Β· Card shown Logged Cooked Jasmine Rice. Using your saved "my usual rice". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Jasmine Rice Γ—1 (cup) 205 cal Β· 4g P Β· 45g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Cooked Jasmine Rice
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-cooked-jasmine-rice",
        "name": "Cooked Jasmine Rice",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 205,
          "proteinGrams": 4,
          "fatGrams": 0,
          "carbsGrams": 45
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual rice",
      "foodItemId": "seed-cooked-jasmine-rice",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my usual rice",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:29:09.657Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual rice" at 96% confidence.
  • Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add another one of the banana from breakfast." (difficulty β€”)0.3s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Medium Banana β€” card not captured.
Why verdict Logged (write-truth verified): Medium Banana β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Logged Medium Banana. Using your recent Medium Banana history. Tell me if that is wrong.
2 Β· Card shown Logged Medium Banana. Using your recent Medium Banana history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Medium Banana Γ—1 (banana) 105 cal Β· 1.3g P Β· 27g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Medium Banana
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-medium-banana",
        "name": "Medium Banana",
        "brand": null,
        "source": "manual",
        "servingLabel": "banana",
        "servingQuantity": 1,
        "servingUnit": "banana",
        "macrosPerServing": {
          "calories": 105,
          "proteinGrams": 1.3,
          "fatGrams": 0.4,
          "carbsGrams": 27
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-medium-banana at 2026-06-10T08:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-medium-banana",
      "quantity": 1,
      "loggedAt": "2026-06-10T08:00:00.000Z"
    }
snapshot captured 2026-08-02T10:29:21.054Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Banana" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I finished the other Fairlife." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
Why verdict WRITE-TRUTH FAIL β€” expected food write missing β€” local foodEntries delta is 0 for this turn (proven no food write, not a capture gap)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not find a to-do matching other Fairlife.
2 Β· Card shown I could not find a to-do matching other Fairlife.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Fairlife Fairlife Core Power Vanilla Protein Shake
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-fairlife-core-power-vanilla-bottle",
        "name": "Fairlife Core Power Vanilla Protein Shake",
        "brand": "Fairlife",
        "source": "manual",
        "servingLabel": "bottle",
        "servingQuantity": 1,
        "servingUnit": "bottle",
        "macrosPerServing": {
          "calories": 170,
          "proteinGrams": 26,
          "fatGrams": 4,
          "carbsGrams": 8
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "the other Fairlife",
      "foodItemId": "seed-fairlife-core-power-vanilla-bottle",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bottle",
        "displayLabel": "the other Fairlife",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:29:32.238Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Fairlife Nutrition Plan Chocolate Shake" at 76% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track my usual almonds." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Almonds β€” card not captured.
Why verdict Logged (write-truth verified): Almonds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Almonds. Using your saved "my usual almonds". Tell me if that is wrong.
2 Β· Card shown Logged Almonds. Using your saved "my usual almonds". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Almonds Γ—1 (20 almonds) 140 cal Β· 5g P Β· 5g C Β· 12g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Almonds
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-almonds-20-count",
        "name": "Almonds",
        "brand": null,
        "source": "manual",
        "servingLabel": "20 almonds",
        "servingQuantity": 1,
        "servingUnit": "almonds",
        "macrosPerServing": {
          "calories": 140,
          "proteinGrams": 5,
          "fatGrams": 12,
          "carbsGrams": 5
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual almonds",
      "foodItemId": "seed-almonds-20-count",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "20 almonds",
        "displayLabel": "my usual almonds",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:29:54.937Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual almonds" at 96% confidence.
  • Matched the common-food list to "Almonds" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down my breakfast eggs." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Hard Boiled Eggs, Hard Boiled Eggs β€” card not captured.
Why verdict Logged (write-truth verified): Hard Boiled Eggs, Hard Boiled Eggs β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Hard Boiled Eggs. Using your saved "my breakfast eggs". Tell me if that is wrong.
2 Β· Card shown Logged Hard Boiled Eggs. Using your saved "my breakfast eggs". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Hard Boiled Eggs Γ—1 (2 eggs) 156 cal Β· 12g P Β· 1g C Β· 10g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Hard Boiled Eggs
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-hard-boiled-eggs-two",
        "name": "Hard Boiled Eggs",
        "brand": null,
        "source": "manual",
        "servingLabel": "2 eggs",
        "servingQuantity": 1,
        "servingUnit": "eggs",
        "macrosPerServing": {
          "calories": 156,
          "proteinGrams": 12,
          "fatGrams": 10,
          "carbsGrams": 1
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my breakfast eggs",
      "foodItemId": "seed-hard-boiled-eggs-two",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "2 eggs",
        "displayLabel": "my breakfast eggs",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:30:06.268Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my breakfast eggs" at 96% confidence.
  • Matched the common-food list to "Egg" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had the regular smoothie." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Regular Smoothie Recipe β€” card not captured.
Why verdict Logged (write-truth verified): Regular Smoothie Recipe β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Recipe Regular Smoothie Recipe. Using your saved "the regular smoothie". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Recipe Regular Smoothie Recipe. Using your saved "the regular smoothie". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Regular Smoothie Recipe Γ—1 (smoothie) 280 cal Β· 18g P Β· 42g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Recipe Regular Smoothie Recipe
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-regular-smoothie-recipe",
        "name": "Regular Smoothie Recipe",
        "brand": "Codex Test Recipe",
        "source": "manual",
        "servingLabel": "smoothie",
        "servingQuantity": 1,
        "servingUnit": "smoothie",
        "macrosPerServing": {
          "calories": 280,
          "proteinGrams": 18,
          "fatGrams": 6,
          "carbsGrams": 42
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "the regular smoothie",
      "foodItemId": "seed-regular-smoothie-recipe",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "smoothie",
        "displayLabel": "the regular smoothie",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:30:17.562Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "the regular smoothie" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my default milk." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): 2 Percent Milk β€” card not captured.
Why verdict Logged (write-truth verified): 2 Percent Milk β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged 2 Percent Milk. Using your saved "my default milk". Tell me if that is wrong.
2 Β· Card shown Logged 2 Percent Milk. Using your saved "my default milk". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: 2 Percent Milk Γ—1 (cup) 122 cal Β· 8g P Β· 12g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: 2 Percent Milk
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-two-percent-milk",
        "name": "2 Percent Milk",
        "brand": null,
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 122,
          "proteinGrams": 8,
          "fatGrams": 5,
          "carbsGrams": 12
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my default milk",
      "foodItemId": "seed-two-percent-milk",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my default milk",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:30:28.757Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my default milk" at 96% confidence.
  • Matched the common-food list to "Milk" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Same protein bar as yesterday." (difficulty β€”)0.8s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Chocolate Peanut Protein Bar" β€” no saved row with matching identity (rows: Quest Chocolate Brownie Protein Bar)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Chocolate Peanut Protein Bar" β€” no saved row with matching identity (rows: Quest Chocolate Brownie Protein Bar)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Logged Quest Quest Chocolate Brownie Protein Bar. Using your recent Quest Quest Chocolate Brownie Protein Bar history. Tell me if that is wrong.
2 Β· Card shown Logged Quest Quest Chocolate Brownie Protein Bar. Using your recent Quest Quest Chocolate Brownie Protein Bar history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Quest Chocolate Brownie Protein Bar Γ—1 (bar) 190 cal Β· 20g P Β· 21g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Codex Test Pantry Chocolate Peanut Protein Bar
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-yesterday-protein-bar",
        "name": "Chocolate Peanut Protein Bar",
        "brand": "Codex Test Pantry",
        "source": "manual",
        "servingLabel": "bar",
        "servingQuantity": 1,
        "servingUnit": "bar",
        "macrosPerServing": {
          "calories": 210,
          "proteinGrams": 14,
          "fatGrams": 9,
          "carbsGrams": 23
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-10T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-yesterday-protein-bar at 2026-06-09T17:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-yesterday-protein-bar",
      "quantity": 1,
      "loggedAt": "2026-06-09T17:00:00.000Z"
    }
snapshot captured 2026-08-02T10:30:40.660Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Generic protein bar" at 90% confidence.
  • Matched your past food logs to "Quest Chocolate Brownie Protein Bar" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had one cup milk." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Got it, I logged 2% milk (one cup (244 g)).
2 Β· Card shown I logged 2% milk (one cup (244 g)) β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: 2% milk Γ—1 (one cup (244 g)) 122 cal Β· 8.1g P Β· 11.7g C Β· 4.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:30:52.732Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add some cottage cheese." (difficulty β€”)4.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said How much some cottage cheese did you have?
2 Β· Card shown How much some cottage cheese did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:31:08.342Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Log one scoop protein powder." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Protein powder.
2 Β· Card shown Logged Protein powder.
3 Β· App data rows written created food_log_entry: Protein powder Γ—1 (1 scoop) 110 cal Β· 24.9g P Β· 1g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:31:19.619Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Protein powder" at 90% confidence.
  • Matched your saved foods and aliases to "my protein powder" at 83% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was one protein bar." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged one protein bar. Assumed 1 protein bar as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one protein bar. Assumed 1 protein bar as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Generic protein bar Γ—1 (1 protein bar) 200 cal Β· 20g P Β· 22g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:31:30.872Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Generic protein bar" at 90% confidence.
  • Matched your past food logs to "Quest Chocolate Brownie Protein Bar" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a bowl of oatmeal." (difficulty β€”)8.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.1s
1 Β· TTS said What exact food and amount should I use for a bowl of oatmeal? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bowl of oatmeal? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:31:50.070Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was toast." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Got it, I logged Toast.
2 Β· Card shown I logged Toast β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Toast Γ—1 (100 g) 265 cal Β· 9g P Β· 49g C Β· 3.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:32:01.967Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Count a yogurt." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Which one did you mean? 1. Yogurt, Whole Milk, Plain, 2. Yogurt, Chocolate, Nonfat Milk, Fortified with Vitamin D
2 Β· Card shown Which one did you mean? 1. Yogurt, Whole Milk, Plain, 2. Yogurt, Chocolate, Nonfat Milk, Fortified with Vitamin D
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:32:14.512Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a shake." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said I couldn't find Add A Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
2 Β· Card shown I couldn't find Add A Protein Shake in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein shake.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:32:26.687Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I ate a bagel with cream cheese." (difficulty β€”)4.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.5s
1 Β· TTS said What type or source of bagel should I use? I did not log it yet because bagel type and source can change the nutrition.
2 Β· Card shown What type or source of bagel should I use? I did not log it yet because bagel type and source can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:32:42.294Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Put down popcorn." (difficulty β€”)1.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said How much popcorn did you have?
2 Β· Card shown How much popcorn did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:32:54.974Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record a serving of cereal." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Which one did you mean? 1. Cereal, Granola, 2. Cereal, O's, Honey Nut, 3. Cereal, Other, Peanut Butter
2 Β· Card shown Which one did you mean? 1. Cereal, Granola, 2. Cereal, O's, Honey Nut, 3. Cereal, Other, Peanut Butter
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:06.908Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had one container yogurt." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Which one did you mean? 1. Yogurt, Whole Milk, Plain, 2. Yogurt, Chocolate, Nonfat Milk, Fortified with Vitamin D
2 Β· Card shown Which one did you mean? 1. Yogurt, Whole Milk, Plain, 2. Yogurt, Chocolate, Nonfat Milk, Fortified with Vitamin D
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:19.448Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was one granola bar." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said Which type of granola bar was it? There are several with different nutrition.
2 Β· Card shown Which type of granola bar was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:31.745Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was a salad with dressing." (difficulty β€”)0.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:42.904Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a handful of pretzels." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said How much should I log for Pretzels? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pretzels? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:54.190Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pretzels" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add one bottle protein drink." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Which type of protein drink was it? There are several with different nutrition.
2 Β· Card shown Which type of protein drink was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:17.651Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track one cup pasta." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup pasta. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup pasta. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked pasta Γ—1 (1 cup) 220 cal Β· 8.1g P Β· 43.3g C Β· 1.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:28.950Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked pasta" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Count two slices cheese." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said Got it, I logged Cheese Spread, American or Cheddar Cheese Base.
2 Β· Card shown I logged Cheese Spread, American or Cheddar Cheese Base β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Cheese Spread, American or Cheddar Cheese Base Γ—2 (1 slice) 122 cal Β· 6.8g P Β· 3.6g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:41.317Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a regular latte." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Coffee shop default Nonfat Latte. Using your saved "my normal latte". Tell me if that is wrong.
2 Β· Card shown Logged Coffee shop default Nonfat Latte. Using your saved "my normal latte". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Nonfat Latte Γ—1 (ounces) 120 cal Β· 9g P Β· 18g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:52.601Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Put down a package of crackers." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged a package of crackers. Assumed 1 package as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged a package of crackers. Assumed 1 package as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Crackers Γ—1 (1 package) 13 cal Β· 0.3g P Β· 2.2g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:03.908Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Crackers" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Breakfast was a muffin." (difficulty β€”)0.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:15.091Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a cup of soup." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Which one did you mean? 1. Soup, Sopa De Fideo Aguada, 2. Soup, Tomato, 3. Soup, Fish or Shrimp
2 Β· Card shown Which one did you mean? 1. Soup, Sopa De Fideo Aguada, 2. Soup, Tomato, 3. Soup, Fish or Shrimp
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:27.081Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had two pancakes." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Got it, I logged Pancakes, Plain.
2 Β· Card shown I logged Pancakes, Plain β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Pancakes, Plain Γ—2 (1 small pancake) 112 cal Β· 3g P Β· 14.2g C Β· 4.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:38.619Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add one serving ice cream." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one serving ice cream. Assumed 100 g because no amount was stated.
2 Β· Card shown Logged one serving ice cream. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Vanilla ice cream Γ—1 (100 g) 207 cal Β· 3.5g P Β· 23.6g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:49.883Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Vanilla ice cream" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Ate a small burrito." (difficulty β€”)1.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.3s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:02.292Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had a turkey sandwich with mayo and cheddar." (difficulty β€”)1.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said What should I use for mayo?
2 Β· Card shown What should I use for mayo?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:14.539Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Ate an apple, a banana, and grapes." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much should I log for Grapes? I did not log them yet because the amounts were not clear.
2 Β· Card shown How much should I log for Grapes? I did not log them yet because the amounts were not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:26.189Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Banana" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log a Chipotle chicken bowl." (difficulty β€”)0.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:37.706Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Breakfast was an omelet with cheddar and olive oil." (difficulty β€”)1.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.2s
1 Β· TTS said How much cheddar should I use? I did not log it yet because the amount can change the nutrition.
2 Β· Card shown How much cheddar should I use? I did not log it yet because the amount can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:50.070Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add my lunch." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Codex Test Cereal High Fiber Bran Cereal. Using your recent Codex Test Cereal High Fiber Bran Cereal history. Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Cereal High Fiber Bran Cereal. Using your recent Codex Test Cereal High Fiber Bran Cereal history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: High Fiber Bran Cereal Γ—1 (cup) 170 cal Β· 6g P Β· 38g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:01.336Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had tacos from the food truck." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said What food did you have?
2 Β· Card shown What food did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:13.355Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log a protein shake with banana, peanut butter, and oats." (difficulty β€”)4.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Banana, Protein Shake, Dry oats, Peanut butter β€” card not captured.
Why verdict Logged (write-truth verified): Banana, Protein Shake, Dry oats, Peanut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.4s
1 Β· TTS said Logged Protein Shake. Includes one banana, Peanut butter, and Dry oats.
2 Β· Card shown Logged Protein Shake. Includes one banana, Peanut butter, and Dry oats.
3 Β· App data rows written created food_log_entry: Protein Shake Γ—1 (serving) 682 cal Β· 26.2g P Β· 99.7g C Β· 23.4g F
created food_log_entry: Banana Γ—1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
created food_log_entry: Peanut butter Γ—1 (32 g) 188 cal Β· 8g P Β· 6.3g C Β· 16.1g F
created food_log_entry: Dry oats Γ—1 (100 g) 389 cal Β· 16.9g P Β· 66.3g C Β· 6.9g F
created food_log_entry: Protein Shake Γ—1 (serving) 682 cal Β· 26.2g P Β· 99.7g C Β· 23.4g F
created food_log_entry: Banana Γ—1 (1 banana) 105 cal Β· 1.3g P Β· 27.1g C Β· 0.4g F
created food_log_entry: Peanut butter Γ—1 (32 g) 188 cal Β· 8g P Β· 6.3g C Β· 16.1g F
created food_log_entry: Dry oats Γ—1 (100 g) 389 cal Β· 16.9g P Β· 66.3g C Β· 6.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:28.839Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had a salad with chicken, walnuts, and ranch." (difficulty β€”)3.0s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.0s
1 Β· TTS said What should I use for ranch?
2 Β· Card shown What should I use for ranch?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:43.035Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Track two slices of pizza." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Pizza.
2 Β· Card shown Logged Pizza.
3 Β· App data rows written created food_log_entry: Pizza Γ—1 (2 slices) 569 cal Β· 24.4g P Β· 71.3g C Β· 20.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:54.304Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pizza" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Count one Starbucks grande latte." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said Logged Starbucks Grande latte with an estimated macro range.
2 Β· Card shown Logged Starbucks Grande latte β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Starbucks Grande latte Γ—1 (1) 190 cal Β· 13g P Β· 18g C Β· 7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:06.840Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould complete the pending action"How much protein have I had today?" (difficulty β€”)0.1s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. PASS: Completed the pending action.
Why verdict Completed the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 994.2 grams of protein today.
2 Β· Card shown You logged 994.2 grams of protein today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:29.624Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"What did I eat yesterday?" (difficulty β€”)0.0s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I do not see any food logged yesterday.
2 Β· Card shown I do not see any food logged yesterday.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:40.785Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould delete the entry"Delete that Quest bar from earlier." (difficulty β€”)0.1s
Verdict Expected DELETE β€” should delete the entry. FAIL: Did not delete (not understood / no removal).
Why verdict Did not delete (not understood / no removal).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Which food entry did you want to correct?
2 Β· Card shown Which food entry did you want to correct?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • prior_food_log
    {
      "type": "prior_food_log",
      "food": "Quest bar",
      "time_hint": "earlier"
    }
snapshot captured 2026-08-02T10:38:51.972Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Quest Chocolate Brownie Protein Bar" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould update the entry"Actually that was vanilla, not chocolate." (difficulty β€”)0.8s
Verdict Expected UPDATE β€” should update the entry. PASS: Updated as asked.
Why verdict Updated as asked.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said Updated to vanilla.
2 Β· Card shown Updated the food entry from "Starbucks Grande latte" to "vanilla".
3 Β· App data rows written updated food_log_entry: Vanilla ice cream Γ—1 (100 g) 207 cal Β· 3.5g P Β· 23.6g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • prior_food_log
    {
      "type": "prior_food_log",
      "food": "chocolate item"
    }
snapshot captured 2026-08-02T10:39:03.922Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Remind me to buy Chobani yogurt." (difficulty β€”)0.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Added to-do: buy Chobani yogurt. Priority 3. Tell me if the title or due date should be different.
2 Β· Card shown Added to-do: buy Chobani yogurt. Priority 3. Tell me if the title or due date should be different.
3 Β· App data rows written created todo_item: buy Chobani yogurt
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:26.443Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
  • Matched your saved foods and aliases to "Chobani Zero Sugar Vanilla Yogurt" at 78% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould handle appropriately"Move my Quest Diagnostics appointment to Friday." (difficulty β€”)1.9s
Verdict Expected OTHER β€” should handle appropriately. UNVERIFIED: OTHER unknown subtype β€” no mechanical checks defined (key: quest diagnostics appointment)
Why verdict OTHER unknown subtype β€” no mechanical checks defined (key: quest diagnostics appointment)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.9s
1 Β· TTS said I don't have access to manage your appointments. To move your Quest Diagnostics appointment, you'll need to contact them directly or use their online scheduling portal.
2 Β· Card shown I don't have access to manage your appointments. To move your Quest Diagnostics appointment, you'll need to contact them directly or use their online scheduling portal.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:39.446Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Quest Chocolate Brownie Protein Bar" at 77% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Open the food log." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food History.
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:50.726Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Show me breakfast." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food Today.
2 Β· Card shown Opening Food Today.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:01.948Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould apply the setting"Make my food confirmations shorter." (difficulty β€”)2.0s
Verdict Expected SETTINGS β€” should apply the setting. FAIL: Did not apply the setting β€” no confirmation (unconfirmed action).
Why verdict Did not apply the setting β€” no confirmation (unconfirmed action).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.0s
1 Β· TTS said I can help with that. For food logging, you can use the app's "short confirm" setting. Would you like me to open your settings, or would you prefer to say "Open Settings" yourself?
2 Β· Card shown I can help with that. For food logging, you can use the app's "short confirm" setting. Would you like me to open your settings, or would you prefer to say "Open Settings" yourself?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:15.061Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould apply the setting"Stop asking me about bread." (difficulty β€”)8.0s
Verdict Expected SETTINGS β€” should apply the setting. FAIL: Did not apply the setting β€” treated it as food/workout-log or stalled instead of applying the setting.
Why verdict Did not apply the setting β€” treated it as food/workout-log or stalled instead of applying the setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 8.0s
1 Β· TTS said Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition.
2 Β· Card shown Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:34.247Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Ask me later about the smoothie details." (difficulty β€”)0.3s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Decisive guess with stated assumption + invited correction (good-guessing).
Why verdict Decisive guess with stated assumption + invited correction (good-guessing).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Added to-do: the smoothie details. Priority 3. Tell me if the title or due date should be different.
2 Β· Card shown Added to-do: the smoothie details. Priority 3. Tell me if the title or due date should be different.
3 Β· App data rows written created todo_item: the smoothie details
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:45.653Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"I don't know, just estimate it." (difficulty β€”)2.7s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said I can help you estimate a food entry. For example, say "Log a medium apple" or "Log 1 cup of oatmeal." If you want to log something specific, tell me what you ate and I'll suggest a standard portion.
2 Β· Card shown I can help you estimate a food entry. For example, say "Log a medium apple" or "Log 1 cup of oatmeal." If you want to log something specific, tell me what you ate and I'll suggest a standard portion.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:59.526Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"No, the other one." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I could not confirm that was saved, so I did not mark it as done.
2 Β· Card shown I could not confirm that the change was saved, so I did not mark it as done.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:10.742Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Put this in notes: banana bread recipe." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
2 Β· Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:21.963Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "bread" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould apply the setting"Set protein goal to 180 grams." (difficulty β€”)0.1s
Verdict Expected SETTINGS β€” should apply the setting. PASS: Applied setting.
Why verdict Applied setting.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Okay, I updated your daily protein goal to 180 grams.
2 Β· Card shown Okay, I updated your daily protein goal to 180 grams.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "settings" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:33.153Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
UNVERIFIEDunclassifiedshould complete the pending action"Search for low sugar protein bars." (difficulty β€”)5.6s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. UNVERIFIED: CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
Why verdict CLARIFY_ANSWER not gradeable single-shot β€” no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.6s
1 Β· TTS said I couldn't find Search For Low Sugar Protein Protein Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
2 Β· Card shown I couldn't find Search For Low Sugar Protein Protein Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic protein bar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:49.853Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I made chili with beef, beans, tomatoes, and oil." (difficulty β€”)2.6s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.6s
1 Β· TTS said Got it. To log your homemade chili, I can help you estimate a standard serving. A typical 1-cup (about 250g) serving of homemade beef chili with beans has roughly: Calories: ~350 Protein: ~20g Carbs: ~30g Fat: ~18g Would you like me to log 1 cup of homemade beef chili for you now?
2 Β· Card shown Got it. To log your homemade chili, I can help you estimate a standard serving. A typical 1-cup (about 250g) serving of homemade beef chili with beans has roughly: Calories: ~350 Protein: ~20g Carbs: ~30g Fat: ~18g Would you like me to log 1 cup of homemade beef chili for you now?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:03.595Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Add one scoop pre-workout." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Reported could-not-confirm (write-confirmation false negative).
Why verdict Reported could-not-confirm (write-confirmation false negative).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I understood a workout plan or equipment request, but could not complete it safely.
2 Β· Card shown I understood a workout plan or equipment request, but could not complete it safely.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:14.789Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had a bite of cheesecake." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a bite of cheesecake? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a bite of cheesecake? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:28.674Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I ate six ounces baked salmon." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Salmon, Salmon β€” card not captured.
Why verdict Logged (write-truth verified): Salmon, Salmon β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six ounces baked salmon.
2 Β· Card shown Logged six ounces baked salmon.
3 Β· App data rows written created food_log_entry: Salmon Γ—1 (6 oz) 354 cal Β· 34g P Β· 0g C Β· 22.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:51.528Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Salmon" at 90% confidence.
  • Matched your past food logs to "Salmon" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Lunch included one cup steamed broccoli." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Broccoli β€” card not captured.
Why verdict Logged (write-truth verified): Broccoli β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup steamed broccoli. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup steamed broccoli. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Broccoli Γ—1 (1 cup) 55 cal Β· 3.8g P Β· 11.3g C Β· 0.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:02.849Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "one cup steamed broccoli" at 90% confidence.
  • Matched the common-food list to "Broccoli" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log three plain rice cakes." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Plain rice cakes β€” card not captured.
Why verdict Logged (write-truth verified): Plain rice cakes β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three plain rice cakes.
2 Β· Card shown Logged three plain rice cakes.
3 Β· App data rows written created food_log_entry: Plain rice cakes Γ—1 (3 plain rice cakes) 104 cal Β· 2.2g P Β· 22g C Β· 0.8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:14.135Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain rice cakes" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I finished one container light Greek yogurt." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "container light greek yogurt" β€” no saved row with matching identity (rows: Low-fat Greek yogurt)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "container light greek yogurt" β€” no saved row with matching identity (rows: Low-fat Greek yogurt)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one container light greek yogurt. Assumed 100 g because no amount was stated.
2 Β· Card shown Logged one container light greek yogurt. Assumed 100 g because no amount was stated.
3 Β· App data rows written created food_log_entry: Low-fat Greek yogurt Γ—1 (100 g) 73 cal Β· 9.9g P Β· 3.9g C Β· 1.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:25.454Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Low-fat Greek yogurt" at 90% confidence.
  • Matched your past food logs to "Nonfat Greek yogurt" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Please track two tablespoons peanut butter." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Peanut butter, Peanut butter β€” card not captured.
Why verdict Logged (write-truth verified): Peanut butter, Peanut butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two tablespoons peanut butter.
2 Β· Card shown Logged two tablespoons peanut butter.
3 Β· App data rows written created food_log_entry: Peanut butter Γ—1 (2 tbsp) 176 cal Β· 7.5g P Β· 5.9g C Β· 15.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:36.752Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "peanut butter" at 90% confidence.
  • Matched the common-food list to "Peanut butter" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast included one plain English muffin." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Plain English muffin β€” card not captured.
Why verdict Logged (write-truth verified): Plain English muffin β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one plain english muffin. Assumed 1 plain english muffin as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one plain english muffin. Assumed 1 plain english muffin as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Plain English muffin Γ—1 (1 plain english muffin) 129 cal Β· 5.1g P Β· 25.5g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:48.094Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain English muffin" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count five ounces baked sweet potato." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sweet potato β€” card not captured.
Why verdict Logged (write-truth verified): Sweet potato β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged five ounces baked sweet potato.
2 Β· Card shown Logged five ounces baked sweet potato.
3 Β· App data rows written created food_log_entry: Sweet potato Γ—1 (5 oz) 128 cal Β· 2.8g P Β· 29.3g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:59.423Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Sweet potato" at 90% confidence.
  • Matched your past food logs to "Potato" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Had one cup strawberries." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Strawberries β€” card not captured.
Why verdict Logged (write-truth verified): Strawberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged had one cup strawberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged had one cup strawberries. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Strawberries Γ—1 (1 cup) 49 cal Β· 1.1g P Β· 11.7g C Β· 0.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:10.726Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Strawberries" at 90% confidence.
  • Matched your past food logs to "Strawberries" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down three turkey sausage links." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey sausage links β€” card not captured.
Why verdict Logged (write-truth verified): Turkey sausage links β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged three turkey sausage links.
2 Β· Card shown Logged three turkey sausage links.
3 Β· App data rows written created food_log_entry: Turkey sausage links Γ—1 (3 turkey sausage links) 225 cal Β· 19.5g P Β· 4.5g C Β· 13.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:22.058Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Turkey sausage links" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was one ounce pretzels." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pretzels β€” card not captured.
Why verdict Logged (write-truth verified): Pretzels β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one ounce pretzels. Assumed 1 oz as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one ounce pretzels. Assumed 1 oz as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Pretzels Γ—1 (1 oz) 108 cal Β· 2.6g P Β· 22.4g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:33.405Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pretzels" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I drank twelve ounces orange juice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Orange juice β€” card not captured.
Why verdict Logged (write-truth verified): Orange juice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged twelve ounces orange juice.
2 Β· Card shown Logged twelve ounces orange juice.
3 Β· App data rows written created food_log_entry: Orange juice Γ—1 (12 oz) 153 cal Β· 2.4g P Β· 35.4g C Β· 0.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:44.757Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Orange juice" at 90% confidence.
  • Matched your past food logs to "Orange juice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add one cup black beans." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Black beans β€” card not captured.
Why verdict Logged (write-truth verified): Black beans β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup black beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup black beans. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Black beans Γ—1 (1 cup) 227 cal Β· 15.3g P Β· 40.8g C Β· 0.9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:56.053Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Black beans" at 90% confidence.
  • Matched your past food logs to "Green beans" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record one slice cheddar cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cheddar cheese β€” card not captured.
Why verdict Logged (write-truth verified): Cheddar cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one slice cheddar cheese. Assumed 1 slice as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one slice cheddar cheese. Assumed 1 slice as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cheddar cheese Γ—1 (1 slice) 81 cal Β· 4.6g P Β· 0.7g C Β· 6.7g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:07.376Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cheddar cheese" at 90% confidence.
  • Matched your past food logs to "Cheese Spread, American or Cheddar Cheese Base" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner was six grilled shrimp." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Shrimp β€” card not captured.
Why verdict Logged (write-truth verified): Shrimp β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged six grilled shrimp.
2 Β· Card shown Logged six grilled shrimp.
3 Β· App data rows written created food_log_entry: Shrimp Γ—1 (6 shrimp) 36 cal Β· 8.6g P Β· 0.1g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:18.676Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Shrimp" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.3 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Track one cup tomato soup." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Tomato soup β€” card not captured.
Why verdict Logged (write-truth verified): Tomato soup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup tomato soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup tomato soup. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Tomato soup Γ—1 (1 cup) 93 cal Β· 2g P Β· 18.9g C Β· 1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:30.095Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Tomato soup" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had two cups mixed greens." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mixed greens β€” card not captured.
Why verdict Logged (write-truth verified): Mixed greens β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two cups mixed greens.
2 Β· Card shown Logged two cups mixed greens.
3 Β· App data rows written created food_log_entry: Mixed greens Γ—1 (2 cup) 12 cal Β· 1.1g P Β· 2g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:41.428Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Mixed greens" at 90% confidence.
  • Matched your past food logs to "Green beans" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log one tablespoon olive oil." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Olive oil β€” card not captured.
Why verdict Logged (write-truth verified): Olive oil β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one tablespoon olive oil. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one tablespoon olive oil. Assumed 1 tbsp as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Olive oil Γ—1 (1 tbsp) 120 cal Β· 0g P Β· 0g C Β· 13.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:52.710Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Olive oil" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"This morning I had one packet instant oatmeal." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Instant oatmeal β€” card not captured.
Why verdict Logged (write-truth verified): Instant oatmeal β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged Instant oatmeal.
2 Β· Card shown Logged Instant oatmeal.
3 Β· App data rows written created food_log_entry: Instant oatmeal Γ—1 (40 g) 150 cal Β· 5g P Β· 27g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_or_history_context
    {
      "type": "saved_food_or_history_context",
      "phrase": "This morning I had one packet instant oatmeal.",
      "expected_item": "packet instant oatmeal"
    }
snapshot captured 2026-08-02T10:46:04.426Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Please record four ounces sirloin steak." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sirloin steak β€” card not captured.
Why verdict Logged (write-truth verified): Sirloin steak β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged four ounces sirloin steak.
2 Β· Card shown Logged four ounces sirloin steak.
3 Β· App data rows written created food_log_entry: Sirloin steak Γ—1 (4 oz) 243 cal Β· 32.9g P Β· 0g C Β· 11.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:15.749Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Sirloin steak" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Ate one clementine." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Clementine β€” card not captured.
Why verdict Logged (write-truth verified): Clementine β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged ate one clementine. Assumed 1 clementine as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged ate one clementine. Assumed 1 clementine as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Clementine Γ—1 (1 clementine) 35 cal Β· 0.7g P Β· 8.9g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:27.042Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Clementine" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down one cup cooked brown rice." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked brown rice β€” card not captured.
Why verdict Logged (write-truth verified): Cooked brown rice β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup cooked brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup cooked brown rice. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Cooked brown rice Γ—1 (1 cup) 218 cal Β· 4.5g P Β· 45.8g C Β· 1.6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:49.820Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Cooked brown rice" at 90% confidence.
  • Matched your past food logs to "Cooked Jasmine Rice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count two tablespoons salsa." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Salsa β€” card not captured.
Why verdict Logged (write-truth verified): Salsa β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged two tablespoons salsa.
2 Β· Card shown Logged two tablespoons salsa.
3 Β· App data rows written created food_log_entry: Salsa Γ—1 (2 tbsp) 9 cal Β· 0.5g P Β· 2g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:01.147Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Salsa" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one cup baby carrots." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Baby carrots β€” card not captured.
Why verdict Logged (write-truth verified): Baby carrots β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one cup baby carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one cup baby carrots. Assumed 1 cup as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Baby carrots Γ—1 (1 cup) 52 cal Β· 0.9g P Β· 12.2g C Β· 0.1g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:12.487Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Baby carrots" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"Add one baked potato." (difficulty β€”)0.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Potato.
2 Β· Card shown Logged Potato.
3 Β· App data rows written created food_log_entry: Potato Γ—1 (6 oz) 148 cal Β· 3.2g P Β· 34.2g C Β· 0.2g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:24.136Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was one mozzarella string cheese." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mozzarella string cheese β€” card not captured.
Why verdict Logged (write-truth verified): Mozzarella string cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged one mozzarella string cheese. Assumed 1 mozzarella string cheese as the default serving. Tell me if you want a different amount.
2 Β· Card shown Logged one mozzarella string cheese. Assumed 1 mozzarella string cheese as the default serving. Tell me if you want a different amount.
3 Β· App data rows written created food_log_entry: Mozzarella string cheese Γ—1 (1 mozzarella string cheese) 80 cal Β· 7g P Β· 1g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:35.472Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Mozzarella string cheese" at 90% confidence.
  • Matched your past food logs to "Mozzarella String Cheese" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my usual Fairlife shake." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Fairlife Nutrition Plan Chocolate Shake β€” card not captured.
Why verdict Logged (write-truth verified): Fairlife Nutrition Plan Chocolate Shake β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Fairlife Fairlife Nutrition Plan Chocolate Shake. Using your saved "my usual fairlife shake". Tell me if that is wrong.
2 Β· Card shown Logged Fairlife Fairlife Nutrition Plan Chocolate Shake. Using your saved "my usual fairlife shake". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Fairlife Nutrition Plan Chocolate Shake Γ—1 (bottle) 150 cal Β· 30g P Β· 4g C Β· 2.5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Fairlife Fairlife Nutrition Plan Chocolate Shake
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-fairlife-nutrition-plan-chocolate",
        "name": "Fairlife Nutrition Plan Chocolate Shake",
        "brand": "Fairlife",
        "source": "manual",
        "servingLabel": "bottle",
        "servingQuantity": 1,
        "servingUnit": "bottle",
        "macrosPerServing": {
          "calories": 150,
          "proteinGrams": 30,
          "fatGrams": 2.5,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my usual Fairlife shake",
      "foodItemId": "seed-fairlife-nutrition-plan-chocolate",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bottle",
        "displayLabel": "my usual Fairlife shake",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-fairlife-nutrition-plan-chocolate at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-fairlife-nutrition-plan-chocolate",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:47:46.736Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my usual fairlife shake" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my morning oatmeal." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Cooked Oatmeal with Peanut Butter β€” card not captured.
Why verdict Logged (write-truth verified): Cooked Oatmeal with Peanut Butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Home default Cooked Oatmeal with Peanut Butter. Using your saved "my morning oatmeal". Tell me if that is wrong.
2 Β· Card shown Logged Home default Cooked Oatmeal with Peanut Butter. Using your saved "my morning oatmeal". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Cooked Oatmeal with Peanut Butter Γ—1 (bowl) 220 cal Β· 8g P Β· 30g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Home default Cooked Oatmeal with Peanut Butter
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-morning-oatmeal-bowl",
        "name": "Cooked Oatmeal with Peanut Butter",
        "brand": "Home default",
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 220,
          "proteinGrams": 8,
          "fatGrams": 9,
          "carbsGrams": 30
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my morning oatmeal",
      "foodItemId": "seed-morning-oatmeal-bowl",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bowl",
        "displayLabel": "my morning oatmeal",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-morning-oatmeal-bowl at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-morning-oatmeal-bowl",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:47:58.145Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my morning oatmeal" at 96% confidence.
  • Matched the common-food list to "Cooked oatmeal" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record my regular salad dressing." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Balsamic Vinaigrette β€” card not captured.
Why verdict Logged (write-truth verified): Balsamic Vinaigrette β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Generic Balsamic Vinaigrette. Using your saved "my regular salad dressing". Tell me if that is wrong.
2 Β· Card shown Logged Generic Balsamic Vinaigrette. Using your saved "my regular salad dressing". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Balsamic Vinaigrette Γ—1 (tablespoons) 90 cal Β· 0g P Β· 4g C Β· 8g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Generic Balsamic Vinaigrette
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-balsamic-vinaigrette",
        "name": "Balsamic Vinaigrette",
        "brand": "Generic",
        "source": "manual",
        "servingLabel": "tablespoons",
        "servingQuantity": 2,
        "servingUnit": "tablespoons",
        "macrosPerServing": {
          "calories": 90,
          "proteinGrams": 0,
          "fatGrams": 8,
          "carbsGrams": 4
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my regular salad dressing",
      "foodItemId": "seed-balsamic-vinaigrette",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 2,
        "defaultServingLabel": "tablespoons",
        "displayLabel": "my regular salad dressing",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:48:09.563Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my regular salad dressing" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had my standard turkey wrap." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey Wrap β€” card not captured.
Why verdict Logged (write-truth verified): Turkey Wrap β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Home default Turkey Wrap. Using your saved "my standard turkey wrap". Tell me if that is wrong.
2 Β· Card shown Logged Home default Turkey Wrap. Using your saved "my standard turkey wrap". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Turkey Wrap Γ—1 (wrap) 340 cal Β· 28g P Β· 31g C Β· 11g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Home default Turkey Wrap
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-standard-turkey-wrap",
        "name": "Turkey Wrap",
        "brand": "Home default",
        "source": "manual",
        "servingLabel": "wrap",
        "servingQuantity": 1,
        "servingUnit": "wrap",
        "macrosPerServing": {
          "calories": 340,
          "proteinGrams": 28,
          "fatGrams": 11,
          "carbsGrams": 31
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my standard turkey wrap",
      "foodItemId": "seed-standard-turkey-wrap",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "wrap",
        "displayLabel": "my standard turkey wrap",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-standard-turkey-wrap at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-standard-turkey-wrap",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:48:20.815Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my standard turkey wrap" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Put down my go-to Greek yogurt." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Oikos Vanilla Greek Yogurt Cup β€” card not captured.
Why verdict Logged (write-truth verified): Oikos Vanilla Greek Yogurt Cup β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Oikos Oikos Vanilla Greek Yogurt Cup. Using your saved "my go to greek yogurt". Tell me if that is wrong.
2 Β· Card shown Logged Oikos Oikos Vanilla Greek Yogurt Cup. Using your saved "my go to greek yogurt". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oikos Vanilla Greek Yogurt Cup Γ—1 (cup) 120 cal Β· 15g P Β· 10g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Oikos Oikos Vanilla Greek Yogurt Cup
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-oikos-vanilla-greek-yogurt",
        "name": "Oikos Vanilla Greek Yogurt Cup",
        "brand": "Oikos",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 120,
          "proteinGrams": 15,
          "fatGrams": 0,
          "carbsGrams": 10
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my go-to Greek yogurt",
      "foodItemId": "seed-oikos-vanilla-greek-yogurt",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "cup",
        "displayLabel": "my go-to Greek yogurt",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-oikos-vanilla-greek-yogurt at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-oikos-vanilla-greek-yogurt",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:48:32.089Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my go to greek yogurt" at 96% confidence.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
  • Matched your past food logs to "Nonfat Greek yogurt" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count my usual protein smoothie." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Protein Smoothie Default β€” card not captured.
Why verdict Logged (write-truth verified): Protein Smoothie Default β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Protein Smoothie Default. Using your saved "usual protein smoothie". Tell me if that is wrong.
2 Β· Card shown Logged Protein Smoothie Default. Using your saved "usual protein smoothie". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Protein Smoothie Default Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_alias
    {
      "type": "saved_food_alias",
      "phrase": "usual protein smoothie",
      "expected_item": "seeded protein smoothie default"
    }
snapshot captured 2026-08-02T10:48:43.335Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "usual protein smoothie" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record my blue bag popcorn." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): SkinnyPop Original Popcorn β€” card not captured.
Why verdict Logged (write-truth verified): SkinnyPop Original Popcorn β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged SkinnyPop SkinnyPop Original Popcorn. Using your saved "my blue bag popcorn". Tell me if that is wrong.
2 Β· Card shown Logged SkinnyPop SkinnyPop Original Popcorn. Using your saved "my blue bag popcorn". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: SkinnyPop Original Popcorn Γ—1 (bag) 100 cal Β· 2g P Β· 10g C Β· 6g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: SkinnyPop SkinnyPop Original Popcorn
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-skinnypop-original-bag",
        "name": "SkinnyPop Original Popcorn",
        "brand": "SkinnyPop",
        "source": "manual",
        "servingLabel": "bag",
        "servingQuantity": 1,
        "servingUnit": "bag",
        "macrosPerServing": {
          "calories": 100,
          "proteinGrams": 2,
          "fatGrams": 6,
          "carbsGrams": 10
        },
        "aliases": [
          "blue bag popcorn"
        ],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my blue bag popcorn",
      "foodItemId": "seed-skinnypop-original-bag",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bag",
        "displayLabel": "my blue bag popcorn",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:48:54.594Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my blue bag popcorn" at 96% confidence.
  • Matched the common-food list to "Air-popped popcorn" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Breakfast was my normal latte." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Nonfat Latte β€” card not captured.
Why verdict Logged (write-truth verified): Nonfat Latte β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Coffee shop default Nonfat Latte. Using your saved "my normal latte". Tell me if that is wrong.
2 Β· Card shown Logged Coffee shop default Nonfat Latte. Using your saved "my normal latte". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Nonfat Latte Γ—1 (ounces) 120 cal Β· 9g P Β· 18g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Coffee shop default Nonfat Latte
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-nonfat-latte-12oz",
        "name": "Nonfat Latte",
        "brand": "Coffee shop default",
        "source": "manual",
        "servingLabel": "ounces",
        "servingQuantity": 12,
        "servingUnit": "ounces",
        "macrosPerServing": {
          "calories": 120,
          "proteinGrams": 9,
          "fatGrams": 0,
          "carbsGrams": 18
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my normal latte",
      "foodItemId": "seed-nonfat-latte-12oz",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 12,
        "defaultServingLabel": "ounces",
        "displayLabel": "my normal latte",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 12 for seed-nonfat-latte-12oz at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-nonfat-latte-12oz",
      "quantity": 12,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:49:05.844Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my normal latte" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Snack was my typical almonds." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Almonds β€” card not captured.
Why verdict Logged (write-truth verified): Almonds β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Generic Almonds. Using your saved "my typical almonds". Tell me if that is wrong.
2 Β· Card shown Logged Generic Almonds. Using your saved "my typical almonds". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Almonds Γ—1 (ounce) 164 cal Β· 6g P Β· 6g C Β· 14g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Generic Almonds
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-typical-almonds",
        "name": "Almonds",
        "brand": "Generic",
        "source": "manual",
        "servingLabel": "ounce",
        "servingQuantity": 1,
        "servingUnit": "ounce",
        "macrosPerServing": {
          "calories": 164,
          "proteinGrams": 6,
          "fatGrams": 14,
          "carbsGrams": 6
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my typical almonds",
      "foodItemId": "seed-typical-almonds",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "ounce",
        "displayLabel": "my typical almonds",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-typical-almonds at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-typical-almonds",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:49:17.099Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my typical almonds" at 96% confidence.
  • Matched the common-food list to "Almonds" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add my home sandwich." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Ham and Swiss Sandwich β€” card not captured.
Why verdict Logged (write-truth verified): Ham and Swiss Sandwich β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Home default Ham and Swiss Sandwich. Using your saved "my home sandwich". Tell me if that is wrong.
2 Β· Card shown Logged Home default Ham and Swiss Sandwich. Using your saved "my home sandwich". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Ham and Swiss Sandwich Γ—1 (sandwich) 360 cal Β· 24g P Β· 33g C Β· 14g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Home default Ham and Swiss Sandwich
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-home-sandwich",
        "name": "Ham and Swiss Sandwich",
        "brand": "Home default",
        "source": "manual",
        "servingLabel": "sandwich",
        "servingQuantity": 1,
        "servingUnit": "sandwich",
        "macrosPerServing": {
          "calories": 360,
          "proteinGrams": 24,
          "fatGrams": 14,
          "carbsGrams": 33
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my home sandwich",
      "foodItemId": "seed-home-sandwich",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "sandwich",
        "displayLabel": "my home sandwich",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:49:28.477Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my home sandwich" at 96% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log my PB toast." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Whole Wheat Toast with Peanut Butter β€” card not captured.
Why verdict Logged (write-truth verified): Whole Wheat Toast with Peanut Butter β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Home default Whole Wheat Toast with Peanut Butter. Using your saved "my pb toast". Tell me if that is wrong.
2 Β· Card shown Logged Home default Whole Wheat Toast with Peanut Butter. Using your saved "my pb toast". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Whole Wheat Toast with Peanut Butter Γ—1 (slice) 170 cal Β· 7g P Β· 18g C Β· 9g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Home default Whole Wheat Toast with Peanut Butter
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-pb-toast",
        "name": "Whole Wheat Toast with Peanut Butter",
        "brand": "Home default",
        "source": "manual",
        "servingLabel": "slice",
        "servingQuantity": 1,
        "servingUnit": "slice",
        "macrosPerServing": {
          "calories": 170,
          "proteinGrams": 7,
          "fatGrams": 9,
          "carbsGrams": 18
        },
        "aliases": [
          "PB toast"
        ],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my PB toast",
      "foodItemId": "seed-pb-toast",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "slice",
        "displayLabel": "my PB toast",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-pb-toast at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-pb-toast",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:49:39.698Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my pb toast" at 96% confidence.
  • Matched the common-food list to "Toast" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had my post workout shake." (difficulty β€”)1.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said I did not make any app changes. What would you like me to do with that?
2 Β· Card shown I did not make any app changes. What would you like me to do with that?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Premier Protein Premier Protein Chocolate Shake
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-premier-protein-chocolate",
        "name": "Premier Protein Chocolate Shake",
        "brand": "Premier Protein",
        "source": "manual",
        "servingLabel": "bottle",
        "servingQuantity": 1,
        "servingUnit": "bottle",
        "macrosPerServing": {
          "calories": 160,
          "proteinGrams": 30,
          "fatGrams": 3,
          "carbsGrams": 5
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my post workout shake",
      "foodItemId": "seed-premier-protein-chocolate",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bottle",
        "displayLabel": "my post workout shake",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-premier-protein-chocolate at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-premier-protein-chocolate",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:49:52.293Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track the yogurt I always get." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "Low Sugar Yogurt Cup" β€” no saved row with matching identity (rows: Vanilla Greek Yogurt Cup)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "Low Sugar Yogurt Cup" β€” no saved row with matching identity (rows: Vanilla Greek Yogurt Cup)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Codex Test Dairy Vanilla Greek Yogurt Cup. Using your saved "my usual yogurt". Tell me if that is wrong.
2 Β· Card shown Logged Codex Test Dairy Vanilla Greek Yogurt Cup. Using your saved "my usual yogurt". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Vanilla Greek Yogurt Cup Γ—1 (cup) 130 cal Β· 15g P Β· 12g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Two Good Low Sugar Yogurt Cup
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-low-sugar-yogurt",
        "name": "Low Sugar Yogurt Cup",
        "brand": "Two Good",
        "source": "manual",
        "servingLabel": "cup",
        "servingQuantity": 1,
        "servingUnit": "cup",
        "macrosPerServing": {
          "calories": 80,
          "proteinGrams": 12,
          "fatGrams": 2,
          "carbsGrams": 3
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • Seed food history: 1 for seed-low-sugar-yogurt at 2026-06-09T08:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-low-sugar-yogurt",
      "quantity": 1,
      "loggedAt": "2026-06-09T08:00:00.000Z"
    }
  • Seed food history: 1 for seed-low-sugar-yogurt at 2026-06-10T08:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-low-sugar-yogurt",
      "quantity": 1,
      "loggedAt": "2026-06-10T08:00:00.000Z"
    }
snapshot captured 2026-08-02T10:50:03.687Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Count my regular cottage cheese bowl." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Low-Fat Cottage Cheese β€” card not captured.
Why verdict Logged (write-truth verified): Low-Fat Cottage Cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Generic Low-Fat Cottage Cheese. Using your saved "my regular cottage cheese bowl". Tell me if that is wrong.
2 Β· Card shown Logged Generic Low-Fat Cottage Cheese. Using your saved "my regular cottage cheese bowl". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Low-Fat Cottage Cheese Γ—1 (cups) 135 cal Β· 18g P Β· 6g C Β· 4g F
created food_log_entry: Low-Fat Cottage Cheese Γ—1 (cups) 135 cal Β· 18g P Β· 6g C Β· 4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Generic Low-Fat Cottage Cheese
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-cottage-cheese-bowl",
        "name": "Low-Fat Cottage Cheese",
        "brand": "Generic",
        "source": "manual",
        "servingLabel": "cups",
        "servingQuantity": 0.75,
        "servingUnit": "cups",
        "macrosPerServing": {
          "calories": 135,
          "proteinGrams": 18,
          "fatGrams": 4,
          "carbsGrams": 6
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my regular cottage cheese bowl",
      "foodItemId": "seed-cottage-cheese-bowl",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 0.75,
        "defaultServingLabel": "cups",
        "displayLabel": "my regular cottage cheese bowl",
        "confirmBeforeLog": false
      }
    }
snapshot captured 2026-08-02T10:50:15.053Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my regular cottage cheese bowl" at 96% confidence.
  • Matched the common-food list to "Cottage cheese" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner was my standard rice and beans." (difficulty β€”)0.1s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Rice and Black Beans Bowl β€” card not captured.
Why verdict Logged (write-truth verified): Rice and Black Beans Bowl β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Logged Home default Rice and Black Beans Bowl. Using your saved "my standard rice and beans". Tell me if that is wrong.
2 Β· Card shown Logged Home default Rice and Black Beans Bowl. Using your saved "my standard rice and beans". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Rice and Black Beans Bowl Γ—1 (bowl) 310 cal Β· 12g P Β· 59g C Β· 3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • Seed food: Home default Rice and Black Beans Bowl
    {
      "type": "food_item",
      "foodItem": {
        "id": "seed-rice-and-beans-bowl",
        "name": "Rice and Black Beans Bowl",
        "brand": "Home default",
        "source": "manual",
        "servingLabel": "bowl",
        "servingQuantity": 1,
        "servingUnit": "bowl",
        "macrosPerServing": {
          "calories": 310,
          "proteinGrams": 12,
          "fatGrams": 3,
          "carbsGrams": 59
        },
        "aliases": [],
        "timesLogged": 0,
        "createdAt": "2026-06-11T12:00:00.000Z"
      }
    }
  • food_default
    {
      "type": "food_default",
      "phrase": "my standard rice and beans",
      "foodItemId": "seed-rice-and-beans-bowl",
      "settings": {
        "quickLogMode": "fixed",
        "defaultQuantity": 1,
        "defaultServingLabel": "bowl",
        "displayLabel": "my standard rice and beans",
        "confirmBeforeLog": false
      }
    }
  • Seed food history: 1 for seed-rice-and-beans-bowl at 2026-06-10T18:00:00.000Z
    {
      "type": "food_history",
      "foodItemId": "seed-rice-and-beans-bowl",
      "quantity": 1,
      "loggedAt": "2026-06-10T18:00:00.000Z"
    }
snapshot captured 2026-08-02T10:50:26.463Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "my standard rice and beans" at 96% confidence.
  • Matched the common-food list to "Cooked white rice" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Have that same Greek yogurt again." (difficulty β€”)0.2s
Verdict Expected LOG β€” should log the entry. FAIL: WRITE-TRUTH FAIL β€” WRONG/MISSING item "same greek yogurt item as the earlier run-created history row" β€” no saved row with matching identity (rows: Oikos Vanilla Greek Yogurt Cup)
Why verdict WRITE-TRUTH FAIL β€” WRONG/MISSING item "same greek yogurt item as the earlier run-created history row" β€” no saved row with matching identity (rows: Oikos Vanilla Greek Yogurt Cup)
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.2s
1 Β· TTS said Logged Oikos Oikos Vanilla Greek Yogurt Cup. Using your saved "my go to greek yogurt". Tell me if that is wrong.
2 Β· Card shown Logged Oikos Oikos Vanilla Greek Yogurt Cup. Using your saved "my go to greek yogurt". Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Oikos Vanilla Greek Yogurt Cup Γ—1 (cup) 120 cal Β· 15g P Β· 10g C Β· 0g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_or_history_context
    {
      "type": "saved_food_or_history_context",
      "phrase": "Have that same Greek yogurt again.",
      "expected_item": "same greek yogurt item as the earlier run-created history row"
    }
snapshot captured 2026-08-02T10:50:49.129Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Plain Greek yogurt" at 90% confidence.
  • Matched your past food logs to "Nonfat Greek yogurt" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Add another turkey burger patty like dinner." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Turkey Burger Patty β€” card not captured.
Why verdict Logged (write-truth verified): Turkey Burger Patty β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Turkey Burger Patty. Using your recent Turkey Burger Patty history. Tell me if that is wrong.
2 Β· Card shown Logged Turkey Burger Patty. Using your recent Turkey Burger Patty history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Turkey Burger Patty Γ—1 (serving) 150 cal Β· 10g P Β· 15g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_or_history_context
    {
      "type": "saved_food_or_history_context",
      "phrase": "Add another turkey burger patty like dinner.",
      "expected_item": "turkey burger patty"
    }
snapshot captured 2026-08-02T10:51:00.892Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your past food logs to "Turkey Burger Patty" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Log the same blueberries as before." (difficulty β€”)0.4s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Blueberries β€” card not captured.
Why verdict Logged (write-truth verified): Blueberries β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.4s
1 Β· TTS said Logged Blueberries. Using your recent Blueberries history. Tell me if that is wrong.
2 Β· Card shown Logged Blueberries. Using your recent Blueberries history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Blueberries Γ—1 (1 cup) 84 cal Β· 1g P Β· 21.5g C Β· 0.4g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_or_history_context
    {
      "type": "saved_food_or_history_context",
      "phrase": "Log the same blueberries as before.",
      "expected_item": "same blueberry amount as the earlier same-run row"
    }
snapshot captured 2026-08-02T10:51:12.362Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Blueberries" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 0.6 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Record another string cheese." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Mozzarella string cheese β€” card not captured.
Why verdict Logged (write-truth verified): Mozzarella string cheese β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Logged Mozzarella string cheese. Using your recent Mozzarella string cheese history. Tell me if that is wrong.
2 Β· Card shown Logged Mozzarella string cheese. Using your recent Mozzarella string cheese history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Mozzarella string cheese Γ—1 (1 mozzarella string cheese) 80 cal Β· 7g P Β· 1g C Β· 5g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • saved_food_or_history_context
    {
      "type": "saved_food_or_history_context",
      "phrase": "Record another string cheese.",
      "expected_item": "mozzarella string cheese using the earlier same-run history"
    }
snapshot captured 2026-08-02T10:51:24.028Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Mozzarella string cheese" at 90% confidence.
  • Matched your past food logs to "Mozzarella String Cheese" at 82% confidence.
  • Matched your saved foods and aliases to "Mozzarella string cheese" at 66% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.5 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Same sweet potato as earlier, one more serving." (difficulty β€”)0.7s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Sweet potato β€” card not captured.
Why verdict Logged (write-truth verified): Sweet potato β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Sweet potato. Using your recent Sweet potato history. Tell me if that is wrong.
2 Β· Card shown Logged Sweet potato. Using your recent Sweet potato history. Tell me if that is wrong.
3 Β· App data rows written created food_log_entry: Sweet potato Γ—1 (5 oz) 128 cal Β· 2.8g P Β· 29.3g C Β· 0.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:51:35.876Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Sweet potato" at 90% confidence.
  • Matched your past food logs to "Sweet potato" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 1.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had toast." (difficulty β€”)1.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said How much toast did you have?
2 Β· Card shown How much toast did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:51:48.694Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add cereal." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said What food did you log? Could you be more specific?
2 Β· Card shown What food did you log? Could you be more specific?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:52:00.639Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log yogurt." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said How much yogurt did you have?
2 Β· Card shown How much yogurt did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:52:13.213Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Put down one cup soup." (difficulty β€”)0.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.9s
1 Β· TTS said Which one did you mean? 1. Soup, Sopa De Fideo Aguada, 2. Soup, Tomato, 3. Soup, Fish or Shrimp
2 Β· Card shown Which one did you mean? 1. Soup, Sopa De Fideo Aguada, 2. Soup, Tomato, 3. Soup, Fish or Shrimp
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:52:25.194Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Count a handful of trail mix." (difficulty β€”)2.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.7s
1 Β· TTS said What exact food and amount should I use for a handful of trail mix? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for a handful of trail mix? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:52:39.059Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I drank a smoothie." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said Which type of smoothie was it? There are several with different nutrition.
2 Β· Card shown Which type of smoothie was it? There are several with different nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:52:51.277Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add pasta salad." (difficulty β€”)4.2s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 4.2s
1 Β· TTS said How much pasta salad did you have?
2 Β· Card shown How much pasta salad did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:53:06.598Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track two tacos." (difficulty β€”)0.8s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.8s
1 Β· TTS said What exact food and amount should I use for two tacos? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for two tacos? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:53:18.558Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Snack was jerky." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:53:29.741Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I had mashed potatoes." (difficulty β€”)3.9s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.9s
1 Β· TTS said How much mashed potatoes did you have?
2 Β· Card shown How much mashed potatoes did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:53:44.763Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Record granola." (difficulty β€”)1.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.1s
1 Β· TTS said How much granola did you have?
2 Β· Card shown How much granola did you have?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:53:56.961Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was chili." (difficulty β€”)0.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:54:08.137Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.2 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Put down orange juice." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Orange juice? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Orange juice? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:54:19.372Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Orange juice" at 90% confidence.
  • Matched your past food logs to "Orange juice" at 82% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould ask a clarifying question"I ate a muffin." (difficulty β€”)0.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. FAIL: Logged a BLIND guess β€” no stated assumption, no correction invited.
Why verdict Logged a BLIND guess β€” no stated assumption, no correction invited.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.7s
1 Β· TTS said Logged Muffin, Plain (1 muffin (1 small)) with an estimated macro range.
2 Β· Card shown Logged Muffin, Plain (1 muffin (1 small)) β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: Muffin, Plain Γ—1 (1 muffin (1 small)) 262 cal Β· 4.1g P Β· 36.4g C Β· 11.3g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:54:31.261Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add hummus." (difficulty β€”)0.1s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said How much should I log for Hummus? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Hummus? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:54:42.473Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Hummus" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Lunch was sushi with spicy mayo." (difficulty β€”)0.0s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
2 Β· Card shown I did not log that yet because the exact item and amount decide the nutrition. What food and how much should I log?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:55:05.080Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I ate half a burrito bowl with rice, beans, steak, and queso." (difficulty β€”)1.7s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said Which beans should I use?
2 Β· Card shown Which beans should I use?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:55:13.797Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track chicken salad on sourdough." (difficulty β€”)5.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.4s
1 Β· TTS said What exact food and amount should I use for chicken salad on sourdough? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for chicken salad on sourdough? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:55:34.427Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"Dinner was pad thai with chicken." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): Pad Thai with Chicken β€” card not captured.
Why verdict Logged (write-truth verified): Pad Thai with Chicken β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Got it, I logged Pad Thai with Chicken.
2 Β· Card shown I logged Pad Thai with Chicken β€” let me know if that's not right.
3 Β· App data rows written created food_log_entry: Pad Thai with Chicken Γ—1 (1 cup) 308 cal Β· 16.2g P Β· 28.8g C Β· 15g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:55:46.107Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"I split a brownie sundae." (difficulty β€”)1.4s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.4s
1 Β· TTS said How much of the sundae did you have? I need the portion size to log it accurately.
2 Β· Card shown How much of the sundae did you have? I need the portion size to log it accurately.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:55:58.592Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Add a Caesar salad with chicken and dressing." (difficulty β€”)1.7s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said What should I use for dressing?
2 Β· Card shown What should I use for dressing?
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:56:11.604Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had ramen with pork and egg." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said How much should I log for Pork? I did not log it yet because the amount was not clear.
2 Β· Card shown How much should I log for Pork? I did not log it yet because the amount was not clear.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:56:23.295Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Pork" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.7 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Log pancakes with butter and syrup." (difficulty β€”)1.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.5s
1 Β· TTS said How much butter should I use? I did not log it yet because the amount can change the nutrition.
2 Β· Card shown How much butter should I use? I did not log it yet because the amount can change the nutrition.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:56:36.001Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Dinner was mac and cheese with bacon." (difficulty β€”)5.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 5.2s
1 Β· TTS said What exact food and amount should I use for mac and cheese with bacon? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for mac and cheese with bacon? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:56:52.326Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould ask a clarifying question"Track half an avocado turkey club sandwich." (difficulty β€”)2.5s
Verdict Expected CLARIFY β€” should ask a clarifying question. PASS: Asked a clarification as expected.
Why verdict Asked a clarification as expected.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.5s
1 Β· TTS said What exact food and amount should I use for half an avocado turkey club sandwich? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for half an avocado turkey club sandwich? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:57:05.975Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Show my lunch log." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food History.
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:57:17.223Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.4 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould delete the entry"Actually remove the avocado." (difficulty β€”)0.3s
Verdict Expected DELETE β€” should delete the entry. PASS: Deleted/removed the requested food with database removal proof.
Why verdict Deleted/removed the requested food with database removal proof.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.3s
1 Β· TTS said Deleted Avocado.
2 Β· Card shown Deleted Avocado.
3 Β· App data rows written deleted food_log_entry:
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state:
  • prior_food_log_or_pending_item
    {
      "type": "prior_food_log_or_pending_item",
      "food": "avocado"
    }
snapshot captured 2026-08-02T10:57:35.390Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched the common-food list to "Avocado" at 90% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 2.9 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould complete the pending action"What did I eat after my workout?" (difficulty β€”)1.7s
Verdict Expected CLARIFY_ANSWER β€” should complete the pending action. FAIL: Did not complete the pending action.
Why verdict Did not complete the pending action.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.7s
1 Β· TTS said I can see your Food History is open. To find what you ate after a workout, please scroll through your recent logs there.
2 Β· Card shown I can see your Food History is open. To find what you ate after a workout, please scroll through your recent logs there.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:57:41.716Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.0 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould navigate"Open the food history screen." (difficulty β€”)0.1s
Verdict Expected NAVIGATE β€” should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Opening Food History.
2 Β· Card shown Opening Food History.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:57:52.912Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.1 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould apply the setting"Stop asking follow-up questions out loud." (difficulty β€”)1.6s
Verdict Expected SETTINGS β€” should apply the setting. FAIL: Did not apply the setting β€” no confirmation (unconfirmed action).
Why verdict Did not apply the setting β€” no confirmation (unconfirmed action).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said Understood. I’ll keep my responses brief and avoid unnecessary follow-ups.
2 Β· Card shown Understood. I’ll keep my responses brief and avoid unnecessary follow-ups.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:58:05.950Z
6 Β· Why this food
  • The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • Matched your saved foods and aliases to "Quest Chocolate Brownie Protein Bar" at 75% confidence.
7 Β· Lookup method
  • The report captured the app food lookup that ran before or alongside the final decision.
  • It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
  • The lookup evidence took 3.8 seconds to collect.
  • This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
PASSshould log the entry"I had one KIND Protein crunchy peanut butter bar." (difficulty β€”)0.6s
Verdict Expected LOG β€” should log the entry. PASS: Logged (write-truth verified): KIND Crunchy Peanut Butter Protein Bar β€” card not captured.
Why verdict Logged (write-truth verified): KIND Crunchy Peanut Butter Protein Bar β€” card not captured.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.6s
1 Β· TTS said Logged KIND Crunchy Peanut Butter Protein Bar with an estimated macro range.
2 Β· Card shown Logged KIND Crunchy Peanut Butter Protein Bar β€” the macros are an estimate since this food varies by brand.
3 Β· App data rows written created food_log_entry: KIND Crunchy Peanut Butter Protein Bar Γ—1 (1 bar) 250 cal Β· 12g P Β· 17g C Β· 18g F
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:58:17.410Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Track one Oikos Pro vanilla cup." (difficulty β€”)0.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.5s
1 Β· TTS said Which one did you mean? 1. Pro Vanilla Yogurt β€” Oikos, 2. Vanilla β€” Oikos PRO (0.5 cup )
2 Β· Card shown Which one did you mean? 1. Pro Vanilla Yogurt β€” Oikos, 2. Vanilla β€” Oikos PRO (0.5 cup )
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:58:29.107Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Count one Fairlife Nutrition Plan chocolate shake." (difficulty β€”)2.2s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.2s
1 Β· TTS said Which one did you mean? 1. Nutrition Plan Chocolate Shake β€” Fairlife (1 bottle), 2. Nutrition Plan Chocolate Shake β€” Fairlife (bottle)
2 Β· Card shown Which one did you mean? 1. Nutrition Plan Chocolate Shake β€” Fairlife (1 bottle), 2. Nutrition Plan Chocolate Shake β€” Fairlife (bottle)
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:58:42.487Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Log one eye coast pro vanilla cup." (difficulty β€”)2.8s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 2.8s
1 Β· TTS said What exact food and amount should I use for one eye coast pro vanilla cup? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for one eye coast pro vanilla cup? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:58:56.456Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"Add one bear bells cookies and cream bar." (difficulty β€”)3.1s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 3.1s
1 Β· TTS said I couldn't find Add One Bear Bell's Cookies Cream Snack Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic snack bar.
2 Β· Card shown I couldn't find Add One Bear Bell's Cookies Cream Snack Bar in my nutrition database. What exact name is on the package? I did not log it because I'd only be guessing the nutrition. If you prefer, tell me to log a generic snack bar.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:59:10.782Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)
FAILshould log the entry"I had a bowl of cooked jasmine rice." (difficulty β€”)9.5s
Verdict Expected LOG β€” should log the entry. FAIL: OVER-ASK β€” asked instead of logging (no saved row).
Why verdict OVER-ASK β€” asked instead of logging (no saved row).
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 9.5s
1 Β· TTS said What exact food and amount should I use for Cooked jasmine rice? I did not log it yet because I could not safely finish that food log.
2 Β· Card shown What exact food and amount should I use for Cooked jasmine rice? I did not log it yet because I could not safely finish that food log.
3 Β· App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did no screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
  • No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:59:43.130Z
6 Β· Why this food No food-decision explanation was captured for this path.
7 Β· Lookup method No lookup method was captured for this path.
8 Β· Candidates β†’ decider no candidate list captured (this path did not run DB resolution β€” e.g. provisional branded log)