notes-todos-lists-A-7c039dd0-c16-2…

Supposed to	N	Correct	Wrong	Unverified
▸ LOG — log the food	69	48 (70%)	21 (30%)	0 (0%)
21 handled wrong — click one to jump to its full detail below "note that the client prefers email over phone" Reported could-not-confirm (write-confirmation false negative). "note that down" WRITE-TRUTH FAIL — WRONG/MISSING content "parking on Main Street" — no saved note row with matching identity (rows: the client prefers email over phone) "jot this down somewhere" WRITE-TRUTH FAIL — WRONG/MISSING content "contractor needs the deposit by Friday" — no saved note row with matching identity (rows: the parking thing on main street) "uh put buy birthday card for mom on my list" Reported could-not-confirm (write-confirmation false negative). "add call the insurance company to my morning list" Reported could-not-confirm (write-confirmation false negative). "remind me tomorrow" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "remind me when I get home to defrost the chicken" Did not write — misroute-into-food; no notes-domain saved row. "new list called weekend projects" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "new pet supplies list please" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "add fix the leaky faucet to weekend projects" Reported could-not-confirm (write-confirmation false negative). "put milk on the list" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "add eggs" Did not write — misroute-into-food; no notes-domain saved row. "add that to my list" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "add batteries and light bulbs to the hardware list" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "put that on packing" OVER-ASK — asked instead of writing the note/todo/list (no saved row). "add eggs bread and butter to the shopping list" WRITE-TRUTH FAIL — WRONG/MISSING content "eggs" — no saved list_item row with matching identity (rows: butter); WRONG/MISSING content "bread" — no saved list_item row with matching identity (rows: butter) "add milk eggs and bread to my grocery list" WRITE-TRUTH FAIL — WRONG/MISSING content "milk" — no saved list_item row with matching identity (rows: bread \| eggs) "add three avocados and two limes to groceries" WRITE-TRUTH FAIL — misroute-into-food: notes/todo/list intent wrote food_log_entries instead of a notes-domain table. "set a reminder every monday to take out the recycling" Reported could-not-confirm (write-confirmation false negative). "remind me about that thing tomorrow" WRITE-TRUTH FAIL — WRONG/MISSING content "dentist appointment" — no saved todo row with matching identity (rows: about that thing) "uh same reminder as last week but for friday" OVER-ASK — asked instead of writing the note/todo/list (no saved row).
▸ UPDATE — update the entry	25	7 (28%)	18 (72%)	0 (0%)
18 handled wrong — click one to jump to its full detail below "set the expense report todo due date to friday at noon" WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write). "change take out trash from seven to eight thirty" Reported could-not-confirm (write-confirmation false negative). "mark defrost chicken done" OVER-ASK — asked instead of update (no notes-domain mutation). "mark all the morning tasks done" WRITE-TRUTH FAIL — UPDATE matched content but did not complete (no completed_at/state toggle). "check that off" OVER-ASK — asked instead of update (no notes-domain mutation). "uncheck water the plants I still need to do it" OVER-ASK — asked instead of update (no notes-domain mutation). "edit the grocery list change two percent milk to oat milk" Did not update — misroute-into-food. "change call insurance to call the insurance company about the claim" OVER-ASK — asked instead of update (no notes-domain mutation). "change the dentist reminder to next wednesday" OVER-ASK — asked instead of update (no notes-domain mutation). "update the note about the contractor start date to the twentieth" WRITE-TRUTH FAIL — UPDATE touched notes-domain rows but none matched expected content (contractor start date). "edit that note" OVER-ASK — asked instead of update (no notes-domain mutation). "no I said bread not butter" WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write). "actually make that almond milk not regular milk" Reported could-not-confirm (write-confirmation false negative). "add to the note about the wifi password it changes every month" Reported could-not-confirm (write-confirmation false negative). "move eggs to the top of my grocery list" Did not update — misroute-into-food. "move milk below bread on the shopping list" Reported could-not-confirm (write-confirmation false negative). "move passport to the top of the packing list" Reported could-not-confirm (write-confirmation false negative). "swap the order of eggs and milk on groceries" WRITE-TRUTH FAIL — misroute-into-food: UPDATE on notes/todo/list wrote food_log_entries.
▸ DELETE — delete the entry	8	5 (63%)	3 (38%)	0 (0%)
3 handled wrong — click one to jump to its full detail below "remove eggs from groceries" OVER-ASK — asked instead of delete (no notes-domain mutation). "remove that from the list" OVER-ASK — asked instead of delete (no notes-domain mutation). "remove the second item on my grocery list" OVER-ASK — asked instead of delete (no notes-domain mutation).
Total	102	60 (59%)	42	0

PASSshould log the food"note that the wifi password is sunflower22" (difficulty —)0.7s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: the wifi password is sunflower22.

Why verdict Notes write-truth verified: the wifi password is sunflower22.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.7s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the wifi password is sunflower22.

3 · App data rows written No food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:01.640Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"jot down that parking is free after six on main street" (difficulty —)0.6s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: parking is free after six on main street.

Why verdict Notes write-truth verified: parking is free after six on main street.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.6s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about parking is free after six on main street.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:13.391Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remember the spare key is under the blue flower pot" (difficulty —)0.6s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: the spare key is under the blue flower pot.

Why verdict Notes write-truth verified: the spare key is under the blue flower pot.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.6s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the spare key is under the blue flower pot.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:25.159Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"make a note the contractor said they start on the fifteenth" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: the contractor said they start on the fifteenth.

Why verdict Notes write-truth verified: the contractor said they start on the fifteenth.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the contractor said they start on the fifteenth.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:36.558Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"save a note my blood pressure was one twenty over eighty this morning" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: my blood pressure was one twenty over eighty this morning.

Why verdict Notes write-truth verified: my blood pressure was one twenty over eighty this morning.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about my blood pressure was one twenty over eighty this morning.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:48.075Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"note from the meeting budget is due friday" (difficulty —)0.4s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: budget is due friday, Meeting.

Why verdict Notes write-truth verified: budget is due friday, Meeting.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Logged your note in Meeting about budget is due friday. Say if that category should be different.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:39:59.759Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"jot that Jake's jersey size is youth large" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Jake's jersey size is youth large.

Why verdict Notes write-truth verified: Jake's jersey size is youth large.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about Jake's jersey size is youth large.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:40:11.224Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"note that the client prefers email over phone" (difficulty —)0.6s

Verdict Expected LOG — should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.6s

1 · TTS said no speech captured

2 · Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:40:22.975Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"quick note the gym locker code is four seven two nine" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: the gym locker code is four seven two nine.

Why verdict Notes write-truth verified: the gym locker code is four seven two nine.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the gym locker code is four seven two nine.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:40:34.375Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"note that down" (difficulty —)0.3s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — WRONG/MISSING content "parking on Main Street" — no saved note row with matching identity (rows: the client prefers email over phone)

Why verdict WRITE-TRUTH FAIL — WRONG/MISSING content "parking on Main Street" — no saved note row with matching identity (rows: the client prefers email over phone)

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the client prefers email over phone.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:40:45.810Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"jot this down somewhere" (difficulty —)0.3s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — WRONG/MISSING content "contractor needs the deposit by Friday" — no saved note row with matching identity (rows: the parking thing on main street)

Why verdict WRITE-TRUTH FAIL — WRONG/MISSING content "contractor needs the deposit by Friday" — no saved note row with matching identity (rows: the parking thing on main street)

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Logged your note in General about the parking thing on main street.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:41:14.210Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"append also grab oat milk to my latest note" (difficulty —)0.3s

Verdict Expected UPDATE — should update the entry. PASS: Notes UPDATE write-truth verified (changed:personal_notes×1).

Why verdict Notes UPDATE write-truth verified (changed:personal_notes×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Updated your note in General about the parking thing on main street.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:41:53.509Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me to call the dentist tomorrow" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: call the dentist.

Why verdict Notes write-truth verified: call the dentist.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: call the dentist. Priority 3, due Jul 31. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: call the dentist

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:42:04.976Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add pick up dry cleaning to my to-do list" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: pick up dry cleaning.

Why verdict Notes write-truth verified: pick up dry cleaning.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: pick up dry cleaning. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: pick up dry cleaning

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:42:16.392Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"put return the library books on my to-dos" (difficulty —)0.4s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: return the library books.

Why verdict Notes write-truth verified: return the library books.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Added to-do: return the library books. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: return the library books

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:42:27.894Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"uh put buy birthday card for mom on my list" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:42:39.059Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me to text Sarah about dinner plans" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: text Sarah about dinner plans.

Why verdict Notes write-truth verified: text Sarah about dinner plans.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: text Sarah about dinner plans. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: text Sarah about dinner plans

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:42:50.411Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"put schedule oil change on my car to-do list" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: schedule oil change.

Why verdict Notes write-truth verified: schedule oil change.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: schedule oil change. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: schedule oil change

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:43:01.744Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add call the insurance company to my morning list" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "todo_categories",
  "record": {
    "id": "seed-todo-cat-morning",
    "name": "Morning",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

snapshot captured 2026-07-30T19:43:26.144Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"new todo finish the slide deck by thursday" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: finish the slide deck.

Why verdict Notes write-truth verified: finish the slide deck.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: finish the slide deck. Priority 3, due Jul 30. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: finish the slide deck

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:43:37.576Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me friday morning to submit the expense report" (difficulty —)0.4s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: submit the expense report.

Why verdict Notes write-truth verified: submit the expense report.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Added to-do: submit the expense report. Priority 3, due Jul 31. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: submit the expense report

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:44:04.111Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add a to-do to renew my passport in the category Admin" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: renew my passport.

Why verdict Notes write-truth verified: renew my passport.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: renew my passport. Priority 3.

3 · App data rows written created todo_item: renew my passport

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:44:15.479Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"remind me tomorrow" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown Want me to add that as a to-do or a list item?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:44:26.645Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add it to todos" (difficulty —)0.0s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: submit my timesheet.

Why verdict Notes write-truth verified: submit my timesheet.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown What should the to-do say?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:44:51.361Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"make sure I text Sarah back and also add a to-do to buy milk" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: buy milk, text Sarah back.

Why verdict Notes write-truth verified: buy milk, text Sarah back.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added 2 to-dos: text Sarah back; buy milk.

3 · App data rows written created todo_item: text Sarah back
created todo_item: buy milk

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:45:14.080Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"remind me when I get home to defrost the chicken" (difficulty —)5.3s

Verdict Expected LOG — should log the food. FAIL: Did not write — misroute-into-food; no notes-domain saved row.

Why verdict Did not write — misroute-into-food; no notes-domain saved row.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.3s

1 · TTS said no speech captured

2 · Card shown What exact food and amount should I use for Chicken breast? I did not log it yet because I could not safely finish that food log.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:45:30.495Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me later" (difficulty —)0.0s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: mail the package this afternoon.

Why verdict Notes write-truth verified: mail the package this afternoon.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown What should the to-do say?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:45:41.645Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"start a grocery list" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Grocery List.

Why verdict Notes write-truth verified: Grocery List.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Created list: Grocery list.

3 · App data rows written created general_list: Grocery List

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:46:04.194Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"create a packing list for the trip" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Packing List For The Trip.

Why verdict Notes write-truth verified: Packing List For The Trip.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Created list: Packing list for the trip.

3 · App data rows written created general_list: Packing List For The Trip

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:46:15.613Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"new list called weekend projects" (difficulty —)1.9s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 1.9s

1 · TTS said no speech captured

2 · Card shown I did not make any app changes. What would you like me to do with that?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:46:28.695Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"make a shopping list" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Shopping List.

Why verdict Notes write-truth verified: Shopping List.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Created list: Shopping list.

3 · App data rows written created general_list: Shopping List

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:46:40.105Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"start a beach list for saturday" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Beach List For Saturday.

Why verdict Notes write-truth verified: Beach List For Saturday.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Created list: Beach list for saturday.

3 · App data rows written created general_list: Beach List For Saturday

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:46:51.450Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"make a new list for that" (difficulty —)0.0s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Camping Supplies List.

Why verdict Notes write-truth verified: Camping Supplies List.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown What should I call the new list?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:47:02.633Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"create a hardware store list" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Hardware Store List.

Why verdict Notes write-truth verified: Hardware Store List.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Created list: Hardware store list.

3 · App data rows written created general_list: Hardware Store List

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:47:25.284Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"new pet supplies list please" (difficulty —)2.1s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 2.1s

1 · TTS said no speech captured

2 · Card shown I did not make any app changes. What would you like me to do with that?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:47:38.632Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add milk to my grocery list" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: milk.

Why verdict Notes write-truth verified: milk.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added milk to Grocery List. Say if that (Grocery List) is the wrong list.

3 · App data rows written created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:47:49.982Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add greek yogurt to the shopping list" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: greek yogurt.

Why verdict Notes write-truth verified: greek yogurt.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added greek yogurt to Shopping List. Say if that (Shopping List) is the wrong list.

3 · App data rows written created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:48:01.482Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add cat litter to my pet supplies list" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Pet Supplies, cat litter.

Why verdict Notes write-truth verified: Pet Supplies, cat litter.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Created list: Pet supplies. Added cat litter.

3 · App data rows written created general_list: Pet Supplies
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:48:12.881Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add charger and passport to my packing list" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: passport, charger.

Why verdict Notes write-truth verified: passport, charger.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added 2 items to Packing List For The Trip: charger and passport. Say if that (Packing List For The Trip) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:48:24.348Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add fix the leaky faucet to weekend projects" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I wasn't sure which food you meant to correct. Could you try again with a bit more detail?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:48:35.531Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add sunscreen and snacks to the beach list" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: snacks, sunscreen.

Why verdict Notes write-truth verified: snacks, sunscreen.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added 2 items to Beach List For Saturday: sunscreen and snacks. Say if that (Beach List For Saturday) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:49:02.498Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add two bottles of sparkling water to groceries" (difficulty —)1.7s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Groceries, two bottles of sparkling water.

Why verdict Notes write-truth verified: Groceries, two bottles of sparkling water.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 1.7s

1 · TTS said no speech captured

2 · Card shown Created list: Groceries. Added two bottles of sparkling water.

3 · App data rows written created general_list: Groceries
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:49:15.313Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"put milk on the list" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown Which list should I add milk to?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "general_lists",
  "record": {
    "id": "seed-list-shopping",
    "name": "Shopping",
    "description": null,
    "list_type": "shopping",
    "archived": false,
    "sort_mode": "manual",
    "sort_direction": "asc",
    "aliases": [],
    "created_at": {
      "$relativeDays": -14
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T19:49:26.499Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add eggs" (difficulty —)0.1s

Verdict Expected LOG — should log the food. FAIL: Did not write — misroute-into-food; no notes-domain saved row.

Why verdict Did not write — misroute-into-food; no notes-domain saved row.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown How much should I log for Egg? I did not log it yet because the amount was not clear.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:49:48.916Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add that to my list" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown Which list should I add that to, and what is the item called?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:50:13.749Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add olive oil and paper towels to groceries" (difficulty —)0.5s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: paper towels, olive oil.

Why verdict Notes write-truth verified: paper towels, olive oil.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Added 2 items to Groceries: olive oil and paper towels. Say if that (Groceries) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:50:36.533Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add batteries and light bulbs to the hardware list" (difficulty —)0.1s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Did you mean 2 items: batteries and light bulbs?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:50:47.715Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"put that on packing" (difficulty —)0.0s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown What should I add to Packing List For The Trip?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:50:58.882Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add 1.5 cups of rice to my meal prep list" (difficulty —)3.7s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Meal Prep, 1.5 cups of rice.

Why verdict Notes write-truth verified: Meal Prep, 1.5 cups of rice.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 3.7s

1 · TTS said no speech captured

2 · Card shown Created list: Meal prep. Added 1.5 cups of rice.

3 · App data rows written created general_list: Meal Prep
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:51:24.999Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add the usual stuff to shopping" (difficulty —)0.0s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: bread, eggs, milk.

Why verdict Notes write-truth verified: bread, eggs, milk.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown What should I add to Shopping List?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "general_lists",
  "record": {
    "id": "seed-list-shopping-usual",
    "name": "Shopping",
    "description": null,
    "list_type": "shopping",
    "archived": false,
    "sort_mode": "manual",
    "sort_direction": "asc",
    "aliases": [],
    "created_at": {
      "$relativeDays": -14
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-usual-milk",
    "list_id": "seed-list-shopping-usual",
    "position": 0,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "milk",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-usual-eggs",
    "list_id": "seed-list-shopping-usual",
    "position": 1,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "eggs",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-usual-bread",
    "list_id": "seed-list-shopping-usual",
    "position": 2,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "bread",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

snapshot captured 2026-07-30T19:51:36.183Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add eggs bread and butter to the shopping list" (difficulty —)0.4s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — WRONG/MISSING content "eggs" — no saved list_item row with matching identity (rows: butter); WRONG/MISSING content "bread" — no saved list_item row with matching identity (rows: butter)

Why verdict WRITE-TRUTH FAIL — WRONG/MISSING content "eggs" — no saved list_item row with matching identity (rows: butter); WRONG/MISSING content "bread" — no saved list_item row with matching identity (rows: butter)

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Added 3 items to Shopping List: eggs, bread, and butter. Say if that (Shopping List) is the wrong list.

3 · App data rows written created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:52:00.265Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"put bananas and uh the other thing on groceries" (difficulty —)0.1s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: peanut butter, bananas.

Why verdict Notes write-truth verified: peanut butter, bananas.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Did you mean 2 items: bananas and uh the other thing?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:52:11.481Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add milk eggs and bread to my grocery list" (difficulty —)0.7s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — WRONG/MISSING content "milk" — no saved list_item row with matching identity (rows: bread | eggs)

Why verdict WRITE-TRUTH FAIL — WRONG/MISSING content "milk" — no saved list_item row with matching identity (rows: bread | eggs)

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.7s

1 · TTS said no speech captured

2 · Card shown Added 3 items to Grocery List: milk, eggs, and bread. Say if that (Grocery List) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:52:34.782Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add tomatoes onions and cilantro to the taco night list" (difficulty —)0.5s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Taco Night, cilantro, onions, tomatoes.

Why verdict Notes write-truth verified: Taco Night, cilantro, onions, tomatoes.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Created list: Taco night. Added 3 items: tomatoes, onions, and cilantro.

3 · App data rows written created general_list: Taco Night
created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:52:46.433Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"throw apples oranges and bananas on the fruit list" (difficulty —)0.5s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Fruit, bananas, oranges, apples.

Why verdict Notes write-truth verified: Fruit, bananas, oranges, apples.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Created list: Fruit. Added 3 items: apples, oranges, and bananas.

3 · App data rows written created general_list: Fruit
created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:52:58.118Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add shampoo conditioner and body wash to the drugstore list" (difficulty —)0.4s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Drugstore, body wash, conditioner, shampoo.

Why verdict Notes write-truth verified: Drugstore, body wash, conditioner, shampoo.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Created list: Drugstore. Added 3 items: shampoo, conditioner, and body wash.

3 · App data rows written created general_list: Drugstore
created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:53:09.732Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add chicken thighs broccoli and brown rice to meal prep" (difficulty —)0.4s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: brown rice, broccoli, chicken thighs.

Why verdict Notes write-truth verified: brown rice, broccoli, chicken thighs.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.4s

1 · TTS said no speech captured

2 · Card shown Added 3 items to Meal Prep: chicken thighs, broccoli, and brown rice. Say if that (Meal Prep) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:53:21.318Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"put tape measure screws and anchors on the hardware list" (difficulty —)0.5s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: anchors, screws, tape measure.

Why verdict Notes write-truth verified: anchors, screws, tape measure.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Added 3 items to Hardware Store List: tape measure, screws, and anchors. Say if that (Hardware Store List) is the wrong list.

3 · App data rows written created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:53:32.965Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"add three avocados and two limes to groceries" (difficulty —)0.5s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — misroute-into-food: notes/todo/list intent wrote food_log_entries instead of a notes-domain table.

Why verdict WRITE-TRUTH FAIL — misroute-into-food: notes/todo/list intent wrote food_log_entries instead of a notes-domain table.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Logged three avocados and Lime.

3 · App data rows written created food_log_entry: Avocado ×1 (3 avocados) 720 cal · 9g P · 38.3g C · 66.1g F
created food_log_entry: Lime ×2 (2 limes) 80 cal · 1.8g P · 28.2g C · 0.6g F

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:53:44.551Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method The answer used provisional food evidence from the common-food list.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"add dish soap sponges and trash bags to the household list" (difficulty —)0.5s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: Household, trash bags, sponges, dish soap.

Why verdict Notes write-truth verified: Household, trash bags, sponges, dish soap.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Created list: Household. Added 3 items: dish soap, sponges, and trash bags.

3 · App data rows written created general_list: Household
created general_list_item:
created general_list_item:
created general_list_item:

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:53:56.300Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me to take out the trash tonight at seven" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: take out the trash tonight at seven.

Why verdict Notes write-truth verified: take out the trash tonight at seven.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: take out the trash tonight at seven. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: take out the trash tonight at seven

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:54:23.149Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me in two hours to check the oven" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: in two hours to check the oven.

Why verdict Notes write-truth verified: in two hours to check the oven.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: in two hours to check the oven. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: in two hours to check the oven

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:54:34.550Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me next monday to renew my car registration" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: renew my car registration.

Why verdict Notes write-truth verified: renew my car registration.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: renew my car registration. Priority 3, due Aug 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: renew my car registration

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:54:45.932Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"new to-do water the plants every sunday" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: water the plants every.

Why verdict Notes write-truth verified: water the plants every.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: water the plants every. Priority 3, due Aug 2. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: water the plants every

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:54:57.300Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me every morning at eight to take my vitamins" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: every morning at eight to take my vitamins.

Why verdict Notes write-truth verified: every morning at eight to take my vitamins.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: every morning at eight to take my vitamins. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: every morning at eight to take my vitamins

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:55:08.785Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"set a reminder every monday to take out the recycling" (difficulty —)5.8s

Verdict Expected LOG — should log the food. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.8s

1 · TTS said no speech captured

2 · Card shown Want me to add that as a to-do or a list item?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:55:25.749Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"remind me about that thing tomorrow" (difficulty —)0.2s

Verdict Expected LOG — should log the food. FAIL: WRITE-TRUTH FAIL — WRONG/MISSING content "dentist appointment" — no saved todo row with matching identity (rows: about that thing)

Why verdict WRITE-TRUTH FAIL — WRONG/MISSING content "dentist appointment" — no saved todo row with matching identity (rows: about that thing)

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: about that thing. Priority 3, due Jul 31. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: about that thing

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:55:37.250Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"new reminder for the appointment" (difficulty —)0.2s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: the appointment.

Why verdict Notes write-truth verified: the appointment.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown Added to-do: the appointment. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: the appointment

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:55:59.667Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould log the food"uh same reminder as last week but for friday" (difficulty —)1.6s

Verdict Expected LOG — should log the food. FAIL: OVER-ASK — asked instead of writing the note/todo/list (no saved row).

Why verdict OVER-ASK — asked instead of writing the note/todo/list (no saved row).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 1.6s

1 · TTS said no speech captured

2 · Card shown Got it. You want me to add a to-do for Friday, same as the one from last week. To do that, I’d need to know which previous to-do you’re referring to—could you say the title?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "todo_categories",
  "record": {
    "id": "seed-todo-cat-personal",
    "name": "Personal",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

Seeded value

{
  "table": "todo_items",
  "record": {
    "id": "seed-todo-last-week-reminder",
    "category_id": "seed-todo-cat-personal",
    "category_name": "Personal",
    "name": "Weekly reminder",
    "description": null,
    "priority": 3,
    "scheduled_date": null,
    "due_date": null,
    "completed_at": null,
    "created_at": {
      "$relativeDays": -7
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T19:56:34.618Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould log the food"remind me to pay the electric bill on the first of every month" (difficulty —)0.3s

Verdict Expected LOG — should log the food. PASS: Notes write-truth verified: pay the electric bill on the first of every month.

Why verdict Notes write-truth verified: pay the electric bill on the first of every month.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.3s

1 · TTS said no speech captured

2 · Card shown Added to-do: pay the electric bill on the first of every month. Priority 3. Tell me if the title or due date should be different.

3 · App data rows written created todo_item: pay the electric bill on the first of every month

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:56:57.081Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"set the expense report todo due date to friday at noon" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. FAIL: WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write).

Why verdict WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown I can create, complete, or list to-dos right now, but I cannot delete or rename them yet.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "todo_categories",
  "record": {
    "id": "seed-todo-cat-work",
    "name": "Work",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

Seeded value

{
  "table": "todo_items",
  "record": {
    "id": "seed-todo-expense",
    "category_id": "seed-todo-cat-work",
    "category_name": "Work",
    "name": "Expense report",
    "description": null,
    "priority": 3,
    "scheduled_date": null,
    "due_date": null,
    "completed_at": null,
    "created_at": {
      "$relativeDays": -7
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T19:57:08.267Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"change take out trash from seven to eight thirty" (difficulty —)5.8s

Verdict Expected UPDATE — should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.8s

1 · TTS said no speech captured

2 · Card shown What would you like me to do with that?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:57:25.247Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"mark call the dentist done" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. PASS: Notes UPDATE write-truth verified (changed:todo_items×1).

Why verdict Notes UPDATE write-truth verified (changed:todo_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Marked done: call the dentist.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:57:36.517Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"check off call the dentist" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. PASS: UPDATE — no notes-domain write (as expected).

Why verdict UPDATE — no notes-domain write (as expected).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown call the dentist is already done — want me to uncheck it?

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:58:00.784Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"mark pick up dry cleaning as complete" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. PASS: Notes UPDATE write-truth verified (changed:todo_items×1).

Why verdict Notes UPDATE write-truth verified (changed:todo_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Marked done: pick up dry cleaning.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:58:12.068Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"I finished the buy milk task" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. PASS: Notes UPDATE write-truth verified (changed:todo_items×1).

Why verdict Notes UPDATE write-truth verified (changed:todo_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Marked done: buy milk.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:58:23.334Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"mark the laundry done" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. PASS: Notes UPDATE write-truth verified (changed:todo_items×1).

Why verdict Notes UPDATE write-truth verified (changed:todo_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Marked done: laundry.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "todo_categories",
  "record": {
    "id": "seed-todo-cat-personal",
    "name": "Personal",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

Seeded value

{
  "table": "todo_items",
  "record": {
    "id": "seed-todo-laundry",
    "category_id": "seed-todo-cat-personal",
    "category_name": "Personal",
    "name": "laundry",
    "description": null,
    "priority": 3,
    "scheduled_date": null,
    "due_date": null,
    "completed_at": null,
    "created_at": {
      "$relativeDays": -7
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T19:58:34.616Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"mark defrost chicken done" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I could not find a to-do matching defrost chicken. Did you mean: pay the electric bill on the first of every month; the appointment; about that thing?

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:58:45.801Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"mark all the morning tasks done" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. FAIL: WRITE-TRUTH FAIL — UPDATE matched content but did not complete (no completed_at/state toggle).

Why verdict WRITE-TRUTH FAIL — UPDATE matched content but did not complete (no completed_at/state toggle).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Marked done: every morning at eight to take my vitamins.

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:58:57.216Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould update the entry"mark that done" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. PASS: UPDATE — no notes-domain write (as expected).

Why verdict UPDATE — no notes-domain write (as expected).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown Which to-do should I mark done: pay the electric bill on the first of every month; the appointment; about that thing?

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:59:08.451Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"check that off" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown Which to-do should I mark done: pay the electric bill on the first of every month; the appointment; about that thing?

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T19:59:46.068Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"uncheck water the plants I still need to do it" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I could not find a to-do matching water the plants. Did you mean: call the dentist; pick up dry cleaning; buy milk?

4 · UI did navigated to "todos" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:00:08.317Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould delete the entry"remove milk from my grocery list" (difficulty —)0.1s

Verdict Expected DELETE — should delete the entry. PASS: Notes DELETE write-truth verified (removed:general_list_items×1).

Why verdict Notes DELETE write-truth verified (removed:general_list_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Removed milk from the list. Say if that (Grocery List) is the wrong list.

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:00:19.534Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould delete the entry"remove eggs from groceries" (difficulty —)0.0s

Verdict Expected DELETE — should delete the entry. FAIL: OVER-ASK — asked instead of delete (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of delete (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I could not find a list item matching eggs on Groceries.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:00:30.769Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould delete the entry"take eggs off the list" (difficulty —)2.7s

Verdict Expected DELETE — should delete the entry. PASS: Notes DELETE write-truth verified (removed:general_list_items×1).

Why verdict Notes DELETE write-truth verified (removed:general_list_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 2.7s

1 · TTS said no speech captured

2 · Card shown Removed eggs from the list. Say if that is the wrong list.

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "general_lists",
  "record": {
    "id": "seed-list-grocery-eggs",
    "name": "Grocery",
    "description": null,
    "list_type": "shopping",
    "archived": false,
    "sort_mode": "manual",
    "sort_direction": "asc",
    "aliases": [],
    "created_at": {
      "$relativeDays": -14
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-eggs",
    "list_id": "seed-list-grocery-eggs",
    "position": 0,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "eggs",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

snapshot captured 2026-07-30T20:00:44.584Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould delete the entry"remove passport from the packing list" (difficulty —)0.1s

Verdict Expected DELETE — should delete the entry. PASS: Notes DELETE write-truth verified (removed:general_list_items×1).

Why verdict Notes DELETE write-truth verified (removed:general_list_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Removed passport from the list. Say if that (Packing List For The Trip) is the wrong list.

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:00:55.817Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould delete the entry"remove cat litter from pet supplies" (difficulty —)0.1s

Verdict Expected DELETE — should delete the entry. PASS: Notes DELETE write-truth verified (removed:general_list_items×1).

Why verdict Notes DELETE write-truth verified (removed:general_list_items×1).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Removed cat litter from the list. Say if that (Pet Supplies) is the wrong list.

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:01:07.015Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould delete the entry"remove that from the list" (difficulty —)0.1s

Verdict Expected DELETE — should delete the entry. FAIL: OVER-ASK — asked instead of delete (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of delete (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Which list item should I take off?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "general_lists",
  "record": {
    "id": "seed-list-default",
    "name": "Shopping",
    "description": null,
    "list_type": "shopping",
    "archived": false,
    "sort_mode": "manual",
    "sort_direction": "asc",
    "aliases": [],
    "created_at": {
      "$relativeDays": -14
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-recent",
    "list_id": "seed-list-default",
    "position": 0,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "butter",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

snapshot captured 2026-07-30T20:01:18.402Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

PASSshould delete the entry"remove bread and butter from the shopping list" (difficulty —)0.1s

Verdict Expected DELETE — should delete the entry. PASS: Notes DELETE write-truth verified (removed:general_list_items×2).

Why verdict Notes DELETE write-truth verified (removed:general_list_items×2).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown Removed 2 items: bread and butter. Say if that (Shopping List) is the wrong list.

4 · UI did navigated to "lists" screen

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:01:40.733Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould delete the entry"remove the second item on my grocery list" (difficulty —)0.0s

Verdict Expected DELETE — should delete the entry. FAIL: OVER-ASK — asked instead of delete (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of delete (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I could not find a list matching second item on my grocery.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "general_lists",
  "record": {
    "id": "seed-list-grocery-2",
    "name": "Grocery",
    "description": null,
    "list_type": "shopping",
    "archived": false,
    "sort_mode": "manual",
    "sort_direction": "asc",
    "aliases": [],
    "created_at": {
      "$relativeDays": -14
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-g1",
    "list_id": "seed-list-grocery-2",
    "position": 0,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "milk",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-g2",
    "list_id": "seed-list-grocery-2",
    "position": 1,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "eggs",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

Seeded value

{
  "table": "general_list_items",
  "record": {
    "id": "seed-item-g3",
    "list_id": "seed-list-grocery-2",
    "position": 2,
    "notes": null,
    "created_at": {
      "$relativeDays": -3
    },
    "updated_at": {
      "$relativeDays": -1
    },
    "deleted_at": null,
    "deleted_by_request_id": null,
    "title": "bread",
    "state": "active",
    "priority": null,
    "tags": [],
    "url": null,
    "due_date": null,
    "review_date": null,
    "source_utterance": null
  }
}

snapshot captured 2026-07-30T20:01:51.899Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"edit the grocery list change two percent milk to oat milk" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. FAIL: Did not update — misroute-into-food.

Why verdict Did not update — misroute-into-food.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown I couldn't identify which food entry you meant. Which one would you like to correct?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:02:03.116Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"change call insurance to call the insurance company about the claim" (difficulty —)1.8s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 1.8s

1 · TTS said no speech captured

2 · Card shown I could not find a list item matching "call insurance" on your to-do list. Did you mean: call the dentist; pick up dry cleaning; buy milk?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:02:16.051Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"change the dentist reminder to next wednesday" (difficulty —)2.5s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 2.5s

1 · TTS said no speech captured

2 · Card shown Want me to add that as a to-do or a list item?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:02:29.634Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"update the note about the contractor start date to the twentieth" (difficulty —)0.2s

Verdict Expected UPDATE — should update the entry. FAIL: WRITE-TRUTH FAIL — UPDATE touched notes-domain rows but none matched expected content (contractor start date).

Why verdict WRITE-TRUTH FAIL — UPDATE touched notes-domain rows but none matched expected content (contractor start date).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.2s

1 · TTS said no speech captured

2 · Card shown I could not confirm that the change was saved, so I did not mark it as done.

4 · UI did navigated to "notes" screen

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "personal_note_categories",
  "record": {
    "id": "seed-note-cat-general",
    "name": "General",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

Seeded value

{
  "table": "personal_notes",
  "record": {
    "id": "seed-note-contractor",
    "category_id": "seed-note-cat-general",
    "category_name": "General",
    "note_text": "Contractor start date is the fifteenth",
    "pinned_to_widget": false,
    "created_at": {
      "$relativeDays": -7
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T20:02:41.017Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"edit that note" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. FAIL: OVER-ASK — asked instead of update (no notes-domain mutation).

Why verdict OVER-ASK — asked instead of update (no notes-domain mutation).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:02:52.266Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"no I said bread not butter" (difficulty —)5.4s

Verdict Expected UPDATE — should update the entry. FAIL: WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write).

Why verdict WRITE-TRUTH FAIL — expected UPDATE missing; local notes-domain delta is 0 (proven no write).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.4s

1 · TTS said no speech captured

2 · Card shown Understood. I'll remove only the bread from the list.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:03:36.367Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"actually make that almond milk not regular milk" (difficulty —)0.1s

Verdict Expected UPDATE — should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.1s

1 · TTS said no speech captured

2 · Card shown I could not confirm that the change was saved, so I did not mark it as done.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:03:47.617Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"add to the note about the wifi password it changes every month" (difficulty —)0.0s

Verdict Expected UPDATE — should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.0s

1 · TTS said no speech captured

2 · Card shown I'm not sure how to help with that yet. Try asking me to log food, a workout, a note, or a to-do.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state:

Seeded value

{
  "table": "personal_note_categories",
  "record": {
    "id": "seed-note-cat-home",
    "name": "Home",
    "created_at": {
      "$relativeDays": -14
    }
  }
}

Seeded value

{
  "table": "personal_notes",
  "record": {
    "id": "seed-note-wifi",
    "category_id": "seed-note-cat-home",
    "category_name": "Home",
    "note_text": "Wifi password is blueharbor42",
    "pinned_to_widget": false,
    "created_at": {
      "$relativeDays": -7
    },
    "deleted_at": null,
    "deleted_by_request_id": null
  }
}

snapshot captured 2026-07-30T20:03:58.784Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"move eggs to the top of my grocery list" (difficulty —)5.4s

Verdict Expected UPDATE — should update the entry. FAIL: Did not update — misroute-into-food.

Why verdict Did not update — misroute-into-food.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.4s

1 · TTS said no speech captured

2 · Card shown What exact food and amount should I use for Egg? I did not log it yet because I could not safely finish that food log.

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:04:15.500Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"move milk below bread on the shopping list" (difficulty —)5.8s

Verdict Expected UPDATE — should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.8s

1 · TTS said no speech captured

2 · Card shown What would you like me to do with that?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:04:32.465Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"move passport to the top of the packing list" (difficulty —)5.8s

Verdict Expected UPDATE — should update the entry. FAIL: Reported could-not-confirm (write-confirmation false negative).

Why verdict Reported could-not-confirm (write-confirmation false negative).

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 5.8s

1 · TTS said no speech captured

2 · Card shown What would you like me to do with that?

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:05:04.768Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method No lookup method was captured for this path.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

FAILshould update the entry"swap the order of eggs and milk on groceries" (difficulty —)0.5s

Verdict Expected UPDATE — should update the entry. FAIL: WRITE-TRUTH FAIL — misroute-into-food: UPDATE on notes/todo/list wrote food_log_entries.

Why verdict WRITE-TRUTH FAIL — misroute-into-food: UPDATE on notes/todo/list wrote food_log_entries.

My override

Things I think are wrong

Use this when the report passed something that should have failed.

Comprehension

Picked wrong food Wrong quantity Should have asked (over-logged) Shouldn't have asked (over-asked) Wrong action entirely

Execution

Didn't save to DB Wrong data saved No voice/TTS Card missing/wrong No chat

Cosmetic

Wording weird

Other thing wrong (describe below)

Things the report marked wrong but I think are right

Use this when the report failed something that should have passed.

Actually right

Food/action was right Quantity/serving was right Asking was right Not asking was right Answer was right No app data row was expected App data row was right Voice/card/chat was acceptable

Report/grader issue

Report expected the wrong result Evidence was enough to judge Failure reason was not valid

Other thing actually right (describe below)

Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.

Timing 0.5s

1 · TTS said no speech captured

2 · Card shown Logged Egg and Milk. Assumed catalog default servings where you did not say an amount — tell me if that is not right.

3 · App data rows written created food_log_entry: Egg ×1 (50 g) 72 cal · 6.3g P · 0.4g C · 4.8g F
created food_log_entry: Milk ×1 (100 g) 50 cal · 3.3g P · 4.8g C · 2g F

4 · UI did no screen events captured

5 · Seed/context data

Seeded starting state: none listed in the corpus row.

No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.

snapshot captured 2026-07-30T20:05:16.466Z

6 · Why this food No food-decision explanation was captured for this path.

7 · Lookup method The answer used provisional food evidence from the common-food list.

8 · Candidates → decider no candidate list captured (this path did not run DB resolution — e.g. provisional branded log)

Why the fails happened — comprehension vs execution vs cosmetic

Handled correctly? — by expected action

Accuracy by difficulty

Clarification follow-ups — scored separately

Cosmetic only

System / infra

Latency

Filter — controls the list below

Per-utterance detail