"Unverified" = the grader couldn't confidently call it PASS or FAIL from the trace β needs a human look (that's you π/π-ing it). "Pass rate" = pass Γ· (pass + fail) β it excludes Unverified rows, so it differs slightly from the Pass % above (which is share of ALL rows).
Why the fails happened β comprehension vs execution vs cosmetic
Comprehension β picked the wrong action/target (the hard problem)
6 (100%)
resolution β 4 (67% of comprehension)
"What did I eat yesterday?" β Did not answer the query correctly.
"How many breakfast entries did I log today?" β Did not answer the query correctly.
"How many snack entries did I log today?" β Did not answer the query correctly.
"What was my average dinner calorie total for the six completed days?" β Did not answer the query correctly.
routing β 1 (17% of comprehension)
"Go back to today in my food diary." β Did not navigate where asked.
other β 1 (17% of comprehension)
"Good to know." β Did not handle the OTHER request correctly.
Of 6 fails: if most are comprehension, that's the hard problem (the app didn't figure out the right action/target); execution/cosmetic means the decision was right but something downstream broke. Click a bar for the sub-split + example utterances.
Handled correctly? β by expected action
Click a row to see the ones it got wrong; click a wrong utterance to jump to its full detail below.
Supposed to
N
Correct
Wrong
Unverified
βΈ QUERY β answer the query
72
68 (94%)
4 (6%)
0 (0%)
4 handled wrong β click one to jump to its full detail below
"What did I eat yesterday?"
answer did not state expected numeric value(s): mealCount
"How many breakfast entries did I log today?"
answer did not state expected numeric value(s): entryCount
"How many snack entries did I log today?"
answer did not state expected numeric value(s): entryCount
"What was my average dinner calorie total for the six completed days?"
answer did not state expected numeric value(s): averageCalories
βΈ NAVIGATE β navigate
3
2 (67%)
1 (33%)
0 (0%)
1 handled wrong β click one to jump to its full detail below
"Go back to today in my food diary."
Did not navigate β misrouted into a food/workout clarification or dead-ended.
βΈ OTHER β handle appropriately
3
2 (67%)
1 (33%)
0 (0%)
1 handled wrong β click one to jump to its full detail below
"Good to know."
OTHER conversation_acknowledgement β response was not an acknowledgement or was too long
Total
78
72 (92%)
6
0
Accuracy by difficulty
Pending A1's per-utterance difficulty score (requested 2026-07-05) β this bar chart lights up once that lands.
Clarification follow-ups β scored separately
Second turn: app asked, we replied β did it resolve correctly?
No CLARIFY_ANSWER (follow-up) rows in this run.
Cosmetic only
Not yet classified β pending A1 adding cosmetic-issue detection (double response, wording variance, rounding) to the grader. Nothing fabricated here.
System / infra
Not yet classified β pending confirmation from A1 whether trace data already carries infra-error signal (TTS/sync/DB-write errors) or needs new detection.
Latency
Avg (time to ready)
0.1s
p90
0.1s
Max
1.8s
Went async
0 (0%)
Each dot is one utterance (green=pass, red=fail, amber=unverified), positioned by how long it took to be ready for review. Bigger dots are the slow outliers β click any dot to jump to its detail.
0s
1s
2s
5s
Response path β quick (single response) vs async (an ack like "Working on itβ¦" before the real answer).
Quick response
78
Slowest 8 utterances (click to jump to detail):
"Thanks, that is helpful."1.8s
"Go back to today in my food diary."1.6s
"Okay, let us keep going."1.0s
"How many snack entries did I log today?"0.1s
"On how many days did I reach at least 120 grams of protein?"0.1s
"How many calories were in the protein shake I logged?"0.1s
"Based on what is logged, which day had the fewest calories this week?"0.1s
"How much protein came from salmon this week?"0.1s
Filter β controls the list below
Pass / Fail / Unverified
PASS 72FAIL 6UNVERIFIED 0
Module (intended for)
Other (78)
Utterance sub-type (within module)
78 shown β 72 pass, 6 fail, 0 unverified
Per-utterance detail
PASSshould answer the query"How many calories have I logged today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 1425 calories today.
2 Β· Card shown You logged 1425 calories today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What is my calorie total so far today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 1425 calories today.
2 Β· Card shown You logged 1425 calories today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:09.185Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein have I had today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 116 grams of protein today.
2 Β· Card shown You logged 116 grams of protein today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:20.347Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much fat have I logged today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 47 grams of fat today.
2 Β· Card shown You logged 47 grams of fat today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:31.522Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs have I had today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 141 grams of carbs today.
2 Β· Card shown You logged 141 grams of carbs today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:42.689Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Give me all my macros for today so far." (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Today. Items: 1 1 fixture serving Codex Test Fixture Codex Test Eggs; 1 1 fixture serving Codex Test Fixture Codex Test Whole Grain Toast; 1 1 fixture serving Codex Test Fixture Codex Test Avocado; 1 1 fixture serving Codex Test Fixture Codex Test Chicken Breast; 1 1 fixture serving Codex Test Fixture Codex Test Quinoa; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli; 1 1 fixture serving Codex Test Fixture Codex Test Banana; 1 1 fixture serving Codex Test Fixture Codex Test Protein Shake. Calories: 1425. Protein: 116 grams. Fat: 47 grams. Carbs: 141 grams. Entry count: 8.
2 Β· Card shown Today. Items: 1 1 fixture serving Codex Test Fixture Codex Test Eggs; 1 1 fixture serving Codex Test Fixture Codex Test Whole Grain Toast; 1 1 fixture serving Codex Test Fixture Codex Test Avocado; 1 1 fixture serving Codex Test Fixture Codex Test Chicken Breast; 1 1 fixture serving Codex Test Fixture Codex Test Quinoa; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli; 1 1 fixture serving Codex Test Fixture Codex Test Banana; 1 1 fixture serving Codex Test Fixture Codex Test Protein Shake. Calories: 1425. Protein: 116 grams. Fat: 47 grams. Carbs: 141 grams. Entry count: 8.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:33:53.873Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories did I have yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 1665 calories yesterday.
2 Β· Card shown You logged 1665 calories yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:05.036Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein did I eat yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 111 grams of protein yesterday.
2 Β· Card shown You logged 111 grams of protein yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:16.402Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much fat did I have yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 41 grams of fat yesterday.
2 Β· Card shown You logged 41 grams of fat yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:27.570Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs did I eat yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 215 grams of carbs yesterday.
2 Β· Card shown You logged 215 grams of carbs yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:38.742Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What were my total calories and macros yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries; 1 1 fixture serving Codex Test Fixture Codex Test Turkey Sandwich; 1 1 fixture serving Codex Test Fixture Codex Test Greek Yogurt; 1 1 fixture serving Codex Test Fixture Codex Test Apple; 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 1665. Protein: 111 grams. Fat: 41 grams. Carbs: 215 grams. Entry count: 8.
2 Β· Card shown Yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries; 1 1 fixture serving Codex Test Fixture Codex Test Turkey Sandwich; 1 1 fixture serving Codex Test Fixture Codex Test Greek Yogurt; 1 1 fixture serving Codex Test Fixture Codex Test Apple; 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 1665. Protein: 111 grams. Fat: 41 grams. Carbs: 215 grams. Entry count: 8.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:34:49.920Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould answer the query"What did I eat yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. FAIL: answer did not state expected numeric value(s): mealCount
Why verdict answer did not state expected numeric value(s): mealCount
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries; 1 1 fixture serving Codex Test Fixture Codex Test Turkey Sandwich; 1 1 fixture serving Codex Test Fixture Codex Test Greek Yogurt; 1 1 fixture serving Codex Test Fixture Codex Test Apple; 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 1665. Protein: 111 grams. Fat: 41 grams. Carbs: 215 grams. Entry count: 8.
2 Β· Card shown Yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries; 1 1 fixture serving Codex Test Fixture Codex Test Turkey Sandwich; 1 1 fixture serving Codex Test Fixture Codex Test Greek Yogurt; 1 1 fixture serving Codex Test Fixture Codex Test Apple; 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 1665. Protein: 111 grams. Fat: 41 grams. Carbs: 215 grams. Entry count: 8.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:01.068Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What did I have for breakfast yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Breakfast yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries. Calories: 380. Protein: 11 grams. Fat: 6 grams. Carbs: 74 grams. Entry count: 2.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:12.249Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What was lunch yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:23.422Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What snacks did I log yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Snack yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Greek Yogurt; 1 1 fixture serving Codex Test Fixture Codex Test Apple. Calories: 235. Protein: 20 grams. Fat: 0 grams. Carbs: 40 grams. Entry count: 2.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:34.682Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What did I have for dinner yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Dinner yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 600. Protein: 48 grams. Fat: 21 grams. Carbs: 51 grams. Entry count: 3.
2 Β· Card shown Dinner yesterday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Salmon; 1 1 fixture serving Codex Test Fixture Codex Test Sweet Potato; 1 1 fixture serving Codex Test Fixture Codex Test Broccoli. Calories: 600. Protein: 48 grams. Fat: 21 grams. Carbs: 51 grams. Entry count: 3.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:45.852Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in the banana I logged today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Banana today. Calories: 105.
2 Β· Card shown Codex Test Banana today. Calories: 105.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:35:57.039Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein was in today's banana?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Banana today. Protein: 1 grams.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:08.225Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Banana" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in the protein shake I logged?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Protein Shake today. Calories: 240.
2 Β· Card shown Codex Test Protein Shake today. Calories: 240.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:19.395Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Protein powder" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in the chicken at lunch today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Codex Test Chicken Breast at lunch today. Calories: 250.
2 Β· Card shown Codex Test Chicken Breast at lunch today. Calories: 250.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:30.620Z
6 Β· Why this food
The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
Matched the common-food list to "Chicken breast" at 90% confidence.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many times did I have chicken this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged Codex Test Chicken Breast 5 times this week.
2 Β· Card shown You logged Codex Test Chicken Breast 5 times this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:36:53.355Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many bananas did I log this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged Codex Test Banana 4 times this week.
2 Β· Card shown You logged Codex Test Banana 4 times this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:04.536Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many times did I eat salmon this week?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged Codex Test Salmon 3 times this week.
2 Β· Card shown You logged Codex Test Salmon 3 times this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:15.714Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many turkey sandwiches did I have this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged Codex Test Turkey Sandwich 3 times this week.
2 Β· Card shown You logged Codex Test Turkey Sandwich 3 times this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:26.888Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many food entries have I logged this week?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You have 59 food entries logged this week.
2 Β· Card shown You have 59 food entries logged this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:38.053Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many food entries did I log today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You have 8 food entries logged today.
2 Β· Card shown You have 8 food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:37:49.219Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould answer the query"How many breakfast entries did I log today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. FAIL: answer did not state expected numeric value(s): entryCount
Why verdict answer did not state expected numeric value(s): entryCount
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have 3 breakfast food entries logged today.
2 Β· Card shown You have 3 breakfast food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:00.415Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould answer the query"How many snack entries did I log today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. FAIL: answer did not state expected numeric value(s): entryCount
Why verdict answer did not state expected numeric value(s): entryCount
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have 2 snack food entries logged today.
2 Β· Card shown You have 2 snack food entries logged today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:11.618Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories did I log Monday?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 1590 calories on Monday.
2 Β· Card shown You logged 1590 calories on Monday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:22.901Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein did I have Monday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 129 grams of protein on Monday.
2 Β· Card shown You logged 129 grams of protein on Monday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:34.091Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs did I eat Monday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 185 grams of carbs on Monday.
2 Β· Card shown You logged 185 grams of carbs on Monday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:45.281Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What did I have for breakfast Monday?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Breakfast on Monday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries. Calories: 380. Protein: 11 grams. Fat: 6 grams. Carbs: 74 grams. Entry count: 2.
2 Β· Card shown Breakfast on Monday. Items: 1 1 fixture serving Codex Test Fixture Codex Test Oatmeal; 1 1 fixture serving Codex Test Fixture Codex Test Blueberries. Calories: 380. Protein: 11 grams. Fat: 6 grams. Carbs: 74 grams. Entry count: 2.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:38:56.403Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much fat did I have Tuesday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 57 grams of fat on Tuesday.
2 Β· Card shown You logged 57 grams of fat on Tuesday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:07.597Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What was my calorie total Tuesday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 1645 calories on Tuesday.
2 Β· Card shown You logged 1645 calories on Tuesday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:18.770Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein did I eat Wednesday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 139 grams of protein on Wednesday.
2 Β· Card shown You logged 139 grams of protein on Wednesday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:29.936Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in Wednesday dinner?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Dinner on Wednesday: 560 calories.
2 Β· Card shown Dinner on Wednesday: 560 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:41.102Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs did I have Thursday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 165 grams of carbs on Thursday.
2 Β· Card shown You logged 165 grams of carbs on Thursday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:39:52.307Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein was in Thursday breakfast?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Breakfast on Thursday: 27 grams of protein.
2 Β· Card shown Breakfast on Thursday: 27 grams of protein.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:03.517Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories did I eat Friday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 2015 calories on Friday.
2 Β· Card shown You logged 2015 calories on Friday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:14.695Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.6 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in Friday dinner?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Dinner on Friday: 820 calories.
2 Β· Card shown Dinner on Friday: 820 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:25.890Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What was my protein total yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 111 grams of protein yesterday.
2 Β· Card shown You logged 111 grams of protein yesterday.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:48.589Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories have I logged this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 11750 calories this week.
2 Β· Card shown You logged 11750 calories this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:40:59.765Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein have I logged this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 870 grams of protein this week.
2 Β· Card shown You logged 870 grams of protein this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:10.932Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much fat have I logged this week?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You logged 347 grams of fat this week.
2 Β· Card shown You logged 347 grams of fat this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:22.101Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs have I logged this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You logged 1292 grams of carbs this week.
2 Β· Card shown You logged 1292 grams of carbs this week.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:33.283Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What is my average daily calorie total this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Average daily calories: 1678.5714 calories.
2 Β· Card shown Average daily calories: 1678.5714 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:44.471Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What is my average protein per day this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Average daily protein: 124.2857 g protein.
2 Β· Card shown Average daily protein: 124.2857 g protein.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:41:55.665Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Which day had the most calories this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Friday had the most calories this week. Calories: 2015.
2 Β· Card shown Friday had the most calories this week. Calories: 2015.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:06.847Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Based on what is logged, which day had the fewest calories this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Sunday had the fewest calories this week. Calories: 1425.
2 Β· Card shown Sunday had the fewest calories this week. Calories: 1425.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:18.049Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.1 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories do I have left today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have about 775 calories left in today's budget (1425 of 2200 logged).
2 Β· Card shown You have about 775 calories left in today's budget (1425 of 2200 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:29.251Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories are left for dinner?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said You have about 775 calories left in today's budget (1425 of 2200 logged).
2 Β· Card shown You have about 775 calories left in today's budget (1425 of 2200 logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:40.480Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein do I have left today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have about 34 grams of protein left today (116 of 150 grams logged).
2 Β· Card shown You have about 34 grams of protein left today (116 of 150 grams logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:42:51.634Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much fat is left in my budget today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have about 23 grams of fat left today (47 of 70 grams logged).
2 Β· Card shown You have about 23 grams of fat left today (47 of 70 grams logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:02.851Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many carbs do I have left today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said You have about 109 grams of carbs left today (141 of 250 grams logged).
2 Β· Card shown You have about 109 grams of carbs left today (141 of 250 grams logged).
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:13.997Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What percent of my calorie goal have I used today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:25.186Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Am I over my calorie goal today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Over calorie goal: No. Calories over: 0. Calories remaining: 775.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:36.354Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Did I get more protein today or yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Today: 116 g protein. Yesterday: 111 g protein. Difference: 5 g protein.
2 Β· Card shown Today: 116 g protein. Yesterday: 111 g protein. Difference: 5 g protein.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:47.520Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Did I eat more calories today or yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:43:58.657Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Was my fat higher today or yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Today: 47 g fat. Yesterday: 41 g fat. Difference: 6 g fat.
2 Β· Card shown Today: 47 g fat. Yesterday: 41 g fat. Difference: 6 g fat.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:09.825Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Did I have more carbs today or yesterday?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Today: 141 g carbs. Yesterday: 215 g carbs. Difference: 74 g carbs.
2 Β· Card shown Today: 141 g carbs. Yesterday: 215 g carbs. Difference: 74 g carbs.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:21.031Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Which had more protein, Monday or Friday?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Monday: 129 g protein. Friday: 142 g protein. Difference: 13 g protein.
2 Β· Card shown Monday: 129 g protein. Friday: 142 g protein. Difference: 13 g protein.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:43.731Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"Which had more calories, Tuesday or Thursday?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:44:54.899Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in breakfast today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Breakfast today: 550 calories.
2 Β· Card shown Breakfast today: 550 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:06.103Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in lunch today?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Lunch today: 530 calories.
2 Β· Card shown Lunch today: 530 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:17.312Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.8 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories were in my snacks today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Snack today: 345 calories.
2 Β· Card shown Snack today: 345 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:28.464Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.7 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"What was my largest meal today?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Breakfast was your largest meal today. Calories: 550.
2 Β· Card shown Breakfast was your largest meal today. Calories: 550.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:39.678Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories came from chicken this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Chicken Breast this week. Calories: 1250.
2 Β· Card shown Codex Test Chicken Breast this week. Calories: 1250.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:45:50.852Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many calories came from bananas this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Banana this week. Calories: 420.
2 Β· Card shown Codex Test Banana this week. Calories: 420.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:02.054Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How much protein came from salmon this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Codex Test Salmon this week. Protein: 120 grams.
2 Β· Card shown Codex Test Salmon this week. Protein: 120 grams.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:13.286Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"How many breakfast calories did I log this week?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Breakfast this week: 2885 calories.
2 Β· Card shown Breakfast this week: 2885 calories.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:24.465Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.9 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould answer the query"What was my average dinner calorie total for the six completed days?" (difficulty β)0.0s
Verdict Expected QUERY β should answer the query. FAIL: answer did not state expected numeric value(s): averageCalories
Why verdict answer did not state expected numeric value(s): averageCalories
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said I could not find a to-do matching days.
2 Β· Card shown I could not find a to-do matching days.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "todos" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:35.635Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould answer the query"On how many days did I reach at least 120 grams of protein?" (difficulty β)0.1s
Verdict Expected QUERY β should answer the query. PASS: Query answered within tolerance.
Why verdict Query answered within tolerance.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.1s
1 Β· TTS said Days at or above 120 g protein: 4.
2 Β· Card shown Days at or above 120 g protein: 4.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:47.036Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 1.0 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Open my food history." (difficulty β)0.0s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Opening Food History.
2 Β· Card shown Opening Food History.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:46:58.213Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould handle appropriately"Thanks, that is helpful." (difficulty β)1.8s
Verdict Expected OTHER β should handle appropriately. PASS: OTHER conversation_acknowledgement β brief acknowledgement with no write on the general route.
Why verdict OTHER conversation_acknowledgement β brief acknowledgement with no write on the general route.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.8s
1 Β· TTS said You're welcome. Ready for your next log or question.
2 Β· Card shown You're welcome. Ready for your next log or question.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:11.211Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould navigate"Show me the nutrition dashboard." (difficulty β)0.0s
Verdict Expected NAVIGATE β should navigate. PASS: Navigated.
Why verdict Navigated.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Opening Food Today.
2 Β· Card shown Opening Food Today.
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI did navigated to "food" screen
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:22.355Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.4 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
PASSshould handle appropriately"Okay, let us keep going." (difficulty β)1.0s
Verdict Expected OTHER β should handle appropriately. PASS: OTHER conversation_acknowledgement β brief acknowledgement with no write on the general route.
Why verdict OTHER conversation_acknowledgement β brief acknowledgement with no write on the general route.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.0s
1 Β· TTS said Of course. Ready when you are. Are you looking to log something new, or do you have a question about your current data?
2 Β· Card shown Of course. Ready when you are. Are you looking to log something new, or do you have a question about your current data?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:34.539Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould navigate"Go back to today in my food diary." (difficulty β)1.6s
Verdict Expected NAVIGATE β should navigate. FAIL: Did not navigate β misrouted into a food/workout clarification or dead-ended.
Why verdict Did not navigate β misrouted into a food/workout clarification or dead-ended.
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 1.6s
1 Β· TTS said What would you like me to do with that?
2 Β· Card shown What would you like me to do with that?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:47.293Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.5 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)
FAILshould handle appropriately"Good to know." (difficulty β)0.0s
Verdict Expected OTHER β should handle appropriately. FAIL: OTHER conversation_acknowledgement β response was not an acknowledgement or was too long
Why verdict OTHER conversation_acknowledgement β response was not an acknowledgement or was too long
My override
Things I think are wrong
Use this when the report passed something that should have failed.
Comprehension
Execution
Cosmetic
Things the report marked wrong but I think are right
Use this when the report failed something that should have passed.
Actually right
Report/grader issue
Pick every reason you think applies. Multiple boxes are allowed because one utterance can be wrong in more than one way. Use the note below for "Other" or extra detail.
Timing 0.0s
1 Β· TTS said Should I add that as a to-do?
2 Β· Card shown Should I add that as a to-do?
3 Β· App data rows writtenNo food/workout/list/note data row captured for this utterance.This does not mean "nothing anywhere was stored"; spoken/chat evidence is shown above, and some chat/session records may live outside this write-capture field. It means the report did not capture an app data-row write such as food_log_entries or workout_sets.
4 Β· UI didno screen events captured
5 Β· Seed/context data
Seeded starting state: none listed in the corpus row.
No DB snapshot captured for this utterance; the report cannot prove whether yesterday/personal data existed.
snapshot captured 2026-08-02T10:47:58.435Z
6 Β· Why this food The lookup compared against planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
7 Β· Lookup method
The report captured the app food lookup that ran before or alongside the final decision.
It searched planned foods, your saved foods and aliases, your past food logs, the shared nutrition database, the common-food list, the exercise list, and the workout equipment list.
The lookup evidence took 0.2 seconds to collect.
This lookup is supporting evidence in the report; by itself it does not prove that food was saved.
8 Β· Candidates β deciderno candidate list captured (this path did not run DB resolution β e.g. provisional branded log)