← Back to scoreboard

Query frozen (exact keys)

Internal name: query-frozen-A
Grade file: query-frozen-A-b863aa4e-c2-20260723-grade.json · Traces: query-frozen-A-b863aa4e-c2-20260723-traces-raw.json
Generated: Thu, Jul 23, 2026, 2:37 PM · Build under test: 467420a07
Pass 0 · Fail 10 · no evidence captured 37 · Pass % (graded) 0%
User-felt wait time — typical reply start: 44 ms · slower cases: 63 ms · async confirm: · async complete:

Showing 47 of 47 rows

# What was said App's final reply Verdict Reason
1 How many calories were in the chicken at lunch today? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
2 How many calories were in the banana I logged today? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
3 What did I eat yesterday? No — I do not see yesterday logged today. no evidence captured answer key has no expected values
4 What was my calorie total Tuesday? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
5 What did I have for breakfast yesterday? I'm looking that up — I'll have an answer in a moment. Fail Reported could-not-confirm (write-confirmation false negative).
6 What is my calorie total so far today? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
7 How many times did I have chicken this week? I do not see times in today's food log. no evidence captured answer key has no expected values
8 How many calories were in Friday dinner? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
9 How many calories were in Wednesday dinner? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
10 How many calories did I log Monday? I do not see calories in today's food log. no evidence captured answer key has no expected values
11 How many times did I eat salmon this week? I do not see times in today's food log. no evidence captured answer key has no expected values
12 What snacks did I log yesterday? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
13 How much protein did I have Monday? I do not see protein in today's food log. no evidence captured answer key has no expected values
14 How many turkey sandwiches did I have this week? I do not see turkey sandwiches in today's food log. no evidence captured answer key has no expected values
15 How many calories did I eat Friday? I do not see calories in today's food log. no evidence captured answer key has no expected values
16 How much protein did I eat Wednesday? I do not see protein in today's food log. no evidence captured answer key has no expected values
17 What did I have for breakfast Monday? I'm looking that up — I'll have an answer in a moment. Fail Reported could-not-confirm (write-confirmation false negative).
18 How much fat did I have yesterday? I do not see fat in today's food log. no evidence captured answer key has no expected values
19 How much protein was in Thursday breakfast? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
20 How much fat have I logged this week? I do not see fat in today's food log. no evidence captured answer key has no expected values
21 What was lunch yesterday? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
22 How many food entries did I log today? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
23 How much protein have I logged this week? I do not see protein in today's food log. no evidence captured answer key has no expected values
24 How many calories have I logged this week? I do not see calories in today's food log. no evidence captured answer key has no expected values
25 Give me all my macros for today so far. I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
26 How many food entries have I logged this week? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
27 How many carbs have I had today? I do not see carbs in today's food log. no evidence captured answer key has no expected values
28 How much protein did I eat yesterday? I do not see protein in today's food log. no evidence captured answer key has no expected values
29 How much protein was in today's banana? Banana has about 1.3g protein per 118 g. no evidence captured answer key has no expected values
30 What is my average daily calorie total this week? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
31 What is my average protein per day this week? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
32 What were my total calories and macros yesterday? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
33 How many carbs did I have Thursday? I do not see carbs in today's food log. no evidence captured answer key has no expected values
34 How many carbs did I eat Monday? I do not see carbs in today's food log. no evidence captured answer key has no expected values
35 How many snack entries did I log today? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
36 How much fat did I have Tuesday? I do not see fat in today's food log. no evidence captured answer key has no expected values
37 How many bananas did I log this week? I do not see bananas in today's food log. no evidence captured answer key has no expected values
38 How much fat have I logged today? I do not see fat in today's food log. no evidence captured answer key has no expected values
39 How many carbs did I eat yesterday? I do not see carbs in today's food log. no evidence captured answer key has no expected values
40 How many carbs have I logged this week? I do not see carbs in today's food log. no evidence captured answer key has no expected values
41 How many calories did I have yesterday? I do not see calories in today's food log. no evidence captured answer key has no expected values
42 How many calories were in the protein shake I logged? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
43 What did I have for dinner yesterday? I'm looking that up — I'll have an answer in a moment. Fail Reported could-not-confirm (write-confirmation false negative).
44 How many calories have I logged today? I do not see calories in today's food log. no evidence captured answer key has no expected values
45 How many breakfast entries did I log today? No registered new-shell module for general. Fail MISROUTE — general/no-module dead-end (should answer the query).
46 What was my protein total yesterday? I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. no evidence captured answer key has no expected values
47 How much protein have I had today? I do not see protein in today's food log. no evidence captured answer key has no expected values

Verdicts come from the grade file. Replies come only from the app side of chat history (not guessed). When the grader could not prove a result, the badge says no evidence captured.

← Back to scoreboard