Showing 175 of 175 rows
| # | What was said | App's final reply | Verdict | Reason |
|---|---|---|---|---|
| 1 | I ate a burger | I logged Hamburger — let me know if that's not right. | Pass | Decisive guess with stated assumption + invited correction (good-guessing). |
| 2 | I drank something | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 3 | add milk | I logged Milk — let me know if that's not right. | Pass | Decisive guess with stated assumption + invited correction (good-guessing). |
| 4 | log deadlifts | Which exercise, weight, and reps should I log? | Pass | Asked a clarification as expected. |
| 5 | the pharmacy run list | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 6 | log some squats | Which exercise, weight, and reps should I log? | Pass | Asked a clarification as expected. |
| 7 | four sets of eight at one thirty five | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 8 | Chobani vanilla nonfat one cup | I'm looking that up — I'll have an answer in a moment. | Fail | Reported could-not-confirm (write-confirmation false negative). |
| 9 | large oat milk latte no sugar | Logged Coffee and Milk. | Pass | Completed the pending action. |
| 10 | the grocery list | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 11 | did pull-ups | Which exercise, weight, and reps should I log? | Pass | Asked a clarification as expected. |
| 12 | add eggs and butter | Logged add eggs and butter. | Fail | Logged a BLIND guess — no stated assumption, no correction invited. |
| 13 | uh three sets of ten at ninety pounds | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 14 | add some fruit | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 15 | had eggs this morning | How much should I log for Egg? I did not log it yet because the amount was not clear. | Pass | Asked a clarification as expected. |
| 16 | put batteries on the list | Which list should I add batteries to? | Pass | Asked a clarification as expected. |
| 17 | show me the other one | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 18 | open that screen | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 19 | remind me about that thing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 20 | I did some curls | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 21 | the rye bread one | I logged Bread — let me know if that's not right. | Pass | Completed the pending action. |
| 22 | I did bench press | Which exercise, weight, and reps should I log? | Pass | Asked a clarification as expected. |
| 23 | make a note | Sure. What should the note say? | Pass | Asked a clarification as expected. |
| 24 | make it quieter | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 25 | I had a smoothie | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 26 | go there | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 27 | log the salad I just ate | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 28 | log a coffee | Logged a coffee. Assumed 100 g because no amount was stated. | Pass | Decisive guess with stated assumption + invited correction (good-guessing). |
| 29 | log my leg day | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 30 | add a task for tomorrow | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 31 | jot something down | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 32 | change my settings | unsupported_settings_update | Fail | Neither clarified nor logged. |
| 33 | track my run | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 34 | log a sandwich | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 35 | create a todo | What should the to-do say? | Pass | Asked a clarification as expected. |
| 36 | log cardio | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 37 | pack the charger and passport | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 38 | I had some pasta | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 39 | save a note about the meeting | Logged your note in General about about the meeting. | Fail | Logged a BLIND guess — no stated assumption, no correction invited. |
| 40 | add it to my list | Which list should I add that to, and what is the item called? | Pass | Asked a clarification as expected. |
| 41 | I benched earlier | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 42 | track my lunch | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 43 | log a snack | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 44 | take me back | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 45 | log dinner from earlier | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 46 | mute the voice readback | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 47 | turn something off | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 48 | update my preferences | not_navigation_command | Fail | Neither clarified nor logged. |
| 49 | track the set I just did | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should ask a clarifying question). |
| 50 | call it dentist follow-up for next Tuesday | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 51 | uh the second one I guess | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 52 | not anymore forget the whole thing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 53 | never mind about the sandwich | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 54 | skip it I'm good | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 55 | the packing list for the beach trip | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 56 | no I meant the other list the camping one | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 57 | actually skip it | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 58 | leg press three sets fifteen at two seventy | Logged leg press seventy: 2 lb for 15 reps. | Pass | Completed the pending action. |
| 59 | don't bother | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 60 | cancel whatever you were doing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 61 | open the workouts tab | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 62 | three sets twelve reps fifty pound dumbbells | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 63 | scratch that whole thing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 64 | forget it | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 65 | spinach feta wrap from Starbucks | I logged Spinach — let me know if that's not right. | Pass | Completed the pending action. |
| 66 | the usual list | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 67 | uh no don't do that | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 68 | errands category due Friday | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 69 | just the regular one | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 70 | personal category call mom Sunday | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 71 | houseplants watering checklist | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 72 | wait no stop | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 73 | later this week | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 74 | greek salad no olives | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 75 | yeah no never mind about that | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 76 | turn off voice responses | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 77 | nah leave it | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 78 | no cancel that | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 79 | no thanks I'm done | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 80 | actually don't | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 81 | bodyweight three sets to failure | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 82 | don't log that set | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 83 | something about the trip | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 84 | scrambled two large eggs | Logged scrambled two large eggs. | Pass | Completed the pending action. |
| 85 | hold on cancel | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 86 | forget the note | no_notes_intent_match | Pass | Declined / no unwanted write. |
| 87 | thirty minutes on the elliptical | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 88 | sorry I meant the food tab | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 89 | a few sets | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 90 | leave it alone | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 91 | Dave's killer bread two slices | Was it plain, or did you have anything on it like butter or cream cheese? I did not log it yet because add-ons can change the nutrition. | no evidence captured | CLARIFY_ANSWER not gradeable single-shot — no pending clarification in this replay (app re-asked / mis-parsed as fresh); needs multi-turn replay. |
| 92 | no skip the list thing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 93 | actually the whole wheat turkey one | I could not confirm that the change was saved, so I did not mark it as done. | Fail | Reported could-not-confirm (write-confirmation false negative). |
| 94 | under travel in my notes | no_notes_intent_match | Fail | Did not complete the pending action. |
| 95 | don't add that after all | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 96 | I changed my mind don't save anything | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 97 | never mind | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 98 | wait no make it the work category | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should complete the pending action). |
| 99 | don't log that | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 100 | don't create that todo | Added to-do: don't create that. Priority 3. | Fail | Wrote when it should decline. |
| 101 | can someone turn down the TV | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 102 | mom I'll be down in five minutes | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 103 | nah don't save the workout | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 104 | so like uh yeah mm | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 105 | okay so anyway she said she'd call back tomorrow | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 106 | the thing about it is | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 107 | hey are you almost ready | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 108 | wait what did you just say about the meeting | not_voice_session_control | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 109 | babe what time are we leaving | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 110 | cancel the food entry | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 111 | so then he goes and tells me the whole story | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 112 | hmm | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 113 | hey pass me my water bottle | I logged Water — let me know if that's not right. | Fail | OTHER ambient_non_command — wrote food on a non-food request |
| 114 | your local forecast shows rain tomorrow | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 115 | anyway where was I | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 116 | don't change my settings | unsupported_settings_update | Pass | Declined / no unwanted write. |
| 117 | where did I put my keys | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 118 | and then we ended up just staying in | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 119 | uh huh yeah so um | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 120 | dude did you see that play | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 121 | I was gonna say | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 122 | man I'm tired today | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 123 | so I was going to | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 124 | yeah I know but like that's not even the point | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 125 | forget going there | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should decline). |
| 126 | breaking news tonight in the capital | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 127 | I should probably stretch later | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 128 | oh that's interesting | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 129 | gotta remember to email Sarah | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 130 | and then I think | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 131 | the Dow Jones closed up two hundred points | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 132 | mm-hmm right right I hear you | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 133 | honestly I don't even know what to tell her | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 134 | tell Jake I'll text him back later | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 135 | okay think think what was I doing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 136 | honey can you grab the door | I logged Honey — let me know if that's not right. | Fail | OTHER ambient_non_command — wrote food on a non-food request |
| 137 | and the winning team takes home the championship | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 138 | tune in next week for the season finale | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 139 | no yeah totally I was thinking the same thing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 140 | sponsored by progressive insurance | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 141 | so basically the whole thing got pushed to Monday | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 142 | the thingy with the stuff | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 143 | if we could just | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 144 | ... | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 145 | why is it so hot in here | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 146 | it was the the one with the | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 147 | yeah no I get it | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 148 | the um the the with the | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 149 | I mean it's fine it's whatever | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 150 | leave the yogurt off | I logged Plain Greek yogurt — let me know if that's not right. | Fail | Wrote when it should decline. |
| 151 | I've been meaning to start a workout journal | Started your workout. | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 152 | the recipe says add milk to the list of ingredients | no_lists_intent_match | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 153 | the meeting notes were sent around by email | not_create_or_append | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 154 | everyone at work uses a shared task board | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 155 | they added squats to the class routine | Which exercise, weight, and reps should I log? | Fail | OTHER ambient_non_command — misrouted ambient speech into food/workout log |
| 156 | she said don't forget to pick up groceries | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 157 | my brother started a new workout program | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 158 | I wish I was better about meal planning | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 159 | navigation in this building is confusing | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 160 | the podcast mentioned intermittent fasting | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 161 | I told him to log out of the shared account | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 162 | I used to keep notes on my phone | no_notes_intent_match | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 163 | he logged into the app yesterday | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 164 | people always tell me to track what I eat | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 165 | I read an article about todo apps | Next to-dos: don't create that (P3). | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 166 | she keeps a list of everything she buys | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 167 | my trainer says I need more protein | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 168 | my wife tracks her meals in a notebook | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 169 | I need to remember to call the dentist | no_todos_intent_match | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 170 | the app kept asking me to confirm things | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 171 | I should really log my food more often | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 172 | I wonder how many calories are in that | I understood the nutrition question, but I could not find a solid number for that food yet. Nothing was logged. | Pass | OTHER ambient_non_command — no durable command write on non-command speech. |
| 173 | we made a grocery list on paper | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 174 | I heard deadlifts are good for your back | Which exercise, weight, and reps should I log? | Fail | OTHER ambient_non_command — misrouted ambient speech into food/workout log |
| 175 | I always forget to write stuff down | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
Verdicts come from the grade file. Replies come only from the app side of chat history (not guessed). When the grader could not prove a result, the badge says no evidence captured.