Showing 43 of 43 rows
| # | What was said | App's final reply | Verdict | Reason |
|---|---|---|---|---|
| 1 | Delete the dentist to-do. | not_create_complete_or_list | no evidence captured | OTHER unknown subtype — no mechanical checks defined (key: ) |
| 2 | I finished the buy milk task. | I could not find a to-do matching buy milk. Did you mean: pick up dry cleaning? | Fail | OVER-ASK — asked instead of update (no notes-domain mutation). |
| 3 | Stop asking me to confirm every food item. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 4 | What are my most important to-dos? | Most important to-dos: pick up dry cleaning (P3, due Jul 24). | Pass | Answered. |
| 5 | Pause listening. | Paused listening. | Pass | Toggled state as asked. |
| 6 | Call me Coach H from now on. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should apply the setting). |
| 7 | Remind me to pick up dry cleaning tomorrow. | Added to-do: pick up dry cleaning. Priority 3, due Jul 24. | Pass | Notes write-truth verified: pick up dry cleaning. |
| 8 | Turn on quiet mode. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should apply the setting). |
| 9 | I want to take a new note in the category Travel. | Sure. What should the note say? | Pass | Asked a clarification as expected. |
| 10 | Remember to bring the charger next time. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should log the food). |
| 11 | Add a task to renew my passport in the category Admin. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should log the food). |
| 12 | Set my protein goal to 180 grams. | I could not confirm that the change was saved, so I did not mark it as done. | Fail | Reported could-not-confirm (write-confirmation false negative). |
| 13 | Respond in Spanish from now on. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should apply the setting). |
| 14 | Open the shopping list. | I could not find a list matching shopping. | Pass | Navigated. |
| 15 | Add wool socks to the packing list. | Added wool socks to Packing List For The Ski Trip. Say if that (Packing List For The Ski Trip) is the wrong list. | Pass | Notes write-truth verified: wool socks wool socks. |
| 16 | Reopen the dry cleaning to-do. | I could not find a to-do matching dry cleaning. Did you mean: call the dentist? | Fail | OVER-ASK — asked instead of update (no notes-domain mutation). |
| 17 | Stop talking. | Stopped speaking. | Pass | Toggled state as asked. |
| 18 | Make a packing list for the ski trip. | Created list: Packing list for the ski trip. | Pass | Notes write-truth verified: Packing List For The Ski Trip. |
| 19 | Change the realtime voice to cedar. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should apply the setting). |
| 20 | Remove wool socks from the packing list. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should handle appropriately). |
| 21 | What's on my grocery list? | Grocery: bread; milk; eggs. | Pass | Answered. |
| 22 | Open my to-dos. | no_todos_intent_match | Pass | Surfaced the requested view/content (display fulfillment). |
| 23 | Go to settings. | Opening Settings. | Pass | Navigated. |
| 24 | Make your responses more brief. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should apply the setting). |
| 25 | Create a new list called books to read. | Created list: Books to read. | Pass | Notes write-truth verified: Books To Read. |
| 26 | Switch to lists. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should navigate). |
| 27 | Mark call the dentist as done. | Marked done: call the dentist. | no evidence captured | UNVERIFIABLE — no notes-domain mutation captured for UPDATE. App claim not credited. |
| 28 | Create a new note that says the wifi password is sunflower22. | Logged your note in General about says the wifi password is sunflower22. | no evidence captured | UNVERIFIABLE — no saved notes/todo/list row captured (untagged / lossy). App claim not credited without write-tag/turn-window proof. |
| 29 | Okay, start listening again. | Listening again. | Pass | Toggled state as asked. |
| 30 | Make sure I text Sarah back and also add a to-do to buy milk. | What fat level or type of milk should I use? I did not log it yet because milk fat level can change the nutrition. | Fail | Did not write — misroute-into-food; no notes-domain saved row. |
| 31 | The note should say pack the passport and adapter. | no_notes_intent_match | Fail | Did not complete the pending action. |
| 32 | Be quiet for a second. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should toggle state). |
| 33 | Say that again? | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should toggle state). |
| 34 | Also add sunscreen. | No registered new-shell module for general. | Fail | MISROUTE — general/no-module dead-end (should log the food). |
| 35 | Take a note in the category Recipes that says add cardamom to the coffee cake. | Logged your note in Recipes about says add cardamom to the coffee cake. | no evidence captured | UNVERIFIABLE — no saved notes/todo/list row captured (untagged / lossy). App claim not credited without write-tag/turn-window proof. |
| 36 | Add a to-do to call the dentist. | Added to-do: call the dentist. Priority 3. | Pass | Notes write-truth verified: call the dentist. |
| 37 | Append also grab oat milk to my latest note. | I logged Milk — let me know if that's not right. | no evidence captured | UNVERIFIABLE — no notes-domain mutation captured for UPDATE. App claim not credited. |
| 38 | Take me to the workouts tab. | Opening Workouts. | Pass | Navigated. |
| 39 | Add to the note about the wifi password: it changes every month. | I could not find a note matching it changes every month. | Fail | Reported could-not-confirm (write-confirmation false negative). |
| 40 | Show me all my lists. | Lists: Grocery (3 active); Packing List For The Ski Trip (1 active); Books To Read (0 active). | Pass | Answered. |
| 41 | Show me my notes. | Notes: Recipes: says add cardamom to the coffee cake; General: says the wifi password is sunflower22; General: lane stager canary is connected. | Pass | Navigated. |
| 42 | Put eggs, milk, and bread on my grocery list. | Created list: Grocery. Added 3 items: eggs, milk, and bread. | Pass | Notes write-truth verified: Grocery, eggs eggs, milk milk, bread bread. |
| 43 | Mute voice responses. | no_settings_update_match | no evidence captured | OTHER unknown subtype — no mechanical checks defined (key: ) |
Verdicts come from the grade file. Replies come only from the app side of chat history (not guessed). When the grader could not prove a result, the badge says no evidence captured.