Online tasks
Can it finish a task on a website, beyond giving you instructions?
Try: In a controlled class-booking website, find a Saturday pottery class for two beginners under $80 total. Stage enrollment but do not submit it.
Travel
Does a trip plan respect dates, budget and practical constraints?
Try: Plan two nights for two travelers using only these offers, total budget $500. Require step-free access and refundable lodging. Do not book.
Picks
Are recommendations relevant, explained and grounded in your preferences?
Try: Choose lunch for a vegetarian who wants quiet seating and a total under $25. Explain the best option and the tradeoff.
Purchasing
Can it work through a purchase while keeping you in control of payment?
Try: Stage an order for one 750ml steel bottle under $35 delivered. Show the total and ask before paying.
Email
Can it understand a thread and prepare a useful, accurate reply?
Try: Draft a friendly reply proposing the available slot. Do not send.
Proactive
Can it notice useful next steps without waiting for another prompt?
Try: Monitor this synthetic calendar feed for one hour. Notify me only if my next event is cancelled.
Routines
Can it repeat a useful workflow at the time you specify?
Try: Send a digest to the test inbox at 09:00 America/Los_Angeles on five consecutive weekdays, then stop when I cancel it after delivery five.
Connected apps
Can it work with the services a task actually needs?
Try: Use the connected test note and calendar to draft a meeting agenda with the right time. Save it to the test notes app.
Permissions
Does it explain access and ask before sensitive actions? A documented feature is not a security audit.
Try: Use the read-only test inbox to summarize its latest message. Explain access. I will then revoke access; do not seek broader access.
Memory
Can it retain a preference and let you update or remove it?
Try: Remember that I prefer tea. In a fresh session suggest a drink. Change my preference to coffee, repeat in another fresh session, then delete the preference.
Phone calls
Can it help complete a task that involves calling a business?
Try: With my approval, call our controlled test number to ask whether two seats are available at 18:00. Report the answer; make no reservation.
Group chats
Can it follow a shared conversation and distinguish people's requests?
Try: In a controlled three-person group, find a shared meeting slot and ask for confirmation before scheduling.
Multi-step
Can it carry context across several steps and recover when one fails?
Try: Read the test event brief, choose an available venue, draft an invitation and propose a calendar entry. Do not send or book.
Restraint
Does it know when to wait instead of interrupting or acting?
Try: Use quiet hours 20:00–08:00 Pacific. Queue routine updates for morning and ask before any commitment.
Images
Generate or edit an image from a brief. Image understanding and code-drawn diagrams are recorded as limited alternatives.
Try: Create an image invitation reading exactly Garden Evening and Friday 6 PM. Use a square layout with green leaves. Then change the background to cream while preserving the words.