

Hunches | Quick glance
Hunches | Quick glance
Designed an intervention to collect users' feedback on Alexa's proactive experiences
Designed an intervention to collect users' feedback on Alexa's proactive experiences
Role
Role
Product designer
Product designer
Timeline
Timeline
16 weeks
16 weeks
This project was part of an Amazon-Sponsored Externship mentored by Amazon's UX Researcher, Monica Chan.
This project was part of an Amazon-Sponsored Externship mentored by Amazon's UX Researcher, Monica Chan.


Quick Glance
For a quick overview, the following presents:
Problem spaces
Final solutions
Impact
To explore the process and iterations, check out the case study
Case study
This was an oversimplification of the project. Check out the case study to explore the whole process, from setting the context to research, design iterations, and the final showcase.
Case Study
Case study
Context
Proactive actions?
Actions taken by a smart device without user's input. In Alexa's term - Hunches
Scope
1 in 4 smart-home interactions is initiated by Alexa. Number bound to increase
Problem
No Hunch awareness
Feedback system inefficient
Security and privacy concerns
Why need user feedback?
To reduce incorrect actions and improve user trust
In a nutshell
Awareness
More User Feedback
Fewer Incorrect Actions
Improved User Trust
Context
In a nutshell
Proactive actions?
Actions taken by a smart device without user's input. In Alexa's term - Hunches
Problem?
No Hunch awareness
Feedback system inefficient
Security and privacy concerns
Why need user feedback?
To reduce incorrect actions and improve user trust
Scope
1 in 4 smart-home interactions is initiated by Alexa. Number bound to increase
Awareness
More User Feedback
Fewer Incorrect Actions
Improved User Trust
Problem space 2 | Awareness


Turned off by default


Switching toggles for all devices


Solution (1/3)
Turned off - missed Hunches updates
Turned on - notification overload
Solution (2/3)




Echo show - Non-intrusive notification (leveraging always on display)
Pulsating to grab attention
Solution (3/3)


Integrated Hunch Notifications in Alexa's widgets
SETUP
Choose lights Alexa can control
Alexa can control these lights for all Hunches automatic actions.
LIGHTS
Living Room lamp
Living Room
Baby Room light
Baby Room
Alert type: Notification, Voice
Edit
Bedroom light
Bedroom
Alert type: None
Edit
Kitchen light
Kitchen
Submit


Baby Room light
Baby Room
Alert type: Notification, Voice
Edit
Baby Room light
Baby Room
Alerts
Save changes
Select your preferred mode of alert
How do you want to be notified when Alexa performs actions on this device based on hunches
Notifications
Voice on Alexa devices
Device Setup - Set alert type without additional steps
Choice to toggle Voice notifications
Problem space 3 | Context-aware


Solution
A simple yes/no feedback collection - not enough for meaningful improvements






User Agency - choice to provide addition feedback on hitting 'No'
Simple taps - predefined contextual scenarios
Problem space 4 | Retention


Solution
How to encourage users to provide feedback over a long period of time?
Activity
TODAY . 2:55 AM
Alexa turned off Living Room lamp
FEEDBACK RECEIVED
Let Alexa know why this action was wrong to align hunches to your preferences
Give more info >
TODAY . 1:00 AM
Alexa turned on Porch light
Alexa had a hunch the light should be turned off by this time
Did Alexa do this right?
Yes
No
YESTERDAY . 9:00 PM
Alexa turned off Baby Room light
Alexa had a hunch the light should be turned off by this time
Did Alexa do this right?
Yes
No
YESTERDAY . 7:00 PM
Alexa turned on Garden lights
Alexa had a hunch the light should be turned off by this time
Did Alexa do this right?
Yes
No
TODAY . 11:15 PM
Alexa turned off Living Room lamp
Thank you for your feedback!
Here is how your feedback has helped me be more accurate over time
Today
11:10 PM
I will turn off Living Room lamp automatically at 11:15 PM
Yesterday
11:45 PM
I will turn on Living Room lamp automatically at 11:30 PM
7:10 PM
I will turn on Living Room lamp automatically at 7:00 PM
Tuesday
7:20 PM
I will turn on Living Room lamp automatically at 7:10 PM
Okay


Yesterday
11:45 PM
I will turn on Living Room lamp automatically at 11:30 PM
7:10 PM
I will turn on Living Room lamp automatically at 7:00 PM
Transparent impact - more likely to provide consistent feedback
Impact


Accessibility to Hunches
Improved from 10% to 80%
Improved user flow
Expressed low frustration navigating Hunches
Interaction with Hunches
70% increased
User Trust
Showed confidence in Alexa's proactive actions
After more than 10 usability tests
Work Done
Problem space 1 | Hunch discoverability


Solution
4 Step process - hidden within the app
Unintuitive


Hunches
3 updates


Hunches on the home screen
Tag introduced on the device tiles
Contributions
Co-design workshop
Developed majority of the activities and supporting materials for the workshop
Co-hosted the workshop
Research
3 interviews, user-tests, and Reddit users' insights
Competitor analysis
UI explorations
Assisted in UI explorations
Generated Hi-Fi mockups for user testing
Work done
Discoverabilty
Awareness
Content-aware
Retention
Discoverabilty
Awareness
Content-aware
Retention
Design space 1


Hunches
3 updates

Problem
4 Step process - hidden within the app
Unintuitive
Solution
Hunches on the home screen
Tag introduced on the device tiles
Impact

Accessibility to Hunches
Improved from 10% to 80%
Interaction with Hunches
70% increased
Improved user flow
Expressed low frustration navigating Hunches
User Trust
Showed confidence in Alexa's proactive actions
After more than 10 usability tests
Contributions
Co-design workshop
Developed majority of the activities and supporting materials for the workshop
Co-hosted the workshop
UI explorations
Assisted in UI explorations
Generated Hi-Fi mockups for user testing
Research
3 interviews, user-tests, and Reddit users' insights
Competitor analysis
Case Study
Explore in detail
Process
Constraints
Iterations backed by research
Case study