Rawk 'n Ruckus Logo

Xbox One Home Automation

The Xbox One Home Automation work was an incubation project in partnership with Microsoft Research. The overall goal was to make entertainment enhancement in the living room effortless through machine learning and automation on Xbox One.

To bring this to life, the Xbox design team was tasked with creating a series of living room scenarios that enabled users to manage and automate smart devices within the home (Nest, Hue wireless lights, Dropcam, etc.). I was the lead designer responsible for driving the work from ideation through handoff.

Xbox One Home Automation
Xbox One Home Automation

Xbox One Home Automation

The Xbox One Home Automation work was an incubation project in partnership with Microsoft Research. The overall goal was to make entertainment enhancement in the living room effortless through machine learning and automation on Xbox One.

To bring this to life, the Xbox design team was tasked with creating a series of living room scenarios that enabled users to manage and automate smart devices within the home (Nest, Hue wireless lights, Dropcam, etc.). I was the lead designer responsible for driving the work from ideation through handoff.

Home Automation Setup & Learning

Home automation app installation, smart device connection, and system learning for connected devices, Xbox activity, and user behaviors.

Home Automation Setup & Learning

Entertainment - Movies

User sits down to watch horror movie and the Lights automatically dim.

Movie Automation

Quick flash of evil character’s face appears on screen, Lights strobe on and off to enhance scene.

Movie Automation

Home Entertainment Automation - TV Sporting Event

User sits down to watch UFC 170 main event.

TV Sporting Event Automation

Peripheral lights dim to black & light over TV creates spotlight effect during champion ring entry.

TV Sporting Event Automation

Peripheral lights and Illumiroom projector transition colors and create light show choreographed to the walk out audio track.

TV Sporting Event Automation

Entertainment - Gaming

System learns user’s preferred audio and lighting settings for gaming.

Gaming Automation

User sits down to play COD & lights auto-dim to user’s preferred level.

Gaming Automation

Audio system auto-adjusts, bass, treble, and volume to user’s preferred levels.

Gaming Automation

During gameplay peripheral lighting flickers with explosions and gunfire.

Gaming Automation

Entertainment - Party Mode

User pre-defines lighting, home theater, and audio settings and assigns to VUI command.

Party Mode Automation

User throws New Year’s Eve party, as guests arrive, user says “Xbox, Party Mode”.

Party Mode Automation

Lighting, Illumiroom projection, and sound switch to pre-defined levels and settings, Xbox Music auto-plays the Party Mode playlist.

Party Mode Automation

Lights and Illumiroom auto-synch to waveform and choreograph to music.

Party Mode Automation

Multitask - Baby Monitor

User sets system to monitor baby cam, Baby is napping in crib, user is watching Dexter.

Multitask - Baby Monitor

Baby starts to rustle around in crib and make some noise.

Multitask - Baby Monitor

System auto-snaps baby cam video feed.

Multitask - Baby Monitor

Father to the rescue.

Multitask - Baby Monitor

Notifications - Skype

Ambient lights in home. Couple is preoccupied with their own activities.

Notifications - Skype

Couple receives an incoming Skype call but is not near the TV. The DropCam in the Garage uses Kinect facial recognition to detect the user’s location and the Sonos system warn user of incoming call.

Notifications - Skype

Lights in the garage and hallway transition to husband’s Xbox profile colors and gently strobe to indicate the user has a call. Husband rushes to living room.

Notifications - Skype

Couple goes to the TV and says “Xbox on” to accept the conversation request, they meet their granddaughter for the first time.

Notifications - Skype