Overview
To enhance the experience of audience presence at online performances by improving the audience interaction model to achieve the vision of a remote presence user experience.
Timeline
Jun 2020 - Dec 2020 (7 months)
Role
UX Designer;
Hardware Interaction Designer;
Design Process
Background
User Research
Design Definition
DISCOVER
Interaction strategy
Solution
Solution-Stage side
Solution-Audience side
DEVELOP
Final Output
DELIVER
Discover
Background
The arrival of the epidemic has prevented people from gathering for offline performance events!
In the midst of an epidemic crisis unlike anything humanity has ever seen has caused almost all offline entertainment events, including sports and live music events, to be postponed indefinitely.Peak consumer demand for content and limited mobility for content creators have provided the conditions for alternative entertainment in the form of online concerts. The post-epidemic era has triggered endless thoughts ......People are starting to distance themselves from each other, but our quest for a rich cultural life never changes!
Discover
User Research
Live streaming situation；Scenario
Live streaming situation
Define functional architecture and layout by analysing user behaviour and scenarios to uncover user behavioural characteristics and needs
Scenario
During the epidemic, it was not possible to go to a live performance, so entertainment lovers watched the show at home via the "online live streaming platform"
Open the live streaming app, the show is about to start, I'm looking forward to seeing my favourite idols, ...... It's starting, wow, I love this song too, singing along, how great it would be if my idol could hear my voice, I miss the interaction and immersion of listening live!
Discover
Design Definition
"Lack of immediacy in online performances, poor immersion and single form of interaction"
What does the audience want?
What we can do for the audience？
"To enhance the experience of audience presence at online performances by improving the audience interaction model to achieve the vision of a remote presence user experience."
Discover
Interaction strategy
Value proposition: sense of presence;
Method：Multimodal interaction
Value proposition: sense of presence
In an online performance scenario, users can feel like they are there, even when they are far away. They feel like they are in the same space as the performers and others, and are able to interact emotionally and give feedback.
Emotional
communication
Interactivity
Authenticity
Interface quality
Method：Multimodal interaction
Discover
Solution
Interaction logic closure
Method：Multimodal interaction
Interaction logic closure
When single output stage performances are combined with audience feedback data and mixed reality technology, together they present a connected stage effect, transforming the audience from 'receivers' to 'participants'. We are creating the future of immersive + interactive + virtual music festivals.
Discover
Solution-Stage side
How is the interaction on the stage implemented ?
Hardware
Presentation
1. Visual representation of user voice and movement feedback
Use perceptual cues to locate user emotions: understand and locate user emotions through facial expressions, special moments in time or recognised keywords, judge user emotions to understand the user's inner desires, be it free exploration, fun and entertainment, or quiet appreciation and provide a design that fits the user's current state of mind, use a combination of perceptual elements to design: communicate and evoke through the use of lines, colours, sounds and actions, etc. The use of line, colour, sound and movement conveys and evokes the corresponding emotions, providing a more human experience.
2.Audience avatar and pop-up presentation
Through motion capture, a digital image of the user is generated in real time, simulating a sense of presence and reducing transmission costs The audience can appear in the virtual space in various forms, for example as a star The performer can also see the audience's comments and interact with them.
3.User motion capture visualisation
Motion capture generates a digital image of the user in real time, simulating a sense of presence and reducing transmission costs.
Discover
Solution-Audience side
How interaction is achieved on the audience side ?
Why do audiences want to interact?
Analyse user behaviour and scenarios
Define functional architecture and layout by analysing user behaviour and scenarios to uncover user behavioural characteristics and needs
Advanced Functionality
Multi-camera, special effects, sing-along, heartbeat curve
Auxiliary functions
Screen casting, sharing, pop-ups, picture quality
Core functions
Playback, interactive, full screen
Stage performance interface metaphor
Live viewing interface design
Fun interactive
Define functional architecture and layout by analysing user behaviour and scenarios to uncover user behavioural characteristics and needs
blow up the concert
fans
It sounds so good, I really .......
Come together!
Heart gesture,
triggered by a click and a long
Multi-angle camera view
Cloud Theatre playback interface, giving viewers the power to choose where they want to watch
Visual data feedback
Let the user know the heartbeat points and transmit them back to the scene, build the stage with the performer and also share for interaction
Deliver
Final output
