TTC Labs - [XR] Utilizing the Body-Based Data of Other Consenting Users

[XR] Utilizing the Body-Based Data of Other Consenting Users

1st Jun 2023

This pattern was a co-created output of a Design Jam which took place in Seoul National University on the subject of body-based data in XR. During the Jam, four design teams created simple prototypes which helped deliver better transparency and control over data use in imagined XR services.

The speculative scenario of Team Retail centered on the experience of an influencer shopping with AR glasses. She has a good understanding of data privacy and wants to access the benefits of body-based data while keeping her own data secure.

Participating in the Body-Based Data Privacy in XR Design Jam in South Korea, Team Retail was made up of students and academics from Seoul National University together with external privacy experts.

Problem & Opportunity

During the Design Jam, Team Retail recognized an opportunity to use body-based data to help their persona in making informed decisions for her followers who were seeking a more tailored personal shopping experience, ensuring that both parties derive most benefit from the service.

How might we...

...leverage body-based data to allow influencers to make informed decisions, ensuring both their data and that of their followers is safe and secure?

Data being used
  • Facial
  • Motion
  • Vitals
  • Voice

Key Features of Prototype

Team Retail’s solution explored how to help an influencer with her side hustle by enabling her to shop using other people’s body-based data while controlling how her own data is shared with others.

User Selection Menu
At the beginning of the shopping experience, the person can choose who they want to shop for that day. This feature enables the person to utilize other people's body-based data while maintaining control over how their own data is shared with others.

Real-Time Data Collection Notifications
Throughout the shopping experience, the user can receive live notifications regarding the specific body-based data being collected. The user can click on the notification to view more detailed information about what is being read. This feature enhances transparency and provides clarity regarding data collection.

Different Levels of Data-Sharing
The person has the option to select the level to which they wish to share their body-based data. They can choose who has access to their data and for what duration.

Data-Sharing Filter
The influencer followers can decide the data they want to share to receive personalized recommendations from the influencer. They can control this by enabling or disabling specific types of data sharing. Before they accept to share their data, they receive a pop-up window informing them that the data they enabled will be visible to the influencer.

Transparent Recommendations
While shopping, the person can view the body-based data used to generate a recommendation. The person can rate the recommendation and provide feedback on its accuracy.

Design Pattern: Persona Switcher

Team Retail used XR prototyping techniques to realize their solution, making use of props and sketches to demonstrate the spatial and physical dimensions of their prototype. The prototypes that were developed by Team Retail and the other participating teams were then used to synthesize learnings and insights which were distilled into UX design patterns for privacy interactions.

Team Retail’s solution was used as the basis for the Persona Switcher design pattern.

The Persona Switcher is a bar that displays the different people whose body-based data a person can access within an experience. In this example, a person decides to use the motion data of someone else — specifically their body measurements and sizing — to buy clothes for them during a shopping experience.