Discovery: User research for a product launch
The client, one of the leading providers of telecommunications and media services, was faced with the challenge of optimising a new online streaming product.
I was the design lead and carried out an heuristic review of the product as well as employed qualitative testing methods on UserZoom and content square to get page insight.
​
The research was presented to leadership with clear next steps proposed in the form of quantitative AB testing.
Date
August 2022
Role
Design Lead
Skills
UX design
Qualitative + Quantiatative
Research
How might we...?
-
Identify key opportunity areas?
-
Enhance the overall experience by leveraging new design patterns, updating copy, UI and functionality?
-
Improve overall sales conversion?
-
Improve overall attach rate and customer lifetime value?
Approach
Our process was broken down into the below approach:
01
UX / UI Audit
I began with an in-depth UX audit to identify opportunity areas and secure alignment with client stakeholders to prioritise a backlog of CRO tests.
03
Quantitative A/B Testing
Describe the item and add all the relevant details you would like to share. Double click to edit the text and change the description.
02
Qualitative User Test
The objective of this user research was to investigate how well users understand the proposition, the relevance of the flow, and interest from users in the product.
01 UX Audit
Executive Summary
Objectives
Audit Virgin Media Stream checkout page
Identify issues that are impacting sales conversion, next step progression, subscription and Stream attach rate and ARPU (average revenue per user)
Benchmark against how key competitors perform against identified issues, understanding what best in class looks like
Approach
•Full cognitive walkthrough of Stream journey
•Heuristic evaluation of Stream checkout page
•Transform key pain points into areas of focus for CRO team to explore further
Opportunities
•Opportunity 1 – page hierarchy: Update page hierarchy to give key context, benefits and information higher up the page to align with user goals
•Opportunity 2 – copy: Update generic copy to highlight key benefits of Stream; remove conflicting copy and duplicate information
•Opportunity 3 – user journey: Make subscription selection more visible and use clear CTAs and toast notifications to confirm selection of products
Next Steps
Validate the findings from our audit with both qualitative analysis through testing with real users, and quantitively through CRO test analysis, to prioritise business value for Virgin Media
Agree on priorities of potential tests
Feed these opportunities into the Stream workstream and run CRO experiments to define best solutions
UX / UI Audit
In depth analysis
Content objective and strategy
Is the value proposition to the user clear, is the information relevant, are key benefits highlighted.
​
Issue
-
No prior context on what Stream is
-
Key information on subscriptions hidden
-
Stream in basket without user selection
​
Content Design
Is the copy readable, concise, simple, universal, consistent, logical, guiding, user-focused, holistic and prioritised
Issue
-
Header copy does not confirm checkout initiated or that this is a new product to add
-
Generic copy does not showcase value proposition. Confusion around how it works and associated costs
​
User flow
Is the site intuitive and are user flows logical
​
Issue
-
No confirmation that checkout initiated
Graphic Design
Does this page use quality graphics and videos to grab user attention
02 Usability test on Userzoom
Objectives
Investigate how well users understand the streaming proposition by conducting a unmoderated usability test on UserZoom.
​
-
How well users understand the proposition
-
Relevance of user flow
-
Insight on attach rate
-
Insight on ARPU (Average revenue per user)
-
What triggers interest in users
-
Information gaps
Findings
Users were surprised to see the information appear here in the user flow
Users did not grasp exactly how the service worked and if it was hardware
Users understanding of the benefits of the service were varied, many did not see the value as they had a similar service
Users did not understand a promotional offer or how to add subscriptions.