Can AI do product usability study?
An expert breakdown of a typical process from public sources, worked out by the same rules as your own check.
1 of 8 steps goes to an agent
Goes to an agent (1)
An agent does these steps on its own.
Consolidate the findings, classify the problems by severity
An agent can do this step alone: everything it takes is a strong suit of AI.
- Extracting structure from an unstructured source
- Rule-based classification and routing
AI drafts, a person checks (3)
AI prepares the work; a person reviews and confirms it.
Test plan: tasks, metrics, success criteria
AI drafts it and a person checks: AI only drafts part of what it takes.
- Generating text in a given register
- Designing a measurement and an experiment
Select and recruit participants matching the real user profile
A person confirms it: the step changes something outside the company.
Report with recommendations to the team
AI drafts it and a person checks: AI only drafts part of what it takes.
- Generating text in a given register
Stays with people (4)
These steps need a person's judgement or presence.
Define the study goals and the format (qualitative or quantitative)
Stays with people: it takes judgement that depends on your business context.
- Judging risk or priority in a business context
Pilot session and plan revision
Stays with people: it takes judgement that depends on your business context.
- Open-ended dialogue with an external party
Run the sessions: tasks, probing questions without hints
Stays with people: it takes judgement that depends on your business context.
- Open-ended dialogue with an external party
Prioritise the fixes together with product
Stays with people: it takes judgement that depends on your business context.
- Judging risk or priority in a business context
- Consolidating people's contributions and resolving priority conflicts
1 step outside what AI can work on
Physical work, or nothing AI could apply itself to. These steps count in no figure.
Observe what the participant does, not what they say
Stays with people: someone has to be there in person.
- On-site sensory assessment of the condition of an object or a person
Sources
- nngroup.com · Consulting
- nngroup.com · Consulting
What about your own process?
Describe it in your own words and get the same breakdown in about a minute.
Check your own process