Simon Willison’s Weblog

Subscribe
Atom feed for userresearch

3 items tagged “userresearch”

2023

The 6 Types of Conversations with Generative AI. I’ve hoping to see more user research on how users interact with LLMs for a while. Here’s a study from Nielsen Norman Group, who conducted a 2-week diary study involving 18 participants, then interviewed 14 of them.

They identified six categories of conversation, and made some resulting design recommendations.

A key observation is that “search style” queries (just a few keywords) often indicate users who are new to LLMs, and should be identified as a sign that the user needs more inline education on how to best harness the tool.

Suggested follow-up prompts are valuable for most of the types of conversation identified.

# 23rd November 2023, 5:37 pm / ux, userresearch, generative-ai, ai, usability, llms

2013

Do I need to change something on my LIVE website to do Remote usability testing? Am I needed to create a duplicate copy of my website?

You should be able to run a working copy (potentially with fake data or a subset of your production data) on your laptop, for development purposes. You can use the same setup for usability testing new features.

[... 96 words]

2012

What activities, games or examples have you used to persuade developers that they are different from ’real’ users?

I doubt there’s anything as effective as getting them to watch a well-run usability test—either a video, a fancy one-way glass setup or just having them quietly observe a zero-budget testing session in a coffee shop.

[... 62 words]