Skip to the page

Plainly Put

One sentence about building things, taken apart

HomeProduct

Hearing customers through what they do

Frustrated users mostly leave without saying anything. The ones who do complain are not always the ones to believe.

People are not good at expressing their frustration. The best way to listen to the customer is through metrics.

Chris Hughes

Chris Hughes was one of the roommates who started Facebook in 2004. He later ran online organizing for Barack Obama’s 2008 presidential campaign and last year launched Jumo, a site connecting people with charities. In each of those roles he worked with very large numbers of people who could not all be asked what they thought.

The first sentence matches what anyone who has run a product sees. Most frustrated users do not write in. They struggle with a screen, give up and do not come back, and nobody finds out why. When people do complain, they often misdiagnose the problem, asking for a feature when the real trouble is that they never understood an existing one.

Facebook itself provides the most famous test. When it launched News Feed in September 2006, users protested loudly, and a group opposing the change gathered hundreds of thousands of members within days. The company added privacy controls but kept the feature, and the usage figures showed people spending more time on the site than before. The loudest voices said users hated the change; their behavior said they did not.

The 2008 campaign worked on the same principle. Its sign-up page was tested in many versions, with different photographs and button wording, and the one visitors actually responded to, rather than the one staff preferred, raised sign-ups substantially. Nobody had to ask visitors what they wanted. Their clicks said it.

Metrics have a clear blind spot, though. They show where people stop, not why. A drop at the payment page could mean the price is wrong, the form is confusing or the page loads slowly, and the numbers alone cannot distinguish them. That still takes watching people or asking them.

Metrics can also miss slow damage. Facebook’s Beacon feature in 2007, which shared users’ purchases on other sites without clear consent, produced a backlash about trust that took time to appear in any usage figure. Harm to trust builds quietly before it shows. A sensible practice uses metrics to find where the frustration is, and conversations to learn what it is.