Ethnography in UX: Easily Misunderstood

Ethnography involves a lot more work than user experience design, because it involves deeper immersion, more personal commitment, a greater willingness to learn from one’s own observational failures, and the ability to work across cultural boundaries.

This is only a small part of what user experience design attempts to accomplish, and depending on how you apply ethnographic methods in UXD, it can add as much value to a design as it can damage it.

Here’s an ethnographer’s take on how usability tests (usually done after or during implementation/prototyping) and focus groups (typically done during the research phase) may not be of *any* benefit to a user if the cultural context has been completely misunderstood.

“While usability tests and focus groups are useful for specific phases of app development, they aren’t as useful for understanding cultural frameworks and practices because by the time an app is being tested, it already has accumulated so many cultural assumptions along the way in the design process that users are asked to test something that functions in the programmer’s world, not the user’s world.”

– Tricia Wang, “My Suggestions for Making Google’s Services More Relevant for Non-Elite Chinese Users

While working on my MSc dissertation with Abigail Sellen from Microsoft Research’s Socio-Digital Lab and Jennifer Rode, my previous supervisor from UCL, I learnt how quickly and easily it was to misunderstand the work of ethnography and anthropology. These fields have had a much longer history than the field of user experience has, and yet – they’ve become instantly popular because of UX, and its terms can often be misinterpreted and misused.

I don’t claim to be an expert on the ethnography or anthropology, but having read some classic ethnographic literature (e.g. Clifford Geertz), it’s clear that there’s a lot more going on compared to something like Holtzblatt and Beyer’s “Contextual Design”, though both of the authors have fairly strong academic affiliations.

Designers and UX practitioners need to read beyond commercially popular business and design books if they really want to get at the heart of how to understand cultures, humanity, and people. The fields of ethnography and anthropolgy tend to be more academic and research-focused, and there can be complications over viewpoints between different schools of thought in the related fields – thus it takes time to really go through the literature, but that’s the cost you pay in order to re-skill oneself in the art of understanding people.

(Update: do read Paul Dourish’s 2006 CHI paper, “Implications for Design“, which presents a more constructive argument about ethnography and its use in the design of interactive systems)

Seizing design opportunities and not blaming ourselves.

I just stumbled across Cennydd’s post about ‘blaming the designer’, which somewhat reflects my work experiences in the past year. I too, found the “design hell” comic to be humorous, and admittedly counted it as gospel truth initially. Then I forgot about it and like all designers/developers, went back and dealt with the hard stuff and worked until our product was finally launched or finished.

Aim for the finish as a team, not for the journey

And so, a few weeks ago on the eve of Christmas last year, we launched our site live. My client, my boss, was happy with the results and our effort to implement tiny changes at the very last minute, and I admit I’m happy with the outcome myself, despite all the ranting and heated arguments about things like how consistency in design isn’t everything and about not adding more ‘unnecessary’ features. It was satisfying to know that my client was happy – that we had produced something that was ready for launch, live. And I think that’s something all designers and developers need to keep in front of their minds, rather than the course at hand.

The opportunities are in our hands

We live in a world that’s increasingly complex, and we appreciate and learn of each other’s strengths in bits and pieces at a time. To this end, I admit my own shortcomings of not being able to bridge the gap between business, marketing, design and engineering more effectively for my client. I now believe that creative freedom comes with caveats, and it is rare that clients will allow designers all the freedom in the world. It is increasingly becoming the designer’s responsibility to seize the opportunity to educate and collaborate with clients to solve problems ‘the design way’, meeting both design and business goals.

I see this as a major opportunity for creative types – designers, content managers, UX consultants, even developers. This is because clients know they are partly ignorant about design and are willing to hear what we have to say. At they same time, they’re not going to back down on what they know best about business, and we need to be sensitive to that.

Putting things to practice

So how would I react this time around?

I think, for a start, my attitude has to be right. I need to stay positive and not try to put down the ideas that come from clients. I should give credit where credit is due, and understand that not every solution is ideal. In fact, some of them are hacks due to various factors like time or lack of knowledge. As iteration is always possible (especially for the web), this isn’t a big problem. Solutions can always be improved, and it’s best to allow some “hacks” to pass, and learn from it through testing and user feedback.

I also feel documentation is key, and putting things down in black and white makes it easy for everyone in the team to see how the design has progressed from day one. Everything that’s documentable is valuable – wireframes, sketches, screenshots, feature requests, reasons for change, points of argument, etc. While I don’t think everything has to be documented, our team did make use extensive use of tools and artifacts to facilitate communication. So, use them wisely.

Finally, the success of the design should be celebrated at the end of a major phase. I somehow feel the best person to do this is the client, but this doesn’t always happen. In some ways, the client’s utmost satisfaction acts as a major milestone in the outcome of a project. In my case, it was my boss’s satisfaction and decision to launch the site live. He brought in a bottle of champagne and we toasted to the launch on Christmas eve, which helped to finalize a major phase in the project and ease fears that we might be carrying on throughout the holidays.

Whatever it is, we all crave to closure to our efforts, some space to regenerate and look forward to our next big task.

Is UX really making a difference?

I’m noticing a trend here regarding user experience people. They’re geeks, no doubt. They enjoy being part of the solution of a system, especially if it leads to something really enjoyable to use. They’re quite intelligent and are fairly multi-talented. They’re also very nice people. I’ve met a lot of UX people in the past year or so and I’ve not met a single person I didn’t think was amicable in some way or other.

Is UX really making a difference?

I have nothing against user experience people. But I’ve been noticing a trend in the user experience industry – that it looks too self-referential (as though to say that “good UX” is demonstrated by “good UX”). There’s rarely talk about how real people’s experiences were tangibly or directly improved because of X user research or Y design solution (the ones out there now aren’t very convincing). And this is the thing that bugs me, and bugs me a lot – the lack of real world stories about how UX is changing the way products are being built and how it’s actually impacting real users.

Maybe it’s because many user experience professionals work mostly on deliverables that don’t themselves represent the final outcome of the product. Wireframes, personas, hi-fi prototypes, site architectures – they’re kind of back-stagey, iterant, and somewhat disposable. In essence, they’re mostly design tools, but they’re not actually the design in and of itself. No doubt they impact the final outcome, because they shape the process in which the products get built – but there’s very little “actual doing” that other professions can speak of, whether it’s advertising, marketing, management, or engineering.

On the other hand, maybe it’s because of the way user experience people can really get reflective, like drawing on inspiring things such as multitouch tablets or surface computers or geeky font artistry. That’s in contrast to something that’s more generative (and often more straightforward), such as producing reports, writing software, closing a sales deal, or editing a draft of a copy.

Process is not the end in and of itself

Increasingly, it seems that the credibility of a UX designer is based on how well that designer understands the process of doing user-centered design, as opposed to how many successful products have come about as a result of that process. This came to me when Darren Smith told me how he noticed that many UX portfolios have a consistent theme of explaining how well these designers understood the process of user-centered design.

Why don’t designers talk more about how their UX work has resulted in the success of a product? I mean, IDEO does it (and does it very well). Even Apple does it (and does it very well). In fact, I feel all great designers do it.

Is UX an escapist’s career?

I almost feel as if UX is a bit like a “cop-out” job. I know it really isn’t, because there are tons of well-meaning UX people who are really passionate about solving the right problems, and they’re taking risks by challenging the status quo for the sake of the users themselves. But the more I think about it – UX designers almost never begin as UX people themselves – many of them were formerly designers, or software developers, or project managers, etc. who were desperate to be in a position to solve the right problems – and left their “old jobs”.

The good news is that UX places the designer directly in a strategic position to make design decisions on behalf of the product implementers, but the trade off is having less control over implementing the actual guts the product. So, while they’re actually doing the important work of navigating the ship, they don’t actually get to man the deck and run the engine (ok, that was a bad metaphor, but you get the idea).

A compromise?

Because we’re such a small community (compared to other professions), we tend to huddle together and give ourselves pats on the back and talk about all the amazing new things the industry is coming up with, even though there are so few major players in the market. I’d actually prefer it if we mingle with senior management and developers and visual designers and marketers and advertisers and… gasp, real users! I feel we’d make a much bigger impact that way.

There seems to be a growing gap between UX and other professions (which can be a good thing), but at some point we’ll need to establish a set of norms or cultures that communicate the way UX designers can integrate with other bodies of the team to produce successful products.

The sooner we begin this process, the better.

How Buildings Learn – The 6-part Video Series

2395908019_5d803e2aaeIf you’ve ever watched Gary Hustwit’s Helveticaor Objectified, and can relate to the uber-geek sensibility of how design affects the way people live, you should also watch Stewart Brand’s series on “How Buildings Learn”, which incidentally is also a a book of the same name. I’ve even embedded all six episodes below for your convenience.

This says so much more than some overly-polished, high-profile, consultant friendly, overpriced user experience books I know.

Here’s a quote from the author, writer, and presenter himself, Stewart Brand. Simply amazing:

This six-part, three-hour, BBC TV series aired in 1997. I presented and co-wrote the series; it was directed by James Muncie, with music by Brian Eno. The series was based on my 1994 book, HOW BUILDINGS LEARN: What Happens After They’re Built. The book is still selling well and is used as a text in some college courses. Most of the 27 reviews on Amazon treat it as a book about system and software design, which tells me that architects are not as alert as computer people. But I knew that; that’s part of why I wrote the book. Anybody is welcome to use anything from this series in any way they like. Please don’t bug me with requests for permission. Hack away. Do credit the BBC, who put considerable time and talent into the project. Historic note: this was one of the first television productions made entirely in digital— shot digital, edited digital. The project wound up with not enough money, so digital was the workaround. The camera was so small that we seldom had to ask permission to shoot; everybody thought we were tourists. No film or sound crew. Everything technical on site was done by editors, writers, directors. That’s why the sound is a little sketchy, but there’s also some direct perception in the filming that is unusual.

Part 1: Flow

Part 2: The Low Road

Part 3: Built for Change

Part 4: Unreal Estate

Part 5: The Romance of Maintenance

Part 6: Shearing Layers

Avoiding the Cult of UX and Rising Above It

I’ve been expressing fairly skeptical views about user experience in my previous posts, and it’s partly a side-effect of stuff that I’m still sorting through in my own work and beliefs. Having spent many years building software as a developer, I’ve become overly sensitive of how people perceive technology and how it can be manipulated to influence the experiences of its users.

I’ve always said that anything is possible with software. That statement has a lot of caveats, because it’s still hard to make software do exactly we want it to do. And while there are a ton of developers out there coding in virtually every language, it’s still rare to find good ones who truly understand how to write them well.

The point I’m making is this – software is a moving target. Despite all our efforts to strategize, plan, research and design for the user experience, it doesn’t mean anything if it doesn’t take the practicalities of implementation into account.

Good designers know this. They understand that it’s not that easy to come up with crazy AJAX interactions, maintain cross-browser compatibility, and design for accessibility within a short period of time. This is why good designers and developers earn their stripes by credibility, not by qualification.

Thus, user experience designers and software programmers are basically two sides of the same coin. You can’t have one without the other. Even if you aren’t calling yourself a UX designer, when you’re making decisions about how users should or would interact with the software, the tone of voice the content should have, the color palettes for the styleguide – that’s basically the kind of thing UX designers get paid to do.

At least for now, UX is being used unceremoniously as an umbrella term for all that design, strategy, and thinking towards the overall experience that’s intended. This means that almost everyone has a hand into doing the work of UX, because almost everyone has a stake in that experience.

The sad part to all this is – it all seems too much like common sense. And everyone will have an opinion about design. Worse still, anyone who really likes the idea of doing UX can suddenly start acting like experts on the subject, and come up with seemingly insightful quips which may actually be more damaging than the status quo. Actual UX designers have their work cut out for them, to separate the wheat from the chaff, to bring clarity from confusion, and most of all, to address the real problems at hand.

There’s a fine line to walk between solving real problems and offering what seems like to the average Joe a poignant solution. And I feel that the only way we’re going to get it right is if we spend more time doing the work of solving rather than fussing too much about how it should be done.

Just like how books/events/ideas/etc. can’t guarantee you’ll turn out a good developer, it won’t guarantee you’ll be a good UX designer as well. I don’t care if you’re highly qualified – show me instead how you’ve helped solve real problems for real people, and that will reveal the true marks of a tradesman.

Google Wave is Not About Email

Boon - Google Wave_1255390358218

Everyone’s hyped up about getting a Google Wave invite. I have one and I don’t see what the fuss is about. Yes, I’ve seen the YouTube video, and yes I’ve watched the Developer Preview video too. It looks great and all, but seriously folks – it’s one complicated thing… next to email.

And this is why Google Wave isn’t about email. The same way computers aren’t (just) about calculators.

What it is is real-time collaborative messaging with historical playback. Which, granted, is very good for real-time anything. Except that real-time in human terms is highly contextual.

Because people have better things to do besides sit in front of their computers all day long, they are much better off carrying Blackberries and having push email rather than collaborative messaging. In my opinion, push email works just as well – because you don’t need to be in front of a computer to communicate with your colleagues.

Wave is also a tool. Meaning that the interface itself is not the message. In order for users to synthesize information, they have to make sense of it in a collaborative sort of way, which means paying attention to whatever is happening in that messaging window, which takes up at most 1/2 of the screen. It looks and feels like, a video player – but for messages. Think of IM on steroids, not email.

Email works because it’s mind-dumbingly easy. And because of that, nobody needs to take 3 week lessons on how to use email – and that includes your grandpa. And because it’s so atomic, it can easily be transported as a message to any other atomic messaging forms – SMS, blog post, forum post, IM chat, whatever.

Waves, on the other hand, are almost asynchronous streams – anyone can start writing content at anytime into a wave, and hope that it doesn’t make a mess of the conversation. Last I checked, people still pay attention to body language and subliminal messages, both of which are devoid in Wave but affects the way people communicate collaboratively and socially together – i.e. turn-taking and all that jazz.

Which part of a wave is atomic? You have to spend effort to calculate and decide. Then you have to find a way of “clipping” that message – and how do you make it portable? Can you cut and paste portions of your wave onto your blog? SMS? can you print it out?

Like email, most of what is published gets fixed in time. But a Wave, is a collection of content played out over time. Just like how photographs put together over time become videos. But with the added complexity of multiple sources of photographs, it becomes more and more difficult to separate and organize content in a Wave.

And that’s why Google Wave is not about email.

Sites and Articles Relevant to this Post:

UX is Bollocks, as Some People Put It

I feel really guilty because I’ve been neglecting this blog about interactions, especially when almost everything I do for a living involves designing for interactions.

Instead, I find myself spending more and more time blogging about careers, which in a way doesn’t have anything to do with interaction. Except for one thing – the human condition.

The real kick behind designing any interaction is the effect you get when a human being interfaces with it. Whether it’s good or bad – it’s one of those things that turns me on like nothing else – seeing someone actually interact with a dumb thing you actually built and expressing an emotional response from it.

But when I go out and read all the blogs that talk about user experience, interaction design, usability, bla bla bla… so much of it is so arcane that my eyes start focusing beyond the screen into emptiness and my mind begins to chant mindless syllables.

UX is losing its Touchy Feely

What ever happened to all that user magic that Norman used to talk about? The stuff where he’d complain about the affordances of door handles being one way and not the other and talking about how people would get confused and how we ought to design to love and make people feel nice and fuzzy inside. What ever happened to that?

Now, the only thing people end up talking about are new things that were invented two hours ago – Experience Themes? Who writes a blog post titled so arcanely these days? I thought we were much better at copy than a lot of other people.

And look at how much time went into creating this user journey diagram. It’s pretty, but I don’t know what in the world it’s saying. I showed this to some colleagues of mine (folks who actually do “get” UX common sense) and they too couldn’t make head or tail of it. And this came up tops on Google. :-/

No One Understands Us Outside of Us

Why can’t we just stick to simple terms and communicate things clearly and simply? Do our customers, bosses, users, readers, colleagues and friends really know what we mean by all these words we use? It’s funny how we spend most of our time building for these people, but talk in a language that doesn’t make sense to them.

Are we as designers supposed to build things that way – where we act as folks who fix things and have our own codes of conduct, and can never have normal conversations with the people we solve problems for?

UX Designers aren’t really Designers if they’re more Geek than Human

We compare ourselves with engineers and say we’re more user friendly, but there’s no doubt that every UX person I know is a geek in their own way. They just don’t do code, that’s all.

I prefer a person who does code, because it’s one level below the abstraction layer (towards the technology, not away from it). You can’t have a web UX designer without a programmer. The programmer gets to call the shots, because he actually builds the stuff that makes it work. UX designers ought to pay some respect to the engineering community who built the thing in the first place.

A UX person only has my approval only if they really do care for other human beings, and tell me about their stories. Don’t talk to me about methods or crazy terms and phrases, because I can toss that out and use something else that works. Just because engineers have fancy names doesn’t mean UX designers need them too.

Speak English?

Engineers need fancy names because computers can’t speak for themselves. UX designers already have a language they can use that’s already widely available, is extremely portable, and is fairly universal – it’s called English. They don’t need to invent new words to describe the things they do, which by the way, was copied and stolen from other disciplines like psychology, sociology, marketing, management, etc.

To be fair, I’ve had my share of that design-speak. But I’ve gain nothing except credit from other fellow designers who’ve done the same.

If designers can focus on explaining and speaking out what really represents people who use technologies, it would be a lot better for everyone… rather than inventing new languages to use between themselves.

Designing with Methods is a Flaky Thing

I’m currently in a team of 3 people working on a redesign of a website. To me, this feels like my first “real” design project, one where I’ve initiated without any requirements for software implementation. Instead, we began to ask ourselves who are our users, and what exactly are we trying to communicate to them?

User-Centred Design – Using What Works For Me

I felt that a lot of “formal” usability methods didn’t help me much, here. I felt somewhat trapped by procedure and process, thinking about best practices for wireframes, personas, user journeys, etc. Having been exposed to too much user experience jargon, I realized that user-centered design isn’t necessarily synonymous with visual design. In fact, each stakeholder seems to have a different understanding of who the user is, even if the differences are slight.

What ended up working for me was to put down the questions I felt the users would ask (while using the interface/application) onto little bits of post-its, and looked for patterns like organizing those questions into related categories. I organized this in several ways:

“User Journey”-type Things and “Site Map”-type Things

One way of visualizing the questions was to list them out in the style of a “user journey”, which were lists of questions laid out in a temporal fashion (e.g. question A leading to question B as a user traversed deeper into the application). This helped me understand which questions to address first, and which to address later. It helped me prioritize my workflow, and make decisions on which interfaces to work on first. It was already obvious that we needed to focus on designing the homepage, but there were other pages that weren’t immediately obvious, such as a page to help users to “learn more” about the product – that page only came about after looking at the questions from the user journeys.

Another way was to group the questions that were related to one another, and label them as categories. That helped me to visualize the overall site layout, because I absolutely hate building software in the dark – and that includes building on software requirements without understanding the whys to the point I’m convinced of its business and user needs.

At this point, I hadn’t used any formal methods I had learnt from a class, website, or book. It was good that I understood who I was designing for, and I wouldn’t have been able to do this without classes, websites and books – but the formal methods were pretty useless. I just used what worked for me.

We Used Fireworks, but I can’t Recommend it to You

It’s important to note that two of us jumped onto paper and pencil and did wireframe sketches, and then designed a hi-def visual of the homepage on Fireworks (which I now really love) – only because we were three people and we couldn’t quite picture the outcome in our minds. At the same time, we needed our boss to make a decision and he has a lot of emotional attachment to the look and feel of the site, being the founder and all. So it was important to get those designs out.

I don’t think I can recommend the same process to other designers – it really depends what you’re designing for. Those fireworks designs took up several days and a lot of it was thrown out of the window as we iterated from one design to another. But I think that’s necessary in design, sometimes – because the interface is what users will end up seeing and using, again and again.

Sometimes I read articles from other designers and it all sounds really cool and makes you feel that there’s some kind of order or process in the design of an interface. But I find these things hard to use because it’s the designer that makes a difference, not the method. It’s about knowing what you know that works – a process or method can’t save you. They’re just tools.