topic: methodology

By the way, one of my favorite questions to get the ball rolling (at least in the US) is: “what strikes you most about American life these days?” Try it out!

Nan Bress, in an email to the anthrodesign list.

design research 101: you don't have to look at all the data. given a compromise between examining and categorising every transcript, photo, answer or looking at the data in different ways, pick manipulation & representation over organization every time.

Having lots of data points doesn't mean you have greater understanding: it simply means you have lots of data points and more chances to prove a statement true or false. Having fully organized data is great if you want to test conclusions, but it's easier to check hypotheses than to find a new, more powerful, more insightful way of looking at the phenomenon being studied. Finding a good explanation for behavior usually involves multiple rounds of trying to make sense of something. That takes time.

If you're short on time, forget trying to organize everything and spend more time interpreting and deriving conclusions from the data. After all, that's what you were hired for, isn't it?

a newspaper dispenser for the Columbus Dispatch, outside a Subway a newspaper dispenser for the Columbus Dispatch, outside a Subway

Here's an example of one my favourite ethnographic analytic moves: 'unpacking'. Unpacking is one kind of interpretation, where an observation is examined for unstated (or implicit) assumptions, consequences, and meanings. Here's how it works.

Consider the above image: a newspaper dispenser outside a subway. Here's what we're going to assume about it:

  1. It is intended to sell newspapers
  2. It is designed to support this intention

Now, notice the statement on the bottom of the dispenser: "We capture history every day". Unpacking this involves finding premises that give this statement meaning:

  1. "History" happens every day
  2. Some things are Historic and some things are not
  3. History can be identified as it happens
  4. "Capturing" history - by identifying what is Historic and what is not - is a non-trivial task
  5. the Dispatch performs this non-trivial task every day

Taken together, the premises make an argument for how value inheres in the Dispatch, and why you should buy it. Note that in order to accept the statement, you have to accept the premises, but in order to unpack, you only have to notice something and wonder what makes that thing work. What, one asks, has to be true to make this true, to make this believable? The insight is in the unpacking, the discovery of assumptions.

The insights here have to do with the claims being made about the nature of history: if one wanted, say, to counter-advertise, one could devise an advertising strategy designed around these claims. For instance, one could reverse the time-orientation and claim value in reporting and making sense of the present, and pointing towards the future.

But unpacking doesn't happen in a vacuum: in order to perform this particular instance of unpacking, I had to have cultural knowledge - (that the statement is an advertisement, that advertisements are stories that help sell something, and so on, that advertisements can appear on newspaper dispenser). This is what makes unpacking a particularly ethnographic move: after all, that cultural knowledge had to be acquired somehow. In this instance, advertisements & newspapers are common enough and shared enough that I could do this analysis without having to do research (although you could count my living 5 years in the US as a process of gaining cultural sensitivity; just growing up as a city-bred person counts too, I guess).

In cases where the things being noticed are in less public or familiar contexts - a McDonald's in India, or on the shop floor of an oil rig, or in a hospital - cultural, contextual, and procedural knowledge has to be learned, and often the quality of the learning depends on the amount of exposure one has to that context (what we call 'research'). This is why anthropologists and ethnographers prefer longitudinal participation - the longer one stays in a place, the more one learns, the more things one can unpack and find the premises of, the more powerful the insights. This is also why the ethnographic method has little to do with mere observation alone - you have to do a lot more than that to interpret and find meaning.

Personas are composite constructions that serve two distinct purposes: to act as aids for design decisions, and to generate empathy. The two can easily get in each other's way: people looking for information that they can act on might consider all the additional texture of people's lives "fluff", whereas people for whom a persona doesn't represent a specific set of information but, rather, a set of contexts and behaviours might be disappointed if the persona had "just the facts, ma'am".

Within corporations, personas are an intensely political artifact: claims on what they should contain are made by many different groups of people: marketing, product planning/management, designers, researchers, engineers.. Each has their own set of questions they want a persona to answer, and each has their own claims on what the persona means. Our poor hardworking persona, then, has to act both as an embodiment of consensus and as a coordinating artifact - something that various kinds of people can look to for guidance as they go about their work.

Regardless, personas are usually composites: rarely in research are personas constructed from one perfect respondent - they are amalgams of many stories and many situations. This is (hopefully) not the case for personas that are entirely behavioural, and who are being constructed for a highly specific activity or around a particular product; the necessity for composition arises when generating personas for a wide variety of activities or products, and especially the case when personas are created as part of generative research, which tend to include attitudinal and aspirational data (to use marketing terminology) in addition to behavioural data. The point is to create a person who embodies the entire range of behaviours and attitudes for that class of people - so that the resulting design covers as much range as possible.

It is at this point that something like the following occurs:

"Does he have a car?"
"Uh, I don't know. I mean, he has an iPod.. isn't this the persona who doesn't like CDs because he wants access to his music all the time?"
"So, ok. He has a car, and he listens to his iPod in it and his FM connector keeps getting interference but his car stereo is old so he has no other way of connecting it"
"Yeah, that sounds about right"

If you're a ux/design researcher you've probably had a conversation very much like this. This is the act of composition: when the essential stories & features have been picked, and they have to be woven into a single story. In this sense, personas are a collection of fictional facts: the stories come from different places, but they have to be made part of this person's life, reflecting their desires, their interests, the conditions of their life and so on - and in the process are given a fictional form. At all times the data speak, but through the voice of this character. In this sense, defining personas seems remarkably similar to writing a novel...

To see this, we turn to the most excellent Umberto Eco (and it is worth reading in full):

What I mean is that to tell a story you must first of all construct a world, furnished as much as possible, down to the slightest details. If I were to construct a river, I would need two banks; and if on the left bank I put a fisherman, and if I were to give this fishermana wrathful character and a police record, then I could start writing, translating into words everything that would inevitably happen. What does a fisherman do? He fishes (and thence a whole sequence of actions, more or less obligatory). And then what happens? Either the fish are biting or they are not. If they bite, the fisherman catches and then goes home happy. End of story. If there are no fish, since he is a wrathful type he will perhaps become angry. Perhaps he will break his fishing rod. This is not much; still, it is already a sketch. But there is an Indian proverb that goes, "Sit on the bank of a river and wait; your enemy's corpse will soon float by." And what if were a corpse were to come down the stream – since this possibility is inherent in an intertextual area like a river? We must also bear in mind that my fisherman has a police record. Will he want to risk trouble? What will he do? Will he run away and pretend not to have seen the corpse? Will he feel vulnerable, because this, after all, is the corpse of the man he hated? Wrathful as he is, will he fly into a rage because he was not able to wreak personally his longed-for vengeance? As you see, as soon as one's invented world has been furnished just a little, there is already the beginning of a story.

Eco, U. (1994). The novel as cosmological event. In The Name of the Rose (1st ed., pp. 512-515). San Diego: Harcourt Brace.

Exactly. Of course, if you're creating a persona you're working off of data, and the construction of the world is not random but is informed by your data (though there may be a few judgement calls along the way for clarity's sake, or to include perspectives). Importantly, the more constraints (user stories, situations) you add, the more formed your story (persona) gets.

Eco continues:

The problem is to construct the world: the words will practically come on their own. Rem tene, verba sequentur: grasp the subject, and the words will follow

Indeed.

Before I studied Zen, mountains were mountains, and water was water.

After studying Zen for some time, mountains were no longer
mountains, and water was no longer water.

But now, after studying Zen longer, mountains are just mountains,
and water is just water.

first attributed to Master Qingyuan in the Compendium of the Five Lamps (Wudeng Huiyuan, 1252). [#]

When I first started interviewing, it was all I could do to just have a conversation, and have the other person tell their story. Following a lead was hard enough, and I could never be sure of what theme I was trying to pursue, even though I had this feeling that I should have one. After all, what use an interview that just meandered aimlessly? What would one learn if one wasn't trying to learn something? But I could never quite measure the distance between what was said to me and what I (should have) learned from it. For a while, all I could do with the interview was to quote bits of it, as a source of fact.

Then I discovered the writing of Clifford Geertz, and was impressed by the notion of writing, and ethnography, as interpretation. Every interview (and every act of doing research) was then an act of interpretation, and was worth doing only so far as it was interpreted, some meaning wrenched out of its atoms, the pace and beat of its sentences. Every phrase or word was, or could be, significant. Stories were ponderous with meaning, begging to be teased out. I would be the curator, bringing out with my writing what a mere quote could not. The words of the other person could not stand with out my foundation. Inevitably, the story became about me as well.

But now listen to Studs Terkel, radio show host and oral historian, interview someone on the American Dream:

I grew up in Paris, Tennessee. People in small towns considered nowhere identified with somewhere. So we were thirty miles from Murray, Kentucky, sixty miles from Paducah, a hundred twenty miles from Memphis, a hundred ten miles from Nashville, forty miles from Clarksville. We were on the L&N Railroad.
...
We were always train-conscious. We used to listen for the train, set your clock by it. You'd say: "Panama's late today. Number 619 is late."
...
[Country] people used to go walking on Sunday afternoons. They go down to the depot to see who's comin' in and who's leavin'. Or just to see the train comin' in. The trains always symbolized mobility. Somebody goin' somewhere, somebody leavin'. We were always aware there was another place outside of this. Somewhere. That you could go somewhere.

When I was a kid, we used to play a game called swinging, with a car tyre and a tree. One would push and one would be the conductor. You'd call off the cities: Paducah, St. Louis, Evansville. Somebody'd say: "I think I'm gonna get off here." And somebody'd say: "Naw, I'm gonna wait". And then everybody would say: "Chicago! Forty-seventh Street!" Listen to a lot of the old blues songs: "How Long, Baby, Has That Evenin' Train Been Gone?" "Going to Chicago." "Trouble in Mind"

Vernon Jarrett, interviewed by Studs Terkel. In American Dreams: Lost and Found (1980). Pantheon Books, New York. pp 83-84.

Something magical has happened here. (In the original text, Terkel's questions, if any, are not printed, so we have no way of telling how he actually led the interview). The interviewee's words stand by themselves again. They form this image, cutting across and connecting layers of meaning: context, history, memory, frame switches, episodes. There's the texture of the particular, the local. We are left with a stark impression of this particular person, and their particular history, but we take away from it an idea of a place and time distant from our place and time. Granted, these impressions have been building up and our sensitivities attuned by the time we read these words, because this is, after all, a book of dreams, of particular dreams of particular people in particular places. But after less than a hundred pages of stories and with barely 5 more of just his own words in the introduction, Studs Terkel wrenches us out of our context and deposits us in someone else's.

Somehow, with his invisible, unreported questions, and perhaps blank, inviting stares, a ready countenance, and - something else? - Terkel has made his interpretations unnecessary. Somehow his interviewees have become so fluent, so expressive, that they capture us. As Terkel vanishes, the stories come alive. This is Zen: mountains once again mountains.

Syndicate content