Know the most appropriate form of testing

British Airways
British Airways

I would wager that "pre-testing" would top a list of the least-popular terms in advertising. By contrast, responses to the word "prototype" range from excited apprehension to outright evangelism.

This makes me curious.

Two words with dictionary definitions so similar that an alien skipping through Wikipedia would be forgiven for thinking them the same thing, yet engendering a reaction that could not be more different. Why?

Pre-testing involves the testing of broadcast work that has been through a few rounds of creative development just to get to that stage. Working hours have been spent, emotional investment made and – I don’t care how rock-like the emotional stability of an agency or client team – inviolate opinions formed about how it should be executed. This is because a broadcast ad is a linear, "closed" product, usually conceived and authored by no more than two people. It doesn’t develop or improve with use. The less that has to change, the more successful a pre-test is deemed to be.

A prototype, on the other hand, refers to a test model of a product or service, and that’s where the similarity with ad pre-testing abruptly ends. Designing something we hope people will want to use time and again demands we pay close attention to how every interaction works. It’s a calculatedly "open" process in several senses:

1 We stay open-minded about the outcome and, what’s more, we do so willingly. Even an early paper prototype of a digital service reveals opportunities and issues to work through that a concept cannot hope to illuminate on its own.

2 It’s a collaborative process by design. Rarely the output of a single auteur or a linear process, developing a product or service demands a set of various and complementary roles: a mix of interaction designer, producer, technologist, developer, writer and strategist, with a product-owner for goal-setting and sign-off.

3 It’s an iterative process that continues beyond first release. Proto­typing may sound like it involves more process and thus bloats time and resource. Conversely, it can save time: we course-correct, rather than pursuing mistakes to completion, observing how users react intuitively to a product before the team’s own opinions calcify. "Make, test, learn, repeat" (words stolen from friends at Made by Many, the digital product innovation agency) is a mantra to work by, not a set of rules imposed by a third party with a set of predetermined norms.

Questions worth asking now

1 Are we prototyping to help sell in our idea within an organisation or as a part of the development process? Fine if the answer is yes to both. Even with a product like the British Airways "Picture Your Holiday" app (a BBH client), the soul of the idea was always in the interaction. Prototyping helped make that real from the start. With further prototyping, key interaction challenges were unearthed early and the team could explore how largely the same code base could be used across different platforms, leading to a more effective roll-out later.

2 Are we making a product or a message? Occasionally I get asked whether we should apply prototyping methodologies to broadcast creative. My answer is usually no, because unless a script is very complex or requires an animation process, the assets required for pre-testing don’t qualify as natural parts of the production process.

3 Is speed a competitive advantage in our market? If yes, then we have to ask: if we know our market, audience and brand and have trusted partners on board, what are we investing in pre-testing for?

By contrast, prototyping methodologies can make the work and the process faster, better, stronger – and, frankly, happier.


Before commenting please read our rules for commenting on articles.

If you see a comment you find offensive, you can flag it as inappropriate. In the top right-hand corner of an individual comment, you will see 'flag as inappropriate'. Clicking this prompts us to review the comment. For further information see our rules for commenting on articles.

comments powered by Disqus
Brand Republic Jobs

subscribe now


Waitrose boosts content strategy with 'Weekend Kitchen with Waitrose' C4 tie-up
Hottest virals: Cute puppies star in Pedigree ad, plus Idris Elba and Fruyo
Amnesty International burns candles to illuminate new hope
Toyota achieves the impossible by calming angry Roman drivers
Tom of Finland's 'homoerotic' drawings made into stamps
YouTube reveals user habits to appeal to 'older' marketers
Ex-M&S marketing chief Steven Sharp consulting at WPP
Wolff Olins reveals new CEO after Apple poaches Karl Heiselman
Glasgow offers £30,000 prize to best digital idea for 2014 Commonwealth Games
Google's revenues surge but shares drop as it grapples with transition to mobile
Facebook beats Twitter to most 'marketing friendly' social media site crown, says DMA
Fableists believe children like Finn should be outdoors enjoying life
Homebase, Baileys and Camelot join the line-up at Media360
MasterCard renews Rugby World Cup sponsorship to push cashless message
Lynx unleashes £9m 'Peace invasion' campaign
Social Brands 100 Youth: Pizza Hut most social youth brand in UK
Cheryl Cole is wild and arresting in new L'Oreal work
Morrisons told not to show alcohol ads during YouTube nursery rhymes
O2 head of brand Shadi Halliwell departs after 23 years at company in restructure
Tesco hit by further sales decline as it turns to digital Clubcard and social network
Branding guru Wally Olins dies aged 83
Duracell short film captures epic Transatlantic voyage
Ash runs Tinder experiment to show smokers are less desirable to opposite sex
British Airways teams up with Gerry Cottle Jnr for summer of rooftop film screenings
Arklu says 'girls can be superheroes too' with doll design competition
Coke enters squash market with Oasis Mighty Drops
Virgin Galactic signs up Land Rover as space flight sponsor
Motorola marketer Andrew Morley departs as Google gears up for sale to Lenovo
US Airways apologises after tweeting obscene image at a customer
Mumsnet admits users' emails and passwords accessed via Heartbleed bug