<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>MarketingProfs Daily Fix Blog &#187; experimentation and testing</title>
	<atom:link href="http://www.mpdailyfix.com/tag/experimentation-and-testing/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.mpdailyfix.com</link>
	<description>Opinions. Commentary. News.</description>
	<lastBuildDate>Fri, 10 Feb 2012 14:26:33 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.1</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Beating The Placebo Effect: Red Pill or Blue?</title>
		<link>http://www.mpdailyfix.com/beating-the-placebo-effect-red-pill-or-blue/?utm_source=rss&amp;utm_medium=rss&amp;utm_campaign=beating-the-placebo-effect-red-pill-or-blue</link>
		<comments>http://www.mpdailyfix.com/beating-the-placebo-effect-red-pill-or-blue/#comments</comments>
		<pubDate>Mon, 14 Sep 2009 13:40:00 +0000</pubDate>
		<dc:creator>Paul Barsch</dc:creator>
				<category><![CDATA[Branding]]></category>
		<category><![CDATA[Customer Behavior]]></category>
		<category><![CDATA[Featured Posts]]></category>
		<category><![CDATA[Market Research]]></category>
		<category><![CDATA[Marketing]]></category>
		<category><![CDATA[Marketing Strategy]]></category>
		<category><![CDATA[Promotional Strategies]]></category>
		<category><![CDATA[customer expectations]]></category>
		<category><![CDATA[experimentation and testing]]></category>
		<category><![CDATA[neuroscience]]></category>
		<category><![CDATA[placebo effect]]></category>
		<category><![CDATA[social cues]]></category>

		<guid isPermaLink="false">http://www.mpdailyfix.com/beating-the-placebo-effect-red-pill-or-blue/</guid>
		<description><![CDATA[http://www.mpdailyfix.com/images/pillman.jpg
]]></description>
			<content:encoded><![CDATA[<p><a href="http://en.wikipedia.org/wiki/Placebo Effect">Placebo pills</a> routinely beat Big Pharma medications in clinical trials. As more drugs fail to make the cut due to increased &#8220;<a href="http://www.enotes.com/alternative-medicine-encyclopedia/placebo-effect">placebo effects</a>,&#8221; what does this say about the inner workings of the human brain and what does any of this have to do with marketing?</p>
<p><span id="more-20663"></span><br />
Since 1962, <a href="http://www.drugs.com/fda-approval-process.html">double blind testing with placebos</a> has been the norm for medications wishing to pass muster from the US Federal Drug Administration (FDA). However, over the years the placebo effect has been more pronounced with fewer drugs passing clinical trials. To be sure, unusually high responses to placebos have been blamed on ineffective compounds, but there might be other causes at work.</p>
<p>A Wired Magazine titled, &#8220;<a href="http://www.wired.com/medtech/drugs/magazine/17-09/ff_placebo_effect?currentPage=all">Placebos Are Getting More Effective. Drugmakers Desperate to Know Why</a>&#8221; cites some of the challenges facing Big Pharma. Over the years, drug makers have diligently worked to uncover why&ndash;for some patients&ndash;the act of taking a placebo works as good (or sometimes better) than a promising compound. In fact, according to the article, researchers are discovering, &#8220;the body&#8217;s response to certain types of medications is in constant flux, affected by expectations of treatment, conditioning, beliefs and social cues.&#8221;</p>
<p>For example, for some patients the simple act of watching another person gain relief from a medication sets &#8220;expectations&#8221; that the medication will indeed provide relief.  And since consumers have been bombarded with billions of dollars in drug advertising over the years, Big Pharma has also increased expectations that simply taking a pill will solve a patient&#8217;s ills. In addition, a kind and empathetic doctor can also boost the placebo effect.</p>
<p>To help remove the noise from the above variables, drug makers have taken to testing medications in countries across the globe. However clinical researchers are discovering that even this isn&#8217;t a perfect solution as doctors are &#8220;paid to fill up trial rosters quickly which may motivate them to recruit patients with milder forms of an illness.&#8221;</p>
<p>Part of the challenge for drug makers is defining the illness in question. The Wired article notes that many new drugs today target &#8220;higher cortical centers that generate beliefs and expectations, interpret social cues and anticipate rewards.&#8221; Defining &#8220;depression&#8221; in a patient is often difficult enough, but then try and see if that same definition holds for patients in different countries and communities! It&#8217;s tough stuff.</p>
<p>In a sign that the white surrender flag has been waved, drug makers have now all but acknowledged the benefits of placebos. What they&#8217;re looking for now is, &#8220;the best placebo response plus the best drug response.&#8221;</p>
<p>A key lesson from this article is that the human brain is very powerful and scientists don&#8217;t quite yet understand exactly how it works. Why or how does the human body improve its condition from the simple act of taking a medication (placebo or not)? Why do patients improve their conditions of depression when a doctor&ndash;knowingly&ndash;prescribes them a dose of medication that&#8217;s too low to be effective?</p>
<p>Another interesting discussion avenue is how customer expectations can be defined and created. For example, the Wired article mentions that drug makers have long known that simply coloring pills can help create expectations of efficacy. Yellow pills may create &#8220;doses of sunshine&#8221;; red pills let patients know they have potency, and green pills help reduce anxiety. Pills stamped with a brand name also offer a patient assurance and comfort.</p>
<p>Helping our companies understand, create and manage customer expectations is where the marketing function can add significant business value.  But as <a href="http://en.wikiquote.org/wiki/Stan_Lee">Stan Lee </a>of Marvel Comics fame reminds us, &#8220;With great power comes great responsibility!&#8221;  Marketers must be willing to resist the urge to manipulate customer expectations in an unethical and immoral manner&ndash;especially if our products and services are no better than a comparable &#8220;do nothing&#8221; placebo.</p>
<p>Questions:</p>
<ul>
<li>In recent tests, durable warhorse drugs like Prozac have been beat by placebos. If you worked for Big Pharma, how might you suggest that your company &#8220;test out&#8221; consumer expectations&ndash;to see if your drugs actually worked?</li>
<li>It would be difficult to argue that consumer expectations haven&#8217;t increased over the past ten to twenty years.  What is a good strategy to manage expectations  &#8230;.  keep them low and over deliver?</li>
<li>Does experimentation with control groups have a place in your marketing function?  If so, how? What are you learning?</li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://www.mpdailyfix.com/beating-the-placebo-effect-red-pill-or-blue/feed/</wfw:commentRss>
		<slash:comments>13</slash:comments>
		</item>
		<item>
		<title>Experiment or Go Home!</title>
		<link>http://www.mpdailyfix.com/experiment-or-go-home/?utm_source=rss&amp;utm_medium=rss&amp;utm_campaign=experiment-or-go-home</link>
		<comments>http://www.mpdailyfix.com/experiment-or-go-home/#comments</comments>
		<pubDate>Wed, 05 Sep 2007 12:49:24 +0000</pubDate>
		<dc:creator>Avinash Kaushik</dc:creator>
				<category><![CDATA[Featured Posts]]></category>
		<category><![CDATA[a/b_testing]]></category>
		<category><![CDATA[avinash kaushik]]></category>
		<category><![CDATA[experimentation and testing]]></category>
		<category><![CDATA[google_website_optimizer]]></category>
		<category><![CDATA[multi-variate testing]]></category>
		<category><![CDATA[multivariate_testing]]></category>
		<category><![CDATA[offermatica]]></category>
		<category><![CDATA[optimost]]></category>
		<category><![CDATA[sitespect]]></category>

		<guid isPermaLink="false">http://www.mpdailyfix.com/experiment-or-go-home/</guid>
		<description><![CDATA[You are a lovely Marketer and all you want is the coveted Marketer of the Year award. Yet your website conversion rate is stuck at 2%&#8230; no matter how hard you try. It&#8217;s not your fault. There are three forces that are working against you&#8230; .

* * * * *

If you do not have an [...]]]></description>
			<content:encoded><![CDATA[<p>You are a lovely Marketer and all you want is the coveted <strong>Marketer of the Year </strong>award. Yet your website conversion rate is stuck at 2%&#8230; no matter how hard you try. It&#8217;s not your fault. There are three forces that are working against you&#8230; .</p>
<p><span id="more-18536"></span><br />
* * * * *
</p>
<p>If you do not have an active experimentation and testing program in your company then you are leaving so much money on the table that it is not even funny.<br />
It is not too extreme to say: <em>If you are not doing testing then pack your bags now and go home because there is no way you can win.</em></p>
<p>You are a lovely Marketer and all you want is the coveted Marketer of the Year award. Yet your website conversion rate is stuck at 2%, no matter how hard you try. Its not your fault. There are three forces that are working against you:</p>
<ol>
<li>Your website is being used for purposes it has not been created for. And you don&#8217;t even know. Few website owners / Marketers / Analysts understand all of the reasons why people come to their websites (Visitor Primary Purpose).
<p>If you don&#8217;t know why they are there, how will you know how to create a great customer experience?</li>
<li>A monolith does not come to your site, segments do. If I unpack that statement what I mean is that even if 100% of the traffic on your site is there to buy (right now), it still is formed of many different types of customers who need to be communicated to in a unique manner (calls to action, content, promotions, and yes even buttons).</li>
<li>HiPPO&#8217;s rule the world when it comes to creating customer experiences. And that&#8217;s a bad thing. No matter what you think the optimal customer experience should be on the website it is quite likely that you walk into a meeting room, or office, and regardless of your competence the HiPPO decides what goes on the site.
<p>HiPPO stands for: the <strong>Hi</strong>ghest <strong>P</strong>aid <strong>P</strong>erson&#8217;s <strong>O</strong>pinion. HiPPO&#8217;s are your bosses, their bosses, your creative directors etc etc.</li>
</ol>
<p align="center"><img height="371" alt="HIPPO - HIghest Paid Person's Opinion" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/hippo-highestpaidperson'sopinion.png" width="499" /></p>
<p>In the past you did not have too many options to counter the HiPPO&#8217;s and get your ideas to the site or why people comes to your site and what problems they have. Now you can run a simple <a href="http://www.kaushik.net/avinash/2007/04/the-three-greatest-survey-questions-ever.html">three question golden survey</a> and find out Visitor Primary Purpose.</p>
<p>You can also let ideas democracy flourish in your company: Captain Experimentation to the rescue!</p>
<p>In its simplest form experimentation and testing is showing two or three or fifty pieces of creative / content / promotions etc to a website visitor. After a statistically significant amount of time let the results of the test help you decide what your customers like / react positively to.</p>
<p>In the last 18 months or so your ability to test has dramatically improved, thanks to evolution of technology, new vendors and integrated reporting.</p>
<p>You can get going with your own website&#8217;s capability to do A/B/C testing (if you have a decent website platform then you are set).</p>
<p align="center"><img height="313" alt="a-b testing" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/a-b_testing.png" width="549" /></p>
<p>Take a page on your site, tell your web server to split traffic to three different version, with your web analytics tool measure success. That&#8217;s all it takes to get your idea validated!</p>
<p>The cool babe of the month is Multivariate Testing. It is the ability of simply partitioning up various parts of the page and putting different pieces of content in each partition to see which combination of element works.</p>
<p>Here is your default page (and who on this earth does not need, <em>nay deserve</em> , a hundred roses?):</p>
<p align="center"><img height="336" alt="mvt-home page" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/mvt-home_page.png" width="349" /></p>
<p>To test all you do is log into your multivariate testing tool, upload all your wonderful ideas, and turn the experiment. You can pump in different images into the main 100 flowers image above. You can put in customer testimonials in the white space on to top right. You can even take your boss&#8217;s wonderful idea of adding Buy Now buttons under each product.</p>
<p>The tool takes care of rending the pages to your website visitors and runs the experiment for you (with the only IT involvement for your company being addition of a few lines of javascript code &#8211; you the Marketer is finally in control baby!!). Each visitor to your website sees a unique page:</p>
<p align="center"><img height="440" alt="mvt test combinations" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/mvt_test_combinations.png" width="455" /></p>
<p>Now here comes the sweetest part. Analytics are included, you just sit back and wait for the green bars to indicate 95% confidence!</p>
<p align="center"><img height="217" alt="mvt-statistical significance" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/mvt-statistical_significance.png" width="518" /></p>
<p>The tool tells you which one works for your customers optimally, and by how much. You don&#8217;t have to guess.</p>
<p>Convinced?</p>
<p>Here&#8217;s one last thing.</p>
<p>You can start doing multivariate testing tomorrow using the 100% free <a href="http://services.google.com/websiteoptimizer/">Google Website Optimizer</a> tool. All you need is a Google AdWords account (you don&#8217;t even need to spend money on AdWords!!). You can get the code, implement, upload and start testing in a couple hours.</p>
<p>Once you get really good at this you can get a paid tool where you might get lots more features (initially you might not need them but later perhaps you will).</p>
<p>If you don&#8217;t want to go down the free route get one of the nice paid tools, Offermatica, Optimost, SiteSpect etc.</p>
<p>To help you choose the right tool for you (and know the kind of effort involved in your company and the impact it will have on your customers) here is a handy selection matrix:</p>
<p align="center"><img height="314" alt="testing type selection matrix" hspace="7" src="http://www.kaushik.net/avinash/wp-content/uploads/2007/08/testing_type_selection_matrix.png" width="490" /></p>
<p>Ms. / Mr. Super Marketer the shackles are now off! <em>Good luck and God speed!!</em></p>
]]></content:encoded>
			<wfw:commentRss>http://www.mpdailyfix.com/experiment-or-go-home/feed/</wfw:commentRss>
		<slash:comments>7</slash:comments>
		</item>
	</channel>
</rss>

