Google Consumer Surveys

Google recently released a new product aimed squarely at the Market Research industry – Consumer Surveys.

As with anything Google does, they tend to bring a fresh perspective to an old problem and their Consumer Survey product is no different.

Instead of following in the footsteps of the DIY survey crowd (poster boy – Survey Monkey), they have rethought the whole process.  Google’s Consumer Surveys are short (two question maximum) surveys administered as access requirements to participating content sites.

The idea is beautifully simple.  Content providers who have large audiences get to monetize some select content while business with research needs get access to on-demand sample.  At only $0.10 per completed survey, that’s a ten to forty-fold saving over standard Panel rates (depending on who you want to talk to).

That’s a pretty disruptive business model in a market that needs a bit of disrupting.

However, if you want to use this service to do research, there are some things you need to know.  The kind of things you are only going to find in the finer details of what Google is offering.

  1. You can only ask TWO questions of the SAME respondent – This is a pretty big limitation, but not surprising given the cost and methodology.  It means that if you have a ten question survey and you want to understand how people who answered question five also answered question nine, you might be out of luck.  Given that a lot of useful analysis is done between questions, this is a big restriction you need to be aware of.  NOTE: technically it’s two questions per ‘request’, so the same respondent might be asked more than 2 questions if they have multiple ‘requests’ for the same study (but it’s not clear if Google even tracks this).
  2. Demographic information is inferred from IP address and browsing behavior - Given the two question limit you obviously can’t collect demographic data on each respondent.  Google gets around this by inferring demos from from IP address and using census tract information to compute average income, age, etc.  Another nice use of technology by Google, but there is really no discussion on how accurate this is.  In studies that I have done looking at IP address for survey responders, upwards of 20% of the sample may be taking the study at work.  Work IP address are different from home IP addresses and obviously not useful for inferring demos.  While Google does a lot of explaining in their White Paper around sampling accuracy, it is pretty much void of a discussion on demo inference accuracy – that’s something I’d love to see some more data on.  NOTE: I don’t consider the comparisons made in the sample accuracy work a direct measure of the accuracy of the demographics as it’s not clear how demographics interact with the questions they asked.
  3. Your data may be weighted by the inferred demographic data  - Compounding the problem of potentially inaccurate demographic data is that this data is also used for post-stratification weighting just in case the sample is skewed is some way.  This makes sense to do, but again, there is not a lot of discussion on the accuracy of the demographic data so the compounding error when using this data for weighting is also unknown.  NOTE: The post-stratification average error in the Consumer Survey test was an improvement on the un-weighted data, but that’s for a single test of a US population sample – does this the accuracy still hold as you do more regionally targeted studies where the accuracy of IP demo inference might be more of an issue?
  4. You don’t get access to the raw data – Not a big deal for most of the companies that will use this system, but annoying if you want to present results in a third party application (I expect Google will allow raw result extraction at some point in the future).
  5. You can’t ask an open-end response – I couldn’t find any reference to open-end questions.  And I don’t really think this type of survey-wall approach lends itself to getting people to explain their thoughts/feelings.  So again, probably not a big limitation for the likely target audience for this product.

So despite some of these limitations, I think the product is well suited to smaller, DIY  projects that don’t require any type of relatively sophisticated analysis.  Which, if you’re honest about it, is probably 80% of most research requirements for small and medium sized businesses.

I also have to hand it to Google for at least doing some due diligence on the tool’s accuracy.  While I agree with their own assessment of the limitations, I don’t see these limitations particularly hurting the majority of studies.

People in Market Research tend to have a very inflated sense of self importance when it comes to collecting survey data.  If Google Consumer Surveys further reinforces the fact that data collection is simple, cheap and fast – that’s a good thing.  It should be.

 

14 Responses to “Google Consumer Surveys”

  1. February 11, 2014 at 4:35 pm #

    Ideally, you should design your garden using urban permaculture techniques.
    If you are like me, you’ve probably heard this term, Permaculture,
    thrown around for a while now, but do you really know what it is.

    The gardens can teach children the importance of eating healthy foods grown from the earth.

  2. February 12, 2014 at 6:15 am #

    Did you ever think that you can actually have fun while playing with mud.
    One of the largest permaculture communities in the US, Earthhaven Ecovillage, is
    located in the nearby town of Black Mountain.
    You are the power person and your home is your happy lab.

  3. May 16, 2014 at 11:34 pm #

    Wonderful site. A lot of helpful info here.
    I’m sending it to a few friends ans additionally sharing
    in delicious. And certainly, thank you on your effort!

  4. Good write-up, I’m a frequent visitor of your
    blog. I enjoy reading your content.

    Here is my homepage Vigrx Plus Side Effects (http://prose.cesar.org.br/dokuwiki/doku.php?id=Keep_Your_Youthful_Look_With_These_Beauty_Tips_461)

  5. I quite like reading a post that will make people think.
    Also, thank you for allowing me to comment!

    Look into my weblog – expert concrete driveway overlay Bee Ridge area

  6. June 15, 2014 at 5:32 pm #

    My family members always say that I am killing my time here at web, except I know
    I am getting familiarity every day by reading thes nice content.

    Feel free to surf to my blog post: goji slim

  7. June 18, 2014 at 2:00 pm #

    I don’t comment, but after reading a ton of remarks on Google Consumer Surveys | insightbydesign. I do have a couple
    of questions for you if you tend not to mind. Could it be only me or does it look like like some of the remarks look like they are left by brain dead people?
    :-P And, if you are writing on other sites, I’d like
    to follow everything fresh you have to post. Would you post a list of
    every one of all your social sites like your Facebook page, twitter feed, or linkedin profile?

    Here is my page pinellas county dui lawyer

  8. June 19, 2014 at 8:12 pm #

    I think this is among the most essential info for me.
    And i’m happy reading your article. The website looks wonderful, the articles are excellent.

    my blog post: Best Acne Treatment Products (http://www.scribd.com)

  9. July 1, 2014 at 5:10 am #

    hello!,I llove your writing very a lot! percentage we communicate extra approxiately your article on AOL?
    I need a specialist in this house to solve myy problem.
    May be that is you! Looking forward tto look you.

  10. July 2, 2014 at 3:12 pm #

    Wonderful items from you, man. I’ve take ino account your stuff prrevious to and you are simply too excellent.
    I really like what you’ve bought here, really like what you are syating and the way
    during which youu assert it. You are making it enjoyable
    and you still takee care of to stay it sensible.
    I can not wait to read much moore from you.
    That is really a great site.

    • September 8, 2014 at 3:13 pm #

      A psychiatrist is a phyiicsan who specializes in the diagnosis and treatment of mental disorders. I have a bachelor’s degree in the social services field. For several years, I have worked with children who have been diagnosed with mental disorders. It is upsetting to see children victimize at an early age and even more disturbing to see them as predators as early as 5 years of age, however knowing that I am doing my part to assist them in becoming functioning youths and adults is rewarding. The empathy, confidentiality and maturity of a medical assistant are definitely needed in this area. I enjoy establishing a rapport with these clients and helping them to find adequate coping skills to deal with their disorders, therefore I would like to work for a psychiatrist.I would not like to work for an emergency phyiicsan for several reasons. I will explain a few. Patients who come to the emergency center typically have serious injuries or trauma. I would not like to have my mind constantly focused on who is coming thru the door and how sever the prognosis is. Knowing myself, I know that would be my focus and I would not be very productive. Also, in the emergency room the staff has to be prepared for anything, I would prefer an area that focuses on a particular specialty. Most importantly, I do not wish to see excessive amounts of blood loss on a regular basis. Actually, not even a minimal amount of blood loss on a regular basis. Giving my opinion and thoughts about this specialty, I would not be an effective employee.

  11. August 26, 2014 at 1:10 pm #

    Normally I do not learn post on blogs, however I wish to say that this write-up very pressured me to check out and
    do it! Your writing taste has been amazed me. Thanks, quite nice article.

  12. September 4, 2014 at 5:58 pm #

    Hey there! I could have sworn I’ve been to this website before but after browsing through some of the
    post I realized it’s new to me. Nonetheless, I’m definitely glad I found it
    and I’ll be book-marking and checking back frequently!

Trackbacks/Pingbacks

  1. Google Consumer Surveys and Disintermediation: A Client Perspective | GreenBook - April 10, 2012

    [...] review of the “Big Data” aspect from Neil Gains, and a nice objective overview on the InsightsByDesign [...]