ICYMI: Seven tips for effective web-based survey testing


Testing a web-based survey is one of the most detested activities to many in the survey research business. From a 2016 post, here are seven tips to better web-based survey testing practices for your next study. You're welcome :-)

FDA Genetic Health Assessment Ruling: Decoded

Trying to read and understand the latest FDA release on personal genetic testing (or what they are now calling Genetic Health Assessments)?  Wish that they could indent when they use multi-level outlines?  We have created a version that may be a bit easier to read and understand...

Evaluating Nonresponse Bias in a Longitudinal Study of Healthy Adults Receiving Genome Sequencing

We know your survey is exciting and will divulge important findings; you know your survey is exciting and will divulge important findings. But darn those who don’t know this and so don’t participate. Or worse – those who do know this, but choose not to participate for some other reason. Their nonresponse can create uncertainty in how accurate our survey results actually are.  If only we could survey robots or well-trained dogs who followed our instructions instead of people!

Research Wonder: A Case for Respondent Pre-Survey Rituals?

A couple months ago, I listened to a podcast episode called "Sports Superstitions" on a wonderful podcast called Fearless Conversations with Abby Wambach (which, by the way, is a wonderful podcast on a variety of social issues from the perspective of a professional athlete). It brought back memories of long ago (high school) days when I used to pole vault. For a long time I blamed my youth for the rituals that I would perform before and during competition.  How I removed the pole from its cardboard tube, the number of times I rocked back and forth before I started down the runway (three), and even the side of the pit that I used to jump off after I completed a vault (always the left)... 

Seven tips for effective web-based survey testing

Testing a web-based survey is one of the most detested activities to many in the survey research business.  It requires patience, persistence, and tremendous focus. Finding someone who enjoys testing and is good at it is a valuable asset to any survey research team. 

A wonderful resource for many details about testing questionnaires (including a chapter on web-based surveys) is Methods for Testing and Evaluating Survey Questionnaires.

Here are seven tips to better web-based survey testing practices for your next study...

Individual Guiding Principle Series: Principle 3 - Inclusivity

This post is part 3 of an in depth exploration and evolution of our guiding principles



We practice inclusivity in everything we do.  We build rooms and doors, not walls.

The scientific process benefits from inclusion.  We believe that through expanding collaboration we do one of two things:

  1. We get more work done with fewer resources. (We are more efficient.)
  2. The result of our collaborations are greater than they would have been regardless of how much effort we would have put into it on our own.

Inclusivity brings us diversity of background, experience, and perspective.  We are more likely to identify weaknesses in what we do with such diversity -- and that can be a scary experience for many to face.  We see fear of being wrong or being shown a different viewpoint as the cause of many errors made in our industry.

A hockey team made of 16 excellent goalies will never compete effectively with a balanced team of players with a variety of position skills.  It does not matter how good those goalies are at making saves, the team with wingers, centers, defense, coaches and trainers will be able to get more creative and move the puck around the ice and into the net.

An example of this principle in practice is how we apply our domains of science.  Our domains of science is used as a tool to guide the decision to launch any new survey.  Prior to a survey launch, we run through a pre-launch checklist that includes 12 domains to check to ensure a successful survey launch.  Anyone involved in a study has the right (and duty) to raise a flag if they believe that any domain has not received the attention it should.  We do not launch a survey without unanimity on this matter.  To be clear - it does not matter what position you are in or your area of expertise, we are inclusive of all contributors when it comes to this critical step in study execution.  

At SoundRocket we value inclusivity with our employees, in our work processes, and in our collaborations with our customers.  We let individuals determine how they contribute.  In our first principle, we stressed unity, in our second, we rested authority in groups, and here, we set our guideline for how those groups are formed.  In the next guideline, we will lay the foundation for how our inclusive groups function.