In the past thirty-nine (39) years Research Strategies, Inc. has seen the evolution of on-line list/panel research. When these individuals are solicited or attracted to these national panel research firms, the first step is for them to complete detailed questionnaires about themselves and their likes and dislikes. In many cases, we have found these individuals to be on multiple lists and/or panels. Even with a single list/panel research firm, they are highly likely to be used across multiple subject areas and/or used multiple times over a short duration of time. While the monetary rewards for these panel/list participants is their primary incentive, some use their participation as a distraction from their everyday life. A game if you will, to becoming “research experts” and gaining a sense of power knowing that their comments are influencing the research results that could impact many other people.
When one looks carefully at the psychology of these type of methodologies, it is easy to realize individuals participating on online research panel/lists should be carefully critiqued, if not eliminated from a research sample. They have a potential of thinking too much through the questions and more likely offering answers they consider more in-line to what the research company wants to hear.
Another factor that must be considered, is the difficulties in gaining a sufficient sample size in tight geographic areas. Even with lists/panel boasting thousands of members, qualified research participants in a given state, county, city/town or even ZIP Code are likely to be limited. So, when research calls for accuracy, a random sampling methodology probably delivers a much better appraisal of your marketplace. Properly structured research can and will answer your products or services’ critical unanswered questions, but research without logical sampling methodology can be expensive and misleading eventually.
Eugene A. Talbott
President