AccessMyLibrary provides FREE access to over 30 million articles from top publications available through your library.

Online and traditional paper-and-pencil survey administration: examining experimenter presence, sensitive material and long surveys.

The Canadian Journal of Human Sexuality

| September 22, 2006 | Wood, Eileen; Nosko, Amanda; Desmarais, Serge; Ross, Craig; Irvine, Colleen | COPYRIGHT 2006 SIECCAN, The Sex Information and Education Council of Canada. This material is published under license from the publisher through the Gale Group, Farmington Hills, Michigan.  All inquiries regarding rights should be directed to the Gale Group. (Hide copyright information)Copyright

Abstract: The present study examined response differences between paper-and-pencil versus computer administered surveys as a function of experimenter presence, survey length, and sensitive material, including sexuality-related measures. Three conditions were employed, one traditional supervised paper-and-pencil condition, one online computer administration condition that was supervised, and one unsupervised online computer administration condition. Missing data were greatest in the paper-and-pencil condition specifically at the end of this long survey in comparison to both online computer conditions. Of the four measures assessing sensitive material, more missing data were found in the paper-and-pencil condition but only for one measure assessing sensitive content. Researcher presence did not have an impact on performance. These findings have important implications for designing and interpreting survey outcomes.

Key words: Survey administration, sensitive measures, length of survey, computerized surveys.

Acknowledgements: We would like to thank Meghan Bellamy and Jen Caron for their help in conducting this research.

Introduction

For decades, paper-and-pencil surveys have served as the primary means for gathering survey information primarily because paper-and-pencil surveys provided a more economical and efficient means for collecting large amounts of data relative to other available data collection techniques, such as interviewing. Advances in computer technology, particularly, the prevalence and accessibility afforded by the Internet, have made it possible to reach vast numbers of participants even more efficiently and economically than through paper-and- pencil surveys (Pasveer & Ellard, 1998). In addition, software technology permits direct data entry thereby reducing costs as well as decreasing data entry errors and the time from data collection to analysis. With the transition to new and different mediums for presenting surveys, researchers and test-developers have questioned whether the new medium will affect the integrity of the survey instrument both in terms of reliability and validity issues and in response rates. The perceived advantages of computer and Internet versus paper-and-pencil survey administration have been supported in some recent investigations (Knapp & Kirk, 2003; Pettit, 2002; Truell, Bartlett, & Alexander, 2002) while others have identified limitations (Crawford, Couper & Lamias, 2001; Tourangeau, 2004).

Several studies assessing the reliability and effectiveness of computer versus and paper-and-pencil survey methodologies have found none or relatively few differences between the two methodologies (Chuah, Drasgow, & Roberts, 2006; Cronk & West, 2002; Knapp & Kirk, 2003; Pettit, 2002; Truell et al., 2002). Given these findings one might conclude that the two methodologies yield equivalent products, with online presentations offering the additional economic advantages. There are however, differences in the methodologies that may differentially affect outcomes.

While most Internet and some computer assessments eliminate the need for a researcher to be present during administration, the anonymity and lack of proctoring may affect how participants respond to survey items. Without having a researcher present to guide participants, there is the possibility of questions being misunderstood. With no one present to clarify the question, confusing items may be answered randomly or abandoned (Nosek, Banaji & Greenwald, 2002). Legitimacy of the survey may also be compromised in the absence of a researcher. For example, the survey may not be taken as seriously by the participant (Tourangeau, 2004) and may be completed by someone other than the desired participant.

Related articles from newspapers, magazines, journals, and more
Looking good or being good? The role of social desirability tendencies in...
Magazine article from: College Student Journal Ferrari, Joseph R. Bristow, Maya Cowman, Shaun E. March 1, 2005 700+ words
...approval. With Sample 1, global social desirability was not predictive of any student...procedures that take into account social desirability tendencies and perhaps other impression...opinions, and personality styles. Social desirability, bias, the tendency to answer...
Religious influences on sensitive self-reported behaviors: the product of...
Magazine article from: Sociology of Religion Regnerus, Mark D. Uecker, Jeremy E. June 22, 2007 700+ words
...attribute them to selection effects, social desirability bias or lack of candidness in survey...association of religiosity with social desirability bias or lack of candidness in survey...religion in young people's lives. Social desirability bias is the tendency of individuals...
Intimate violence and social desirability: a meta-analytic review.
Magazine article from: Journal of Interpersonal Violence Sugarman, David B. Hotaling, Gerald T. April 1, 1997 700+ words
...were more strongly correlated with social desirability scores that were reports of being...prevalence estimates, the effect of social desirability responding. Because of the negative...for example, the Marlowe-Crowne Social Desirability Scale (Crowne & Marlowe...
A psychometric investigation of the Marlowe-Crowne Social Desirability Scale...
Magazine article from: Measurement and Evaluation in Counseling and Development Seol, Hyunsoo October 1, 2007 700+ words
...scores on the Marlowe-Crowne Social Desirability Scale (MCSDS; D. P. Crowne...King & Bruner, 2000). Social desirability bias, which is defined as "the...noted that "the meaning of high social desirability scores is not at all clear" (p...
Wives' and husbands' housework reporting: gender, class, and social...
Magazine article from: Gender & Society Press, Julie E. Townsley, Eleanor April 1, 1998 700+ words
A central issue of housework research is the degree to which different household members' unpaid contributions to the household have changed in recent decades. Studies have shown consistently, for example, that in this era of married women's rising labor force participation, employed wives have
Predictors of coping with work stress: the influences of sex, gender role,...
Magazine article from: Sex Roles: A Journal of Research Gianakos, Irene March 1, 2002 700+ words
High masculinity and/or femininity scores were, as expected, predictive of the control-related coping styles of help-seeking, positive thinking, and direct action, and were not predictive of the escape-related coping styles of alcohol use and avoidance/resignation. Help-seeking scores were
Collecting data on alcohol use and alcohol-related victimization: a comparison...
Magazine article from: Journal of Studies on Alcohol Parks, Kathleen A. Pardi, Ann M. Bradizza, Clara M. March 1, 2006 700+ words
...based methods of survey administration may reduce socially...for reduced social desirability responding on...other modes of survey administration (Davis, 1999...the modes of survey administration. A number of...
Allianz switches to Kenexa for employee survey administration.
Newspaper article from: Telecomworldwire July 24, 2008 700+ words
TELECOMWORLDWIRE-24 July 2008-Allianz switches to Kenexa for employee survey administration(C)1994-2008 M2 COMMUNICATIONS LTD http://www.m2.com Kenexa (NasdaqGS:KNXA), a software, services and proprietary...
Stock option expensing: a quick hit survey. (Administration).(pensions)(Brief...
Newspaper article from: Pension Benefits September 1, 2002 700+ words
"Seventy-one percent [of stock-option plan administrators don't] believe expense accounting for stock options will become a common practice [for] U.S. companies by the end of 2002, according to [our] survey. Many companies have not made up their minds about what they might do should legislation or
Effects of survey mode, patient mix, and nonresponse on CAHPS[R] hospital...
Magazine article from: Health Services Research Elliott, Marc N. Zaslavsky, Alan M. Goldstein, Elizabeth Lehrman, William Hambarsoomians, Katrin Beckett, Megan K. Giordano, Laura April 1, 2009 700+ words
...their telephone keypads. Mode of survey administration can affect the scores received by...leads to response bias (e.g., social desirability bias). Previous studies have generally...is reason to expect that mode of survey administration may have a greater impact on hospital...
For more facts and information, see all results

Source: HighBeam Research, Online and traditional paper-and-pencil survey administration:...

©2009 Gale, a part of Cengage Learning. All rights reserved.
About us | FAQs | Contact us | Privacy policy | Terms and conditions
Other Gale sites: Encyclopedia.com | HighBeam Research | Acquire Content | Books & Authors | Goliath | MovieRetriever | Smart QandA