Evaluation of Different Recruitment Methods: Longitudinal, Web-Based, Pan-European Physical Activity Through Sustainable Transport Approaches (PASTA) Project.

Mailin Gaupp-Berghausen, Elisabeth Raser, Esther Anaya-Boig, Ione Avila-Palencia, Audrey de Nazelle, Evi Dons, Helen Franzen, Regine Gerike, Thomas Götschi, Francesco Iacorossi, Reinhard Hössinger, Mark Nieuwenhuijsen, David Rojas-Rueda, Julian Sanchez, Emilia Smeds, Manja Deforth, Arnout Standaert, Erik Stigell, Tom Cole-Hunter, Luc Int Panis
Author Information
  1. Mailin Gaupp-Berghausen: Institute for Transport Studies, University of Natural Resources and Life Sciences, Vienna, Vienna, Austria. ORCID
  2. Elisabeth Raser: Institute for Transport Studies, University of Natural Resources and Life Sciences, Vienna, Vienna, Austria. ORCID
  3. Esther Anaya-Boig: Centre for Environmental Policy, Imperial College London, London, United Kingdom. ORCID
  4. Ione Avila-Palencia: ISGlobal, Barcelona, Spain. ORCID
  5. Audrey de Nazelle: Centre for Environmental Policy, Imperial College London, London, United Kingdom. ORCID
  6. Evi Dons: Centre for Environmental Sciences, Hasselt University, Hasselt, Belgium. ORCID
  7. Helen Franzen: ICLEI, European Secretariat GmbH, Freiburg, Germany. ORCID
  8. Regine Gerike: Chair of Integrated Transport Planning and Traffic Engineering, Technische Universität Dresden, Dresden, Germany. ORCID
  9. Thomas Götschi: Physical Activity and Health Unit, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland. ORCID
  10. Francesco Iacorossi: Agenzia Roma Servizi per la Mobilità, Rome, Italy. ORCID
  11. Reinhard Hössinger: Institute for Transport Studies, University of Natural Resources and Life Sciences, Vienna, Vienna, Austria. ORCID
  12. Mark Nieuwenhuijsen: ISGlobal, Barcelona, Spain. ORCID
  13. David Rojas-Rueda: ISGlobal, Barcelona, Spain. ORCID
  14. Julian Sanchez: London Borough of Newham, London, United Kingdom. ORCID
  15. Emilia Smeds: Department of Science, Technology, Engineering and Public Policy, University College London, London, United Kingdom. ORCID
  16. Manja Deforth: Physical Activity and Health Unit, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland. ORCID
  17. Arnout Standaert: Flemish Institute for Technological Research (VITO), Mol, Belgium. ORCID
  18. Erik Stigell: Trivector Traffic AB, Stockholm, Sweden. ORCID
  19. Tom Cole-Hunter: ISGlobal, Barcelona, Spain. ORCID
  20. Luc Int Panis: Flemish Institute for Technological Research (VITO), Mol, Belgium. ORCID

Abstract

BACKGROUND: Sufficient sample size and minimal sample bias are core requirements for empirical data analyses. Combining opportunistic recruitment with a Web-based survey and data-collection platform yields new benefits over traditional recruitment approaches.
OBJECTIVE: This paper aims to report the success of different recruitment methods and obtain data on participants' characteristics, participation behavior, recruitment rates, and representativeness of the sample.
METHODS: A longitudinal, Web-based survey was implemented as part of the European PASTA (Physical Activity through Sustainable Transport Approaches) project, between November 2014 and December 2016. During this period, participants were recruited from 7 European cities on a rolling basis. A standardized guide on recruitment strategy was developed for all cities, to reach a sufficient number of adult participants. To make use of the strengths and minimize weakness, a combination of different opportunistic recruitment methods was applied. In addition, the random sampling approach was applied in the city of Örebro. To reduce the attrition rate and improve real-time monitoring, the Web-based platform featured a participant's and a researchers' user interface and dashboard.
RESULTS: Overall, 10,691 participants were recruited; most people found out about the survey through their workplace or employer (2300/10691, 21.51%), outreach promotion (2219/10691, 20.76%), and social media (1859/10691, 17.39%). The average number of questionnaires filled in per participant varied significantly between the cities (P<.001), with the highest number in Zurich (11.0, SE 0.33) and the lowest in Örebro (4.8, SE 0.17). Collaboration with local organizations, the use of Facebook and mailing lists, and direct street recruitment were the most effective approaches in reaching a high share of participants (P<.001). Considering the invested working hours, Facebook was one of the most time-efficient methods. Compared with the cities' census data, the composition of study participants was broadly representative in terms of gender distribution; however, the study included younger and better-educated participants.
CONCLUSIONS: We observed that offering a mixed recruitment approach was highly effective in achieving a high participation rate. The highest attrition rate and the lowest average number of questionnaires filled in per participant were observed in Örebro, which also recruited participants through random sampling. These findings suggest that people who are more interested in the topic are more willing to participate and stay in a survey than those who are selected randomly and may not have a strong connection to the research topic. Although direct face-to-face contacts were very effective with respect to the number of recruited participants, recruiting people through social media was not only effective but also very time efficient. The collected data are based on one of the largest recruited longitudinal samples with a common recruitment strategy in different European cities.

Keywords

References

  1. Contemp Clin Trials. 2012 Jan;33(1):67-75 [PMID: 21983626]
  2. Women Health. 1998;28(1):23-40 [PMID: 10022055]
  3. Internet Interv. 2014 Apr;1(2):58-64 [PMID: 25045624]
  4. Am J Epidemiol. 2006 Feb 1;163(3):197-203 [PMID: 16339049]
  5. BMJ Open. 2016 Jan 07;6(1):e009924 [PMID: 26743706]
  6. J Med Internet Res. 2015 Dec 24;17(12):e285 [PMID: 26704736]
  7. Sex Transm Infect. 2007 Dec;83(7):571-6 [PMID: 17971376]
  8. J Med Internet Res. 2014 Dec 15;16(12):e279 [PMID: 25514159]
  9. Internet Interv. 2016 Apr 27;4:72-81 [PMID: 30135792]
  10. BMC Med Res Methodol. 2015 Oct 08;15:80 [PMID: 26450702]
  11. Aust J Prim Health. 2015;21(2):254-8 [PMID: 24581281]
  12. BMC Public Health. 2015 Nov 14;15:1126 [PMID: 26577129]
  13. J Med Internet Res. 2014 May 01;16(5):e117 [PMID: 24784982]
  14. J Med Internet Res. 2014 Sep 01;16(9):e198 [PMID: 25231937]
  15. J Nutr Educ Behav. 2013 Jan-Feb;45(1):69-76 [PMID: 23305805]
  16. Am J Med Genet A. 2013 May;161A(5):951-7 [PMID: 23554131]
  17. Am J Epidemiol. 2015 May 15;181(10):737-46 [PMID: 25883155]
  18. Int J Methods Psychiatr Res. 2014 Jun;23(2):184-91 [PMID: 24615785]
  19. Hand (N Y). 2015 Sep;10(3):529-34 [PMID: 26330790]
  20. JMIR Public Health Surveill. 2016 Jul 11;2(2):e32 [PMID: 27400979]
  21. Eur J Epidemiol. 2010 Mar;25(3):163-72 [PMID: 20127393]
  22. JMIR Res Protoc. 2014 Sep 17;3(3):e48 [PMID: 25230740]
  23. J Med Internet Res. 2016 Nov 7;18(11):e286 [PMID: 27821383]
  24. Am J Epidemiol. 2010 Dec 1;172(11):1292-8 [PMID: 20880962]
  25. Ann Epidemiol. 2007 Sep;17(9):643-53 [PMID: 17553702]
  26. J Med Internet Res. 2012 Feb 01;14(1):e20 [PMID: 22297093]

MeSH Term

Adult
Europe
Exercise
Female
Humans
Internet
Longitudinal Studies
Male
Middle Aged
Research Design
Social Media
Surveys and Questionnaires

Word Cloud

Created with Highcharts 10.0.0recruitmentparticipantssurveyWeb-basedrecruitednumberdatacitieseffectivesampleopportunisticdifferentmethodslongitudinalEuropeansamplingÖrebroratepeople0platformapproachesparticipationPASTAPhysicalActivitySustainableTransportApproachesstrategyuseappliedrandomapproachattritionsocialmedia17averagequestionnairesfilledperparticipantP<001highestSElowestFacebookdirecthighonestudyobservedalsotopicBACKGROUND:SufficientsizeminimalbiascorerequirementsempiricalanalysesCombiningdata-collectionyieldsnewbenefitstraditionalOBJECTIVE:paperaimsreportsuccessobtainparticipants'characteristicsbehaviorratesrepresentativenessMETHODS:implementedpartprojectNovember2014December2016period7rollingbasisstandardizedguidedevelopedreachsufficientadultmakestrengthsminimizeweaknesscombinationadditioncityreduceimprovereal-timemonitoringfeaturedparticipant'sresearchers'userinterfacedashboardRESULTS:Overall10691foundworkplaceemployer2300/106912151%outreachpromotion2219/106912076%1859/1069139%variedsignificantlyZurich113348CollaborationlocalorganizationsmailinglistsstreetreachingshareConsideringinvestedworkinghourstime-efficientComparedcities'censuscompositionbroadlyrepresentativetermsgenderdistributionhoweverincludedyoungerbetter-educatedCONCLUSIONS:offeringmixedhighlyachievingfindingssuggestinterestedwillingparticipatestayselectedrandomlymaystrongconnectionresearchAlthoughface-to-facecontactsrespectrecruitingtimeefficientcollectedbasedlargestsamplescommonEvaluationDifferentRecruitmentMethods:LongitudinalWeb-BasedPan-EuropeanProjectquestionnairemobilephonemulticentral

Similar Articles

Cited By