Survey Fundamentals
Bhattacherjee, A. (2012). Social Science Research: Principles, Methods, and Practices. Textbooks Collection. 3.
Carr, D. S., Boyle, E. H., Cornwell, B., Correll, S. J., Crosnoe, R., Freese, J., & Waters, M. C. (2018). Chapter 7: Survey Research. In The Art and Science of Social Research (p.193-231). W.W. Norton.
Cohort. (2013). In K. Bell (Ed.). Open education sociology dictionary. https://sociologydictionary.org/cohort/
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Pearson.
Deakin University Library. (2020, October 27). Cross-sectional studies-Quantitative study designs-LibGuides at Deakin University. https://deakin.libguides.com/quantitative-study-designs/cross-sectional
Elon University Poll. (2014, September 26). Methods of collecting survey data [Video]. YouTube. https://www.youtube.com/watch?v=9cuOyAR-Y9I&feature=emb_title
Franklin, S., Walker, C. (2010). Survey methods and practices. Statistics Canada Social Survey Methods Division.
Mackey, A., & Gass, S. M. (2005). Second language research: Methodology and design. Lawrence Erlbaum.
McCombes, S. (2019, August 20). How to do survey research. Scribbr. https://www.scribbr.com/methodology/survey-research/
Mahmutovic, J. (2020, July 27). 7 advantages of online surveys (and 3 disadvantages). https://www.surveylegend.com/online-survey/advantages-of-online-surveys/
Ohio State University Office of Student Life. (2013, February 6). Basics of designing a survey [Video]. YouTube. https://www.youtube.com/watch?v=36s6wBSJW8U
Precision Opinion. (2020, January 27). 5 reasons telephone surveys are more powerful than you think. https://precisionopinion.com/5-reasons-telephone-surveys-are-more-powerful-than-you-think/
Rafferty, A., Walthery, P., & King-Hele, S. (2015). Analysing change over time: repeated cross sectional and longitudinal survey data. UK Data Service.
SurveyMonkey. (n.d.) Survey vs questionnaire: What’s the difference?https://www.surveymonkey.com/mp/survey-vs-questionnaire/
Participants and Sampling
Arcury, T.A. & Quandt, S.A. (1999). Participant recruitment for qualitative research: A site-based approach to community research in complex societies. Human Organization, 58(2), 128-133. Retrieved June 16, 2021, from https://www.jstor.org/stable/44126647?seq=2#metadata_info_tab_contents
Catalogue of Bias Collaboration. (2017). Catalogue of Bias. https://catalogofbias.org/biases/selection-bia
CrashCourse. (2018, March 28). Sampling Methods and Bias with Surveys [Video]. YouTube. https://www.youtube.com/watch?v=Rf-fIpB4D50.
DeCarlo, M., Cummings, C. & Agnelli, K. (2020). Quantitative sampling. In M. DeCarlo, C. Cummings & K. Agnelli (Eds.), Graduate research methods in social work. Pressbooks. Retrieved from https://viva.pressbooks.pub/mswresearch/chapter/10-quantitative-sampling/.
DeCarlo, M. (2018). Scientific inquiry in social work. PressBooks. Retrieved June 16, 2021, from https://scientificinquiryinsocialwork.pressbooks.com/chapter/10-2-sampling-in-qualitative-research/
Ellard-Gray, A., Jeffrey, N.K., Choubak, M. & Crann, S.E. (2015). Finding the hidden participant: Solutions for recruiting hidden, hard-to-reach, and vulnerable populations. International Journal of Qualitative Methods, 14(5), 1-10. https://doi.org/10.1177/1609406915621420
ELLICSR. (2017, July 18). What is Informed Consent // Informed Consent Training [Video]. YouTube. https://www.youtube.com/watch?v=BXQHDCWSt-Q.
Evans, A.N. & Rooney, B.J. (2011). Selecting research participants. In A.N. Evans & B.J. Rooney (Eds.), Methods in Psychological Research, (pp. 116-129). SAGE Publications Inc.
Glen, S. (2017, July 30). Self-selection bias. Statistics How To. https://www.statisticshowto.com/self-selection-bias/
Harvart Catalyst. (2017). The use of social media in recruitment to research: A guide for investigators and IRBs. Retrieved June 24, 2021, from https://catalyst.harvard.edu/wp-content/uploads/regulatory/Social_Media_Guidance.pdf
Henrich, J., Heine, S.J. & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(1), 61-135. doi:10.1017/S0140525X0999152X
Mack, N., Woodsong, C., MacQueen, K.M., Guest, G. & Namey, E. (2005). Qualitative research methods: A data collector’s field guide. Family Health International.
Robinson, O.C. (2014). Sampling in interview-based qualitative research: A theoretical and practical guide. Qualitative Research in Psychology, 11(1), 25-41. https://doi.org/10.1080/14780887.2013.801543
Roulston, K. (2018, March 12). Recruiting participants for a qualitative research study. Qualpage. https://qualpage.com/2018/03/12/recruiting-participants-for-a-qualitative-research-study/
Sargeant, J. (2012). Qualitative research part II: Participants, analysis, and quality assurance. Journal of Graduate Medical Education. http://dx.doi.org/10.4300/JGME-D-11-00307.1
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018). Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & Quantity, 52(4), 1893–1907. https://doi.org/10.1007/s11135-017-0574-8
The Decision Lab (n.d.). Why responses to a survey or experiment can be inaccurate due to the nature of the survey or experiment. https://thedecisionlab.com/biases/response-bias/.
The National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. (1979). The Belmont Report: Ethical principles and guidelines for the protection of human subjects of research. Department of Health, Education, and Welfare. Retrieved July 1, 2021 from https://www.hhs.gov/ohrp/sites/default/files/the-belmont-report-508c_FINAL.pdf
Question Design
Allen, M. (2017). The sage encyclopedia of communication research methods (Vols. 1-4). Thousand Oaks, CA: SAGE Publications, Inc. https://methods.sagepub.com/reference/the-sage-encyclopedia-of-communication-research-methods/i14203.xml
Avineri, N. (2017). Research methods for language teaching: inquiry, process, and synthesis. Palgrave Macmillan. https://www.worldcat.org/title/research-methods-for-language-teaching-inquiry-process-and-synthesis/oclc/1204366822&referer=brief_results
Carr, D. S., Boyle, E. H., Cornwell, B., Correll, S. J., Crosnoe, R., Freese, J., & Waters, M. C. (2018). Chapter 7: Survey Research. In The Art and Science of Social Research (p.193-231). W.W. Norton. https://www.worldcat.org/title/art-and-science-of-social-research/oclc/1243647059&referer=brief_results
Choi, B. C., & Pak, A. W. (2005). A catalog of biases in questionnaires. Preventing chronic disease. 2(1). A13. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1323316/
Copeland, A. (2017). The pros and cons of open and closed questions. Retrieved from https://www.interpnet.com/NAI/docs/CIT/Copeland-Questions.pdf
Bloom, D., Canning, D., Dayalu, R. & Karra, M. (2020, April 27). COVID-19 symptoms & social distancing web survey: Version 2. Harvard University T.H. Chan School of Public Health. Retrieved from https://www.hsph.harvard.edu/pgda/covid/
Elon University Poll. (2014, September 16). 7 tips for good survey questions [Video]. Youtube. https://www.youtube.com/watch?v=Iq_fhTuY1hw
Gibbs, G. R. (2012, November 23). Question types & piloting. Part 1 of 3 on questionnaire design [Video]. Youtube. https://www.youtube.com/watch?v=vjailyWAcJQ
Hughes, J., Camden, A., Yangchen, T. (2016). Rethinking and updating demographic questions: Guidance to improve descriptions of research samples. Psi Chi Journal of Psychological Research. 21(3). https://cdn.ymaws.com/www.psichi.org/resource/resmgr/journal_2016/21_3Fall16JN-Hughes.pdf–_International-Cooperation-COVID_TOPLINE.pdf
QuestionPro. (n.d.) Close ended questions: Definition, types with examples. Retrieved from https://www.questionpro.com/close-ended-questions.html
QuestionPro. (n.d.) Open ended questions: Definition, types with examples. Retrieved from https://www.questionpro.com/blog/what-are-open-ended-questions/
Smith-Schoenwalder, C. (2020, June 24). Model Predicts Tens of Thousands of Lives Could be Saved if Almost Everyone Uses Masks. Retrieved November 19, 2020, from https://www.usnews.com/news/health-news/articles/2020-06-24/model-predicts-33-000-americans-could-be-saved-if-almost-everyone-uses-masks
U.S. Census Bureau. (2020). 2020 Household Pulse Survey. Retrieved from https://www2.census.gov/data/experimental-data-products/household-pulse-survey/household-pulse-survey-questionnaire.pdf
Questionnaire Design
Avineri, N. (2017). Research methods for language teaching: inquiry, process, and synthesis. Palgrave Macmillan. https://www.worldcat.org/title/research-methods-for-language-teaching-inquiry-process-and-synthesis/oclc/1204366822&referer=brief_results
BBC Studios. (2020, May 16). Leading Questions – Yes Prime Minister [Video]. Archive.org. https://archive.org/details/leading-questions-yes-prime-minister
DeFranzo, S. (n.d.). Survey design: Formatting your survey questionnaire. SnapSurveys. Retrieved February 28, 2021, from https://www.snapsurveys.com/blog/formatting-your-survey-questionnaire/
Dr. Nic’s Maths and Stats. (2014, February 17). Designing a questionnaire-statistics help [Video]. YouTube. https://www.youtube.com/watch?v=FkX-t0Pgzzs&feature=emb_title
Fanning, E. (2005). Formatting a paper-based survey questionnaire: Best practices. Practical Assessment, Research, & Evaluation. 10(12). 1-14. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.458.1417&rep=rep1&type=pdf
Krosnick, J., Presser, S. (2009). Question and Questionnaire Design. In Wright, J. and Marsden, P. (Eds). Handbook of Survey Research (p. 1-81). Elsevier. https://web.stanford.edu/dept/communication/faculty/krosnick/docs/2009/2009_handbook_krosnick.pdf
Pew Research. (2020, April 12). Pew Research Center: 2020 Pew Research Center’s American Trends Panel. Retrieved from https://www.pewresearch.org/wp-content/uploads/2020/04/COVID-impact-on-K-12-education-topline.pdf
Pew Research Center. (2019). Methods 101: How is polling done around the world? [Video]. Youtube. https://youtu.be/CV0ZCQyI9M4
Pew Research Center. (n.d.) Methods: Questionnaire design. Retrieved February 28, 2021, from https://www.pewresearch.org/methods/u-s-survey-research/questionnaire-design/
Vanette, D. (2014, September 15). Questionnaire design: Theory and best practices. [Workshop presentation]. Stanford University Institute for Research in the Social Sciences. https://iriss.stanford.edu/sites/g/files/sbiybj6196/f/questionnaire_design_1.pdf
Qualtrics. (n.d.) Survey methodology & compliance best practices. Retrieved from https://www.qualtrics.com/support/survey-platform/survey-module/survey-checker/survey-methodology-compliance-best-practices/
Raimondi, A. (n.d.). 3 ways to improve the visual design of your survey. Retrieved from https://www.surveymonkey.com/curiosity/3-ways-to-improve-visual-design-of-surveys/?ut_source=mp
Survey Monkey. (n.d.). Survey Introductions. https://help.surveymonkey.com/articles/en_US/kb/Tip-Creating-an-effective-survey-introduction
University of Michigan. (n.d.). UX research at scale: surveys, analytics, online testing [Video]. Coursera. https://www.coursera.org/lecture/ux-research-at-scale/visual-design-of-survey-questions-Oo0lE
UTS Engineering. (2014, August 13). Questionnaire structure [Video]. Youtube. https://www.youtube.com/watch?v=WocacrAsvCY
Survey Implementation
Blazek, L. (2017). Turned on Black and Grey Computer Photo [Digital Image]. Unsplash. https://unsplash.com/photos/mcSDtbWXUZU
Chudoba, B. (n.d.). Does adding one more question impact survey completion rate? Survey Monkey. https://www.surveymonkey.com/curiosity/survey_questions_and_completion_rates/
Chudoba, B. (n.d.). How much time are respondents willing to spend on your survey? Survey Monkey. https://www.surveymonkey.com/curiosity/survey_completion_times/
Gitlin, J. (n.d.) Survey data cleaning: 7 things to check before you start your analysis. Survey Monkey. https://www.surveymonkey.com/curiosity/survey-data-cleaning-7-things-to-check-before-you-start-your-analysis/
National Research Center. (2017, February 10). Do Incentives Increase Response Rate? [Video]. Facebook. https://www.facebook.com/NRCInc/videos/1219545101448157/
Willott, L. (2019, July 12). Average survey response rate-What you need to know. Customer Thermometer. https://www.customerthermometer.com/customer-surveys/average-survey-response-rate/
Survey Monkey. (n.d.). Sample Size Calculator. Retrieved from https://www.surveymonkey.com/mp/sample-size-calculator/
Survey Monkey. (n.d.). Using survey incentives to improve response rates. Retrieved from https://www.surveymonkey.com/mp/using-survey-incentives-to-improve-response-rates/
The Pell Institute. (n.d.) Evaluation guide: Analyze qualitative data.http://toolkit.pellinstitute.org/evaluation-guide/analyze/analyze-qualitative-data/ Willott, L. (2019, July 12).
Reliability and Validity
Aldridge, V. (2017). Table 2: Comparison of student exam scores showing a small bias [Digital image]. In Assessing test-retest reliability of psychological measures: Persistent methodological problems. European Psychologist. 22(4). 12. https://doi.org/10.1027/1016-9040/a000298
Aldridge, V., Dovey, T., Wade, A. (2017). Assessing test-retest reliability of psychological measures: Persistent methodological problems. European Psychologist. 22(4). 207-218. https://doi.org/10.1027/1016-9040/a000298
Arpin, Elizabeth. (2016, February 17). Discriminant validity [Video]. YouTube. https://www.youtube.com/watch?v=dDLwuK_rORY
Carr, D. S., Boyle, E. H., Cornwell, B., Correll, S. J., Crosnoe, R., Freese, J., & Waters, M. C. (2018). Chapter 7: Survey Research. In The Art and Science of Social Research (p.193-231). W.W. Norton. https://wwnorton.com/books/9780393537529
ChrisFlipp. (2014, March 17). Reliability & validity [Video]. YouTube. https://www.youtube.com/watch?v=9ltvDNAsO-I&list=PL6MBkp9QmXTETU60aBT_M7Jw2BvzuE132
Fisher, S. (2020, November 13). Market research: 7 ways to pretest your survey before you send it. Qualtrics. Retrieved from https://www.qualtrics.com/blog/6–ways-to-pretest-your-survey-before-you-send-it/
Glaser, B. (1965). The Constant Comparative Method of Qualitative Analysis. Social Problems. 12(4). 436–445. https://doi.org/10.2307/798843
MeanThat. (2016, March 17). 3.11 Validity and Reliability of Research [Video]. YouTube. https://www.youtube.com/watch?v=2fK1ClycBTM&list=PL6MBkp9QmXTETU60aBT_M7Jw2BvzuE132&index=2
Price, P., Jhangiani, R., & Chiang, I. (2015). Chapter 19: Understanding psychological measurement. In Research Methods of Psychology – 2nd Canadian Edition. BCcampus. Retrieved from https://kpu.pressbooks.pub/psychmethods4e/chapter/understanding-psychological-measurement/
Price, P., Jhangiani, R., & Chiang, I. (2015). Chapter 20: Reliability and validity of measurement. In Research Methods of Psychology – 2nd Canadian Edition. BCcampus. Retrieved from https://kpu.pressbooks.pub/psychmethods4e/chapter/reliability-and-validity-of-measurement/
Rosenberg’s Self-Esteem Scale. (n.d.). https://wwnorton.com/college/psych/psychsci/media/rosenberg.htm
Ruel, E., Wagner III, W. & Gillespie, B. (2016). Chapter 6: Pretesting and pilot testing. In The practice of survey research (pp. 101-119). SAGE Publications. https://us.sagepub.com/sites/default/files/upm-assets/68507_book_item_68507.pdf
Vanette, D. (2019). The Qualtrics handbook of question design. Qualtrics. 22-24. Retrieved from https://success.qualtrics.com/rs/542-FMF-412/images/The%20Qualtrics%20handbook%20of%20question%20design.pdf
Data Analysis
Bevans, R. (2020, January 28). Statistical tests: which one should you choose? Scribbr. https://www.scribbr.com/statistics/statistical-tests/
CSSLOhioStateU. (2014, August 3). Your survey closed, now what? Quantitative analysis basics [Video]. YouTube. https://www.youtube.com/watch?v=4q5UZwwidRI
Dr Nic’s Maths and States. (2012, January 31) Statistical tests: Choosing which statistical test to use [Video]. YouTube. https://www.youtube.com/watch?v=rulIUAN0U3w
Dr. Saul McLeod. (2019, June 10, updated 2021). What are Confidence Intervals in Statistics? https://www.simplypsychology.org/confidence-interval.html#:~:text=The%20confidence%20interval%20(CI)%20is,an%20upper%20and%20lower%20interval.
Excel Campus-Jon. (2015, February 4). Introduction to pivot tables, charts, and dashboards in Excel (Part 1) [Video]. YouTube. https://www.youtube.com/watch?v=9NUjHBNWe9M
Laerd Statistics. (n.d.) FAQs on measures of central tendency-Mean, mode and median. Lund Research. Lundt Research. https://statistics.laerd.com/statistical-guides/measures-central-tendency-mean-mode-median.php
Scribbr. (2019, November 15). Quantitative vs qualitative research: The differences explained [Video]. YouTube. https://www.youtube.com/watch?v=a-XtVF7Bofg&t=71s
Southampton Education School. (2012, August 14). Analyzing Questionnaires. https://www.youtube.com/watch?v=c5ClF8RlGb4
Statisticshowto. (n.d.) Mean and Median in Skewed Distributions. https://www.statisticshowto.com/probability-and-statistics/skewed-distribution/#:~:text=In%20a%20normal%20distribution%2C%20the,the%20right%20of%20the%20median.
Stephanie Glen. (2014, December 12). Skewed distribution: left skewed vs right skewed [Video]. YouTube. https://www.youtube.com/watch?v=24YCewQ8s3M
Sullivan, Lisa. (n.d.). Confidence Intervals. https://sphweb.bumc.bu.edu/otlt/mph-modules/bs/bs704_confidence_intervals/bs704_confidence_intervals_print.html
SurveyMonkey. (n.d.) Developing a data analysis plan. https://www.surveymonkey.com/mp/developing-data-analysis-plan/
You have completed this module!
Click the next button to start the next topic or return to the main menu.