Our Methodology

Springtide conducts a variety of online surveys for custom research projects and our own reporting. Guided by project-specific research questions, we develop survey instruments using a combination of validated scales, established items, and newly developed items. We test survey instruments through cognitive interviews to evaluate how potential respondents understand and respond to questions. Insights from these interviews help us revise surveys and improve the quality of the instrument. 

Participant recruitment and survey distribution vary across research projects. For some projects, surveys are distributed through the networks of our clients and partner organizations. For others, we contract with survey panel vendors to distribute surveys to respondents who meet eligibility and sampling criteria. Panel respondents are compensated for each completed survey based on supplier rates and survey length. 

Springtide’s sample sizes also vary by project. When possible and project-appropriate, we follow census distributions for age, gender, region, and ethnicity/race to create a nationally representative sample along these demographics. However, because the Census Bureau does not ask questions about religion or certain other demographics, it is unclear how representative our samples are across all metrics. Survey data are therefore best understood as tracking broad patterns and perspectives, rather than providing precise point estimates. 

Our team of researchers uses IBM SPSS, Stata, or R to clean and code the data. To improve data quality, we use various validity checks to exclude respondents who finish too quickly, select the same response option for every question, or fail attention or logic checks. Panel vendors we contract with also require potential respondents to verify their identities and create user profiles that require annual verification and updates. Springtide does not have access to respondents’ identities or other identifying information collected for verification purposes. 

Project survey items, recruitment procedures, data cleaning methods, and sample sizes can be found in the methodology statements of individual reports. 

When applicable, links to project-specific methodology statements, topline data, and The Association of Religion Data Archives (ARDA) datasets are shared online. 

Springtide uses qualitative methods, like in-depth interviews and focus groups, to collect data about social processes and phenomena that can be difficult to quantify. Springtide conducts interviews and focus groups by telephone or video call. Sampling methods vary by project and are selected based on the research questions and goals of the study. Some studies use probability-based sampling methods, such as randomly selecting potential participants to receive invitations by mail. Others use convenience or network-based sampling, in which participants are recruited through the networks of clients or partner organizations. Participation is voluntary, and respondents are compensated for their time.  

Interviews typically last between 30 and 75 minutes. Most interviews are guided but open-ended, allowing unexpected themes to emerge while also maintaining as much consistency across interviews as possible. Our team of researchers uses ATLAS.ti to code and analyze qualitative data.

Springtide’s research involves young people ages 13 to 25. We recognize the great responsibility that conducting research with young people entails. Thus, our team is trained in research ethics, compliance, and safety from the Collaborative Institutional Training Initiative or CITI Program. Certificates of completion are available upon request from research@springtideresearch.org.   

Protecting the privacy and well-being of young people is especially important to us. Our survey research is designed to pose no more than minimal risk, and we do not store any identifying information from survey respondents. All survey respondents complete an informed consent or assent process before participating.  

For interviews and focus groups, adults (ages 18+) must provide informed consent before participating. Young people under the age of 18 may participate in interviews or focus groups only with the informed consent of a parent or guardian and their own informed assent.  

Springtide’s internal project designs, study instruments, recruitment materials, informed consent forms, and researcher credentials are reviewed by an external Institutional Review Board (IRB). IRBs operate under federal regulations established by the US Department of Health and Human Services. They review and monitor research involving human participants with the authority to approve, require modifications to, or reject research proposals. In this way, IRBs play a critical role in the protection of the rights and welfare of participants in the research process.   

You can find out more about the external IRB Springtide uses at https://www.sterlingirb.com/.