What to know
An evaluation can use quantitative or qualitative data, and often includes both. Both methods provide important information for evaluation, and both can improve community engagement.
Section Overview
- Provide counted information to answer questions like "How many?" and "What were the outcomes?"
- Data collected through surveys, questionnaires, pretests and posttests, observation, or review of existing documents and databases
- Analysis involves statistical analysis
- Strengths: Generalizability (if sample represents population), ease of analysis, consistency and precision
- Limitations: Poor response rates, difficulty obtaining documents, may not provide contextual understanding
- Answer questions about value added, responsibility, and timing
- Data collected through direct or participant observation, interviews, focus groups, case studies, written documents
- Analysis includes examining patterns, identifying themes, coding data
- Strengths: Provides contextual understanding, complements quantitative data by explaining "why" and "how"
- Limitations: Lack of generalizability, time-consuming and costly data collection, complex analysis
- Combination of qualitative and quantitative methods
- Used when addressing diverse issues in community engagement evaluation
- Choice of methods depends on evaluation needs, timeline, and available resources
References
Ericsson KA, Simon HA. Protocol analysis. Cambridge (MA): Massachusetts Institute of Technology; 1993.
Garbarino S, Holland J. Quantitative and qualitative methods in impact evaluation and measuring results. Social Development Direct; 2009. Retrieved from http://www.gsdrc.org/docs/open/EIRS4.pdf
Krueger R, Casey M. Focus groups: a practical guide for applied research (3rd ed.). Thousand Oaks (CA): Sage; 2000.
Morgan D. Focus groups and qualitative research. Newbury Park (CA): Sage; 1997.
Patton MQ. Qualitative evaluation and research methods. Newbury Park (CA): Sage; 2002.
Steckler A, McLeroy KR, Goodman RM, Bird ST, McCormick L. Toward integrating qualitative and quantitative methods: an introduction. Health Education Quarterly 1992;19(1):1-8.