Abstract
The literature on mixed methods and multimethods has burgeoned over the last 20 years, and researchers from a growing number and diversity of fields have progressively embraced these approaches. However, rapid growth in any movement inevitably gives rise to gaps or shortcomings, such as “identity crises” or divergent conceptual views. Although some authors draw a clear and sometimes opinionated distinction between mixed methods and multimethods, for others, they are synonymous. The concepts underlying both terms therefore have become blurred and generated much confusion. The aim of this article is to explore the origins of the confusion, describe our view of mixed methods and multimethod studies, and by doing so, help to clearly delineate the two concepts. The authors have presented their opinion of how these terms and concepts should be distinguished and call for a constructive debate of the issues involved in the mixed methods and multimethod literature. This is a way truly to propel the field forward.
Similar content being viewed by others
References
Anguera, M.T.: Observational typology. Qual. Quant. 13(6), 449–484 (1979)
Anguera, M.T.: Observational methods (general). In: Fernández-Ballesteros, R. (ed.) Encyclopedia of Psychological Assessment, vol. 2, pp. 632–637. Sage, London (2003)
Anguera, M.T., Hernández-Mendo, A.: Avances en estudios observacionales de Ciencias del Deporte desde los mixed methods (advances in mixed methods observational studies in sports sciences). Cuad. Psicol. Dep. 16(1), 17–30 (2016)
Anguera, M.T., Izquierdo, C.: Methodological approaches in human communication: from complexity of perceived situation to data analysis. In: Riva, G., Anguera, M.T., Wiederhold, B.K., Mantovani, F. (eds.) From Communication to Presence. Cognition, Emotions and Culture Towards the Ultimate Communicative Experience, pp. 203–222. IOS Press, Amsterdam (2006)
Anguera, M.T., Blanco-Villaseñor, A., Losada, J.L.: Diseños observacionales, cuestiones clave en el proceso de la metodología observacional [observational designs, key issues in the process of observational methodology]. Metod. Cienc. Comport. 3(2), 135–160 (2001)
Anguera, M.T., Camerino, O., Castañer, M., Sánchez-Algarra, P.: Mixed methods en actividad física y deporte (mixed methods in physical activity and sport). Rev. Psicol. Dep. 23(1), 123–130 (2014)
Anguera, M.T., Camerino, O., Castañer, M., Sánchez-Algarra, P., Onwuegbuzie, A.J.: The specificity of observational studies in physical activity and sports sciences: moving forward in mixed methods research and proposals for achieving quantitative and qualitative symmetry. Front. Psychol. 8, 2196 (2017). https://doi.org/10.3389/fpsyg.2017.02196
Anguera, M.T., Portell, M., Chacón-Moscoso, S., Sanduvete-Chaves, S.: Indirect observation in everyday contexts: concepts and methodological guidelines within a mixed methods framework. Front. Psychol. 9, 13 (2018). https://doi.org/10.3389/fpsyg.2018.00013
Archibald, M.M.: Investigator triangulation: a collaborative strategy with potential for mixed methods research? J. Mix. Methods Res. 10(3), 228–250 (2015). https://doi.org/10.1177/1558689815570092
Archibald, M.M., Radil, A.I., Zhang, X., Hanson, W.E.: Current mixed methods practices in qualitative research: a content analysis of leading journals. Int. J. Qual. Methods 14(2), 5–33 (2015)
Bakeman, R., Gottman, J.M.: Applying observational methods: a systematic view. In: Osofsky, J.D. (ed.) Handbook of Infant Development, 2nd edn, pp. 818–853. Wiley, New York (1987)
Bakeman, R., Gottman, J.M.: Observing Interaction. Introduction to Sequential Analysis, 2nd edn. Cambridge University Press, Cambridge (1997)
Bazeley, P.: Editorial: integrating data analyses in mixed method research. J. Mix. Methods Res. 3(3), 203–207 (2009). https://doi.org/10.1177/1558689809334443
Bazeley, P.: Integrative analysis strategies for mixed data sources. Am. Behav. Sci. 56(6), 814–828 (2012). https://doi.org/10.1177/0002764211426330
Bazeley, P.: Writing up multimethod and mixed methods research for diverse audiences. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 296–313. Oxford University Press, Oxford (2015)
Bazeley, P., Kemp, L.: Mosaics, triangles, and DNA: metaphors for integrated analysis in mixed methods research. J. Mix. Methods Res. 6(1), 55–72 (2012). https://doi.org/10.1177/1558689811419514
Bergman, M.M.: Multimethod research and mixed methods research: old wine in new bottles? J. Mix. Methods Res. 1(1), 101–104 (2007). https://doi.org/10.1177/2345678906291429
Blanco-Villaseñor, A., Losada, J.L., Anguera, M.T.: Analytic techniques in observational designs in environment–behavior relation. Medio Ambient Comport. Hum. 4(2), 111–126 (2003)
Borkan, J.M.: Mixed methods studies: a foundation for primary care research. Ann. Fam. Med. 2, 4–6 (2004)
Brewer, J., Hunter, A.: Multimethod Research: A Synthesis of Styles. Sage, Newbury Park (1989)
Brewer, J., Hunter, A.: Foundations of Multimethod Research: Synthesizing Styles, 2nd edn. Sage, Thousand Oaks (2006)
Burns, K.K., Bellows, M., Eigenseher, C., Jackson, K., Gallivan, J., Rees, J.: Exploring patient engagement practices and resources within a health care system: applying a multi-phased mixed methods knowledge mobilization approach. Int. J. Mult. Res. Approach. 8(2), 233–247 (2014). https://doi.org/10.1080/18340806.2014.11082063
Campbell, D.T., Fiske, D.W.: Convergent and discriminant validation by the multitrait–multimethod matrix. Psychol. Bull. 56, 81–105 (1959)
Christ, T.W.: Book review: the oxford handbook of multimethod and mixed methods research inquiry. J. Mix. Methods Res. 10(2), 207–209 (2016). https://doi.org/10.1177/1558689815622704
Cook, T.D.: Postpositivism critical multiplism. In: Shortlan, R.L., Mark, M.M. (eds.) Social Science and Social Policy, pp. 21–62. Sage, Beverly Hills (1985)
Cook, T.D., Campbell, D.T.: Quasi Experimentation: Design and Analysis Issues for Field Settings. Rand Mc Nally, Chicago (1979)
Creswell, J.W.: A Concise Introduction to Mixed Methods Research. Sage, Thousand Oaks (2015)
Creswell, J.W., Plano Clark, V.L.: Designing and Conducting Mixed Methods Research. Sage, Thousand Oaks (2007)
Creswell, J.W., Tashakkori, A.: Develo** publishable mixed methods manuscripts. J. Mix. Meth. Res. 1(2), 107–111 (2007). https://doi.org/10.1177/1558689806298644
Creswell, J.W., Tashakkori, A.: How do research manuscripts contribute to the literature on mixed methods? J. Mix. Meth. Res. 2(2), 115–120 (2008). https://doi.org/10.1177/1558689808315361
Creswell, J.W., Plano Clark, V.L., Gutmann, M.L., Hanson, W.E.: Advanced mixed methods research designs. In: Tashakkori, A., Teddie, C. (eds.) Handbook of Mixed Methods in Social & Behavioral Research, pp. 209–240. Sage, Thousand Oaks (2003)
Denzin, N.K.: The Research Act: A Theoretical Introduction to Sociological Method. McGraw-Hill, New York (1978)
Fassnacht, G.: Theory and Practice of Observing Behaviour. Academic Press, New York (1982)
Fetters, M.D., Freshwater, D.: Publishing a methodological mixed methods research article. J. Mix. Methods Res. 9(3), 203–213 (2015). https://doi.org/10.1177/1558689815594687
Fetters, M.D., Curry, L.A., Creswell, J.W.: Achieving integration in mixed methods designs: principles and practices. Health Serv. Res. 48(6 Pt. 2), 2134–2156 (2013). https://doi.org/10.1111/1475-6773.12117
Fowler, F.J.: Survey Research Methods. Sage, Newbury Park (1993)
Galt, K.A.: SPSS text analysis for surveys 2.1 and qualitative and mixed methods analysis. J. Mix. Methods Res. 2(3), 284–286 (2008). https://doi.org/10.1177/1558689808317830
Gibbs, G.R.: Atlas.ti software to assist with the qualitative analysis of data. J. Mix. Methods Res. 1(1), 103–104 (2007). https://doi.org/10.1177/2345678906291490
Greene, J.C.: Is mixed methods social inquiry a distinctive methodology? J. Mix. Methods Res. 2(1), 7–22 (2008). https://doi.org/10.1177/1558689807309969
Greene, J.C.: Preserving distinctions within the multimethod and mixed methods research merger. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 606–615. Oxford University Press, Oxford (2015)
Guetterman, T.C.: What distinguishes a novice from an expert mixed methods researcher? Qual. Quant. 51, 377–398 (2017)
Hesse-Biber, S.N.: Mixed Methods Research: Merging Theory with Practice. Guilford Press, New York (2010)
Hesse-Biber, S.N.: Introduction: navigating a turbulent research landscape: working the boundaries, tensions, diversity, and contradictions of multimethod and mixed methods inquiry. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. xxxiii–liii. Oxford University Press, Oxford (2015)
Hesse-Biber, S.N., Rodriguez, D., Frost, N.A.: Qualitatively driven approach to multimethod and mixed methods research. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 3–20. Oxford University Press, Oxford (2015)
Hillyard, S.: New Frontiers in Ethnography. Bingley, Emerald (2010)
Holstein, J.A., Gubrium, J.F.: Phenomenology, etnomethodology, and interpretative practice. In: Denzin, N.K., Lincoln, Y.S. (eds.) Handbook of Qualitative Research, pp. 262–272. Sage, Thousand Oaks (1994)
Hunter, A., Brewer, J.: Designing multimethod research. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 185–205. Oxford University Press, Oxford (2015a)
Hunter, A., Brewer, J.: Conundrums of multimethod resarch. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 616–623. Oxford University Press, Oxford (2015b)
Johnson, R.B.: Dialectical pluralism and mixed research. Am. Behav. Sci. 56(6), 751–754 (2012). https://doi.org/10.1177/0002764212442494
Johnson, R.B., Onwuegbuzie, A.J., Turner, L.A.: Toward a definition of mixed methods research. J. Mix. Methods Res. 1(2), 112–133 (2007). https://doi.org/10.1177/1558689806298224
Kerlinger, F.N.: Foundations of Behavioral Research: Educational, Psychological and Sociological Inquiry. Holt Rinehart & Winston, New York (1973)
Lazarsfeld, P.F.: Foreward to Ernest Greenwood, Experimental Sociology. King’s Crown Press, New York (1945)
Lee, R.M.: Unobtrusive Methods in Social Research. Open University Press, Buckingham (2000)
Leeman, J., Voils, C.I., Sandelowski, M.: Conducting mixed methods literature reviews: synthesizing the evidence needed to develop and implement complex social and health interventions. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 167–184. Oxford University Press, Oxford (2015)
Levitt, H.M., Bamberg, M., Creswell, J.W., Frost, D.M., Josselson, R., Suárez-Orozco, C.: Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology: the APA Publications and Communications Board Task Force Report. Am. Psychol. 73(1), 26–46 (2018)
Mark, M.M.: Mixed and multimethods in predominantly quantitative studies, especially experiments and quasi-experiments. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 21–41. Oxford University Press, Oxford (2015)
Maxwell, J., Chmiel, M., Rogers, S.E.: Designing integration in multimethod and mixed methods research. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 223–239. Oxford University Press, Oxford (2015)
Mertens, D.: Publishing mixed methods research. J. Mix. Methods Res. 5(1), 3–6 (2011). https://doi.org/10.1177/1558689810390217
Molina-Azorín, J.F., Fetters, M.D.: Mixed methods research prevalence studies: field-specific studies on the state of the art of mixed methods research. J. Mix. Methods Res. 10(2), 123–128 (2016). https://doi.org/10.1177/1558689816636707
Morales-Sánchez, V., Pérez-López, V., Anguera, M.T.: Tratamiento metodológico de la observación indirecta en la gestión de organizaciones deportivas (indirect observational methodology in managing sports services). Rev. Psicol. Dep. 23(1), 201–207 (2014)
Morse, J.M.: Principles of mixed methods and multimethod research design. In: Tashakkori, A., Teddie, C. (eds.) Handbook of Mixed Methods in Social & Behavioral Research, pp. 189–208. Sage, Thousand Oaks (2003)
Morse, J.M.: Procedures and practice of mixed method design. Maintaining control, rigor, and complexity. In: Taskakkori, A., Teddie, C. (eds.) Sage Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn, pp. 339–352. Sage, Thousand Oaks (2010)
Morse, J.M.: Issues in qualitatively-driven mixed-method designs: walking through a mixed-method project. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 206–222. Oxford University Press, Oxford (2015)
Morse, J., Cheek, J.: Introducing qualitatively-driven mixed-method designs. Qual. Health Res. 25(6), 731–733 (2015). https://doi.org/10.1177/1049732315583299
Morse, J.M., Niehaus, L.: Mixed Method Design: Principles and Procedures. Left Coast Press, Walnut Creek (2009)
Newman, I., Onwuegbuzie, A.J., Hitchcock, J.H.: Using the general lineal model to facilitate the full integration of qualitative and quantitative analysis: the potential to improve prediction ad theory building and testing. Gen. Linear Model J. 4(1), 12–28 (2015)
Nigras, K.: Spreadsheet software can facilitate mixed methods research—using old tools in a new context! J. Mix. Methods Res. 1(3), 297–299 (2007). https://doi.org/10.1177/1558689807301250
Onwuegbuzie, A.J., Hitchcock, J.H.: Advanced mixed analysis approaches. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 275–295. Oxford University Press, Oxford (2015)
Onwuegbuzie, A.J., Slate, J.R., Leech, N.L., Collins, K.M.T.: Conducting mixed analyses: a general typology. Int. J. Mult. Res. Approach. 1, 4–17 (2007). https://doi.org/10.5172/mra.455.1.1.4
Onwuegbuzie, A.J., Johnson, R.B., Collins, K.M.T.: Assessing legitimation in mixed research: a new framework. Qual. Quant. 45, 1253–1271 (2011)
Onwuegbuzie, A.J., Frels, R.K., Collins, K.M.T., Leech, N.L.: Conclusion: a four phase model for teaching and learning mixed research. Int. J. Mult. Res. Approach. 7(1), 133–156 (2013)
Plano Clark, V.L., Badiee, M.: Research questions in mixed methods research. In: Tashakkori, A., Teddie, C. (eds.) Sage Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn, pp. 275–304. Sage, Thousand Oaks (2010)
Plano Clark, V.L., Ivankova, N.V.: Mixed Methods Research: A Practical Guide to the Field. Sage, Thousand Oaks (2016)
Portell, M., Anguera, M.T., Chacón-Moscoso, S., Sanduvete, S.: Guidelines for reporting evaluations based on observational methodology. Psicothema 27, 283–289 (2015a). https://doi.org/10.7334/psicothema2014.276
Portell, M., Anguera, M.T., Hernández-Mendo, A., Jonsson, G.K.: Quantifying biopsychosocial aspects in everyday contexts: an integrative methodological approach from the behavioral sciences. Psychol. Res. Behav. Manag. 8, 153–160 (2015b). https://doi.org/10.2147/PRBM.S82417
Salmons, J.E.: Conducting multimethod and mixed methods research online. In: Hesse-Biber, S.N., Johnson, R.B. (eds.) The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry, pp. 522–547. Oxford University Press, Oxford (2015)
Sánchez-Algarra, P., Anguera, M.T.: Qualitative/quantitative integration in the inductive observational study of interactive behaviour: impact of recording and coding among predominating perspectives. Qual. Quant. 47(2), 1237–1257 (2013). https://doi.org/10.1007/s11135-012-9764-6
Sandelowski, M.: Tables or tableaux? Writing and reading mixed methods studies. In: Tashakkori, A., Teddie, C. (eds.) Handbook of Mixed Methods in Social & Behavioral Research, pp. 321–350. Sage, Thousand Oaks (2003)
Sandelowski, M.: Metasynthesis of qualitative research. In: Cooper, H. (ed.) APA Handbook of Research Methods in Psychology: Vol. 2. Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological, pp. 19–36. American Psychological Association, Washington, DC (2012)
Sandelowski, M.: Unmixing mixed-methods research. Res. Nurs. Health 37, 3–8 (2014). https://doi.org/10.1002/nur.21570
Sandelowski, M., Barroso, J.: Handbook for Synthesizing Qualitative Research. Springer, New York (2007)
Sandelowski, M., Voils, C.I., Knafl, G.: On quantitizing. J. Mix. Methods Res. 3, 208–222 (2009). https://doi.org/10.1177/1558689809334210
Sandelowski, M., Voils, C., Leeman, J., Crandell, J.: Map** the mixed methods research synthesis terrain. J. Mix. Methods Res. 6, 317–331 (2012). https://doi.org/10.1177/1558689811427913
Sandelowski, M., Leeman, J., Knafl, K., Crandell, J.: Text-in-context: a method for extracting findings in mixed-methods mixed research synthesis studies. J. Adv. Nurs. 69, 1428–1437 (2013a). https://doi.org/10.1111/jan.12000
Sandelowski, M., Voils, C.I., Crandell, J., Leeman, J.: Synthesizing qualitative and quantitative research findings. In: Beck, C.T. (ed.) Routledge International Handbook of Qualitative Nursing Research, pp. 347–356. Routledge, New York (2013b)
Sorensen, A.: Use of QSR NVivo 7 qualitative analysis software for mixed methods research. J. Mix. Methods Res. 2(1), 106–110 (2008). https://doi.org/10.1177/1558689807309082
Stange, K.C., Crabtree, B.F., Miller, W.L.: Publishing multimethod research. Ann. Fam. Med. 4, 292–294 (2006). https://doi.org/10.1370/afm.615
Strauss, A., Corbin, J.: Grounded theory methodology. In: Denzin, N.K., Lincoln, Y.S. (eds.) Handbook of Qualitative Research, pp. 273–285. Sage, Thousand Oaks (1994)
Tashakkori, A., Teddie, C.: Mixed Methodology: Combining Qualitative and Quantitative Approaches. Sage, Thousand Oaks (1998)
Tashakkori, A., Teddie, C.: Handbook of Mixed Methods in the Behavioral and Social Sciences. Sage, Thousand Oaks (2003)
Tashakkori, A., Teddie, C.: Putting the human back in “Human Research Methodology”: the researcher in mixed methods research. J. Mix. Methods Res. 4(4), 271–277 (2010a). https://doi.org/10.1177/1558689810382532
Tashakkori, A., Teddie, C. (eds.): The Sage Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn. Sage, Thousand Oaks (2010b)
Teddie, C., Tashakkori, A.: A general typology of research designs featuring mixed methods. Res. Sch. 13(1), 12–28 (2006)
Teddie, C., Tashakkori, A.: Foundations of Mixed Methods: Integrating Quantitative and Qualitative Approaches in the Social & Behavioral Sciences. Sage, Thousand Oaks (2009)
Teddie, C., Tashakkori, A.: Overview of contemporary issues in mixed methods research. In: Tashakkori, A., Teddie, C. (eds.) The Sage Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn, pp. 1–41. Sage, Thousand Oaks (2010)
Webb, E.T., Campbell, D.T., Schwartz, R.D., Sechrest, L., Grove, J.B.: Nonreactive Measures in the Social Sciences. Houghton Mifflin, Boston (1966)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Anguera, M.T., Blanco-Villaseñor, A., Losada, J.L. et al. Revisiting the difference between mixed methods and multimethods: Is it all in the name?. Qual Quant 52, 2757–2770 (2018). https://doi.org/10.1007/s11135-018-0700-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-018-0700-2