Log in

Measuring Partial Democracies: Rules and their Implementation

  • Original Research
  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

This paper proposes a new index that focuses on capturing the extent of democracy in a country using not only the existence of rules but also the extent of their implementation. The measure, based on the axiomatically robust framework of (Alkire and Foster, J Public Econ 95:476–487, 2011), is able to moderate the existence of democratic rules by their actual implementation. By doing this we have a meaningful way of capturing the notion of a partial democracy within a continuum between non-democratic and democratic, separating out situations when the rules exist but are not implemented well. We construct our index using V-Dem data from 1900 to 2010 for over 100 countries to measure the process of democratization across the world. Our results show that we can track the progress in democratization, even when the regime remains either a democracy or an autarchy. This is the notion of partial democracy that our implementation-based index measures through a wide-based index that is consistent, replicable, extendable, easy to interpret, and more nuanced in its ability to capture the essence of democracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. Refer to https://freedomhouse.org/report/freedom-world/2019/democracy-retreat, last accessed on 23rd November 2021. Also see House (2017).

  2. An alternative definition of democracy has focused on the existence of political elite. (Bollen, 1980) Lipset (1959) also argues that the construct should include more social requisites, though some of these may be categorized as outcomes of democracies as well. The Lipset hypothesis formed the basis of the theory of modernization which associates economic growth with democratic transitions of economies.

  3. The partial aspect of democracy that the measure captures is still coming from objective data. As with any new concept, when we become more comfortable with the basic idea of partial democracies, then rather than just using objective indicators we could also conduct surveys which would enable researchers to use perception-based indicators of implementation. The theoretical framework of the index proposed in the paper is agnostic towards what type of data is used in the particular context.

  4. The next segment of the paper discusses the existing measures and some of their inherent limitations.

  5. There have been various studies that have compared measures of democracy. See Giebler, Ruth and Tanneberg (2018) and Skaaning (2018).

  6. According to Decancq and Lugo (2013) the drawbacks of using statistical methods include difficulty in interpreting results and a lack of transparency in a latent variable model. Secondly, such an empirical analysis relies on correlations between dimensions but as Nardo et al. (2005) points out correlations do not necessarily represent the real influence of the indicators on the variable of interest. This does not imply that empirical techniques should not be used at all. They are extremely useful in reducing the number of indicators and guiding choices of indicators to put into the index. This must always be done in conjunction with a theoretical measurement framework. Alkire (2013) asks for caution in using empirical methods to choose dimensions in multidimensional analysis, “For this reason the empirical approach should be used to provide informative support to participatory methods and deliberations, but should not constitute the sole basis for selecting dimensions.”.

  7. The authors of the index recognize this as a possible drawback of their measure.

  8. However, depending on the priorities of the analysis being conducted, the weights can be modified to give preference to the selected dimensions or indicators.

  9. The dimensions are equally weighted (in this case, since there are 5 dimensions, it implies that each dimension has a weight of 1/5). Within each dimension, there are several sub-dimensions that are equally weighted within the dimension (say we have k sub-dimensions for a particular dimension, then each sub-dimension has 1/k weight). Therefore, the effective nested weight of the kth sub-dimension is 1\5 k. If there are say p indicators that are combined to get the rule part of the kth sub-dimension, then those p indicators each get 1/p weight and together add up for the rule part of the kth sub-dimension. Then if the implementation part of this sub-dimension has q indicators, then all get 1/q weight and are added up to get the implementation score of this sub-dimension. The rule and implementation together give the sub-dimension score which in the nested structure here has the 1/5 k weight.

  10. However, the cut-offs used are for illustrative purposes only and can be varied depending on the purpose of the analysis and the context in which it is being applied.

  11. Most of the studies on conflict use data from either the Correlates of War (CoW) project or from the Uppsala / PRIO dataset. The CoW dataset covers data for the period from 1930 to 2003. However, it only covers conflicts where there are more than 1000 battle deaths per year. Hence use of this dataset has been critiqued as it leaves out conflicts in many smaller countries / regions. The UCDP (Uppsala Conflict Data Program) / PRIO data covers data from the period 1946 to 2008. The UCDP / PRIO dataset from 1989 onwards includes data for conflicts where there are more than 25 battle deaths / year in addition to the 1000 battle deaths / year norm. From 2002-03 onwards, it also covers data on non-state conflict and one-sided violence.

References

  • Alkire, S. (2013). Choosing dimensions: The capability approach and multidimensional poverty. The many dimensions of poverty (pp. 89–119). London: Palgrave Macmillan.

    Chapter  Google Scholar 

  • Alkire, S., & Foster, J. (2011). Counting and multidimensional poverty measurement. Journal of Public Economics, 95(7–8), 476–487.

    Article  Google Scholar 

  • Alvarez, M., Cheibub, J. A., Limongi, F., & Przeworski, A. (1996a). Classifying political regimes. Studies in Comparative International Development, 31(2), 3–36.

    Article  Google Scholar 

  • Alvarez, M., Cheibub, J. A., Limongi, F., & Przeworski, A. (1996b). What makes democracies endures? Journal of Democracy, 7(1), 39–55.

    Article  Google Scholar 

  • Ananta, A., Arifin, E. N., & Suryadinata, L. (2005). Emerging democracy in Indonesia. Singapore: ISEAS Publishing.

    Book  Google Scholar 

  • Bailey, N. (2018). Exploring the relationship between institutional factors and FDI attractiveness: A meta-analytic review. International Business Review, 27(1), 139–148.

    Article  Google Scholar 

  • Beetham, D. (1999). Democracy and human rights (Vol. 249). England: Polity Press Cambridge.

    Google Scholar 

  • Berman, B., Eyoh, D., & Kymlicka, W. (Eds.). (2004). Ethnicity and democracy in Africa. Athens: Ohio University Press.

    Google Scholar 

  • Boese, V. A. (2019). How (not) to measure democracy. International Area Studies Review, 22(2), 95–127.

    Article  Google Scholar 

  • Bogaards, M. (2009). How to classify hybrid regimes? Defective democracy and electoral authoritarianism. Democratization, 16(2), 399–423.

    Article  Google Scholar 

  • Bollen, K. A. (1980). Issues in the comparative measurement of political democracy. American Sociological Review, 45(3), 370–390.

    Article  Google Scholar 

  • Brecke, P. (2001). The long-term patterns of violent conflict in different regions of the world. In Uppsala conflict data conference, Uppsala, Sweden.

  • Bremer, S. A. (1993). Democracy and militarized interstate conflict, 1816–1965. International Interactions, 18(3), 231–249.

    Article  Google Scholar 

  • Bush, S. S. (2017). The politics of rating freedom: Ideological affinity, private authority, and the Freedom in the World ratings. Perspectives on Politics, 15(3), 711–731.

    Article  Google Scholar 

  • Collier, S., Sater, W. F., & William, F., III. (2004). A history of Chile, 1808–2002 (Vol. 82). England: Cambridge University Press.

    Book  Google Scholar 

  • Coppedge, M., Gerring, J., Lindberg, S. I., Skaaning, S. E., Teorell, J., Altman, D., & Wilson, S. L. (2017). V-dem dataset v7. Available at: https://www.v-dem.net/en/data/data-version-7–1/.

  • Coppedge, M., Lindberg, S., Skaaning, S. E., & Teorell, J. (2016). Measuring high level democratic principles using the V-Dem data. International Political Science Review, 37(5), 580–593.

    Article  Google Scholar 

  • Croissant, A., & Merkel, W. (2004). Introduction: Democratization in the early twenty-first century. Democratization, 11(5), 1–9.

    Article  Google Scholar 

  • Dahl, R. A. (1956). A Preface to Democratic Theory. Chicago: University of Chicago Press.

    Google Scholar 

  • Dahl, R. A. (1971). Polyarchy: Participation and Opposition. London: Yale University Press.

    Google Scholar 

  • Decancq, K., & Lugo, M. A. (2013). Weights in multidimensional indices of wellbeing: An overview. Econometric Reviews, 32(1), 7–34.

    Article  Google Scholar 

  • Diamond, L. (1999). Develo** democracy: Toward consolidation. Baltimore: JHU Press.

    Book  Google Scholar 

  • Dixon, W. J. (1994). Democracy and the peaceful settlement of international conflict. The American Political Science Review, 88(1), 14–32.

    Article  Google Scholar 

  • Elkins, Z. (2000). Gradations of democracy? empirical tests of alternative conceptualizations. American Journal of Political Science, 44(2), 293–300.

    Article  Google Scholar 

  • Epstein, D. L., Bates, R., Goldstone, J., Kristensen, I., & O’Halloran, S. (2006). Democratic transitions. American Journal of Political Science, 50(3), 551–569.

    Article  Google Scholar 

  • Fatton, R. (1990). Liberal democracy in Africa. Political Science Quarterly, 105(3), 455–473.

    Article  Google Scholar 

  • Feith, H. (2006). The decline of constitutional democracy in Indonesia. Sheffield: Equinox Publishing.

    Google Scholar 

  • Giannone, D. (2010). Political and ideological aspects in the measurement of democracy: The Freedom House case. Democratization, 17(1), 68–97.

    Article  Google Scholar 

  • Gibler, D. M. (2007). Bordering on peace: Democracy, territorial issues, and conflict. Inter-National Studies Quarterly, 51(3), 509–532.

    Article  Google Scholar 

  • Giebler, H., Ruth, S. P., & Tanneberg, D. (2018). Why Choice Matters: Revisiting and Comparing Measures of Democracy. Politics and Governance, 6(1), 1–10.

    Article  Google Scholar 

  • Goertz, G. (2006). Social science concepts: A user’s guide. Princeton: Princeton University Press.

    Book  Google Scholar 

  • Goertzel, T. G. (1999). Fernando Henrique Cardoso: Reinventing democracy in Brazil. Boulder: Lynne Rienner Publishers.

    Google Scholar 

  • Haber, S., & Menaldo, V. (2011). Do natural resources fuel authoritarianism? a reappraisal of the resource curse. The American Political Science Review, 105(1), 1–26.

    Article  Google Scholar 

  • Hadenius, A., & Teorell, J. (2005). Assessing alternative indices of democracy. Sweden: Lund University.

    Google Scholar 

  • House, F. (2017). Freedom in the world 2016: Anxious dictators, wavering democracies: Global freedom under pressure. Available at: https://freedomhouse.org/sites/default/files/FH_FITW_Report_2016.pdf.

  • House, F. (2019). Freedom in the World 2019.

  • Inglehart, R., & Christian, W. (2005). Modernization, cultural change and democracy: The human development sequence. England: Cambridge University Press.

    Google Scholar 

  • Ketteni, E., & Kottaridi, C. (2019). The impact of regulations on the FDI-growth nexus within the institution-based view: A nonlinear specification with varying coefficients. International Business Review, 28(3), 415–427.

    Article  Google Scholar 

  • Knutsen, C. H. (2010). Measuring effective democracy. International Political Science Review, 31(2), 109–128.

    Article  Google Scholar 

  • Leib, E., & He, B. (Eds.). (2006). The search for deliberative democracy in China. Berlin: Springer.

    Google Scholar 

  • Lindberg, S. I., Coppedge, M., & Gerring, J. (2014). V-dem: A new way to measure democracy. Journal of Democracy, 25(3), 159–169.

    Article  Google Scholar 

  • Lipset, S. M. (1959). Some social requisites of democracy: Economic development and political legitimacy. The American Political Science Review, 53(1), 69–105.

    Article  Google Scholar 

  • Marshall, MG, Gurr, TR, Jaggers, K (2017) Polity IV project: Political regime characteristics and transitions, 1800–2016. Available at http://www.systemicpeace.org/inscrdata.html.

  • Matos, C. (2008). Journalism and political democracy in Brazil. Lanham: Lexington Books.

    Google Scholar 

  • Merkel, W. (2004). Embedded and defective democracies. Democratization, 11(5), 33–58.

    Article  Google Scholar 

  • Merkel, W., & Croissant, A. (2000). Formale und informale Institutionen in defekten Demokratien. Politische Vierteljahresschrift, 41(1), 3–30.

    Article  Google Scholar 

  • Mitra, S. (2013). Towards a multidimensional measure of governance. Social Indicators Research, 112(2), 477–496.

    Article  Google Scholar 

  • Moon, B. E., Birdsall, J. H., Ciesluk, S., Garlett, L. M., Hermias, J. J., Mendenhall, E., & Wong, W. H. (2006). Voting counts: Participation in the measurement of democracy. Studies in Comparative International Development, 41(2), 3–32.

    Article  Google Scholar 

  • Munck, G. L., & Verkuilen, J. (2002). Conceptualizing and measuring democracy: Evaluating alternative indices. Comparative Political Studies, 35(1), 5–34.

    Google Scholar 

  • Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffmann, A., & Giovannini, E. (2005). Handbook on constructing composite indicators: Methodology and user guide. France: OECD Publications.

    Google Scholar 

  • Ogden, S. (2002). Inklings of democracy in China (Vol. 210). Cambridge: Harvard Univ Asia Center.

    Book  Google Scholar 

  • Przeworski, A., Alvarez, R. M., Alvarez, M. E., Cheibub, J. A., Limongi, F., & Neto, F. P. L. (2000). Democracy and development: Political institutions and well-being in the world 1950–1990 (No. 3). England: Cambridge University Press.

    Book  Google Scholar 

  • Przeworski, A., & Limongi, F. (1997). Modernization: Theories and facts. World Politics, 49(2), 155–183.

    Article  Google Scholar 

  • Rector, J. L. (2019). The history of Chile. Santa Barbara: ABC-CLIO.

    Google Scholar 

  • Robinson, K. (2008). Gender. Routledge, England: Islam and democracy in Indonesia.

    Google Scholar 

  • Rodrik, D. (1998). Globalisation, Social Conflict and Economic Growth. The World Economy, 21(2), 143–158.

    Article  Google Scholar 

  • Schmidt, M. G. (2002). Political performance and types of democracy: Findings from comparative studies. European Journal of Political Research, 41(1), 147–163.

    Article  Google Scholar 

  • Schumpeter, J. A. (1976). II. Capitalism, socialism, and democracy, 1942.

  • Thornton, J. L. (2008). Long time coming the prospects for democracy in china. Foreign Affairs, 87(1), 2–22.

    Google Scholar 

  • Treier, S., & Jackman, S. (2008). Democracy as a latent variable. American Journal of Political Science, 52(1), 201–217.

    Article  Google Scholar 

  • Vaccaro, A. (2021). Comparing measures of democracy: Statistical properties, convergence, and interchangeability. European Political Science, 20(4), 666–684.

    Article  Google Scholar 

  • Vanhanen, T. (2000). A new dataset for measuring democracy, 1810–1998. Journal of Peace Research, 37(2), 251–265.

    Article  Google Scholar 

  • Zakaria, F. (1997). The rise of illiberal democracy. Foreign Affairs, 76, 22.

    Article  Google Scholar 

  • Zhang, J. (2008). Marketization and democracy in China. England: Routledge.

    Book  Google Scholar 

Download references

Acknowlegement

We are grateful to Tonmoy Islam for helpful comments and suggestions. Mitra would like to acknowledge the support of the Research Council of Norway grant no. 217995/V10. All remaining errors are solely ours.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shabana Mitra.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

See Tables 2 and 3.

Table 2 Indicators comprising Dimensions for the Index of Democracy
Table 3 Overall Ranking of Countries basis Depth of Democracy

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Basu, D., Mitra, S. & Purohit, A. Measuring Partial Democracies: Rules and their Implementation. Soc Indic Res 166, 133–155 (2023). https://doi.org/10.1007/s11205-022-03055-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-022-03055-9

Keywords

JEL Classification

Navigation