Abstract
Sewage treatment plants are essential in improving the quality of receiving water bodies, contributing to healthy and sustainable urban development. The increasingly common public-private partnership (PPP) model of sewage treatment facilities may not yield the expected benefits, often compromised by inadequacies in the complex operation-maintenance stage. Holistic criteria and methods to define and judge a plant’s performance are lacking. To fill the knowledge gap, this study established a performance evaluation system applicable to the critical operation-maintenance stage of China’s PPP sewage-treatment industry. First, the range of quantitative and qualitative indicators was surveyed by literature review, and an appropriate subset was selected according to expert judgment. Second, the multilevel extension principle of matter-element analysis was combined with the analytic hierarchy process to determine the performance level and establish a comprehensive, efficient and practical evaluation system. The proposed method was tested on two PPP plants to confirm its applicability and reliability in assessing operation-maintenance functions. The study identified the diagnostic criteria to refine the design, operation and maintenance parameters to optimize plant performance. The findings provided an assured and comprehensive quality control scheme and a practical tool for governments and other parties to assess the service delivery quality of PPP plants.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agarwal S, Singh AP (2022) Performance evaluation of textile wastewater treatment techniques using sustainability index: An integrated fuzzy approach of assessment. Journal of Cleaner Production 337:130384, DOI: https://doi.org/10.1016/j.jclepro.2022.130384
Ahmed I, Ofori-Amanfo D, Awuah E, Cobbold F (2018) Performance assessment of the rehabilitated mudor sewage treatment plant at james town accra-ghana. Journal of Water Resource & Protection 10(8):725–739, DOI: https://doi.org/10.4236/jwarp.2018.108041
Ahn J, Moon H, Shin J, Ryu J (2020) Social benefits of improving water infrastructure in South Korea: Upgrading sewage treatment plants. Environmental Science and Pollution Research 27(10):11202–11212, DOI: https://doi.org/10.1007/s11356-020-07733-4
Aishwarya JM, Nilavunesan D, Baskaralingam P, Sivanesan S (2016) Performance evaluation of sewage treatment plant at a residential building. International Journal of Environment and Sustainable Development 15(3):326–336, DOI: https://doi.org/10.1504/IJESD.2016.077389
Alnashiri HM (2021) Assessment of physicochemical parameters and heavy metal concentration in the effluents of sewage treatment plants in Jazan Region, Saudi Arabia. Journal of King Saud University-Science 33(8):101600, DOI: https://doi.org/10.1016/j.jksus.2021.101600
Alver A (2019) Evaluation of conventional drinking water treatment plant efficiency according to water quality index and health risk assessment. Environmental Science and Pollution Research 26(26):27225–27238, DOI: https://doi.org/10.1007/s11356-019-05801-y
Ananda J (2020) Assessing the operational efficiency of wastewater services whilst accounting for data uncertainty and service quality: A semi-parametric approach. Water International 45(7–8):921–944, DOI: https://doi.org/10.1080/02508060.2020.1786650
Ayyildiz E, Yildiz A, Gumus AT, Ozkan C (2020) An integrated methodology using extended SWARA and DEA for the performance analysis of wastewater treatment plants: Turkey case. Environmental Management 67(3):1–19, DOI: https://doi.org/10.1007/s00267-020-01381-7
Bae DS, Damnjanoic I, Kang DH (2019) PPP renegotiation framework based on equivalent NPV constraint in the case of BOT project: Incheon Airport highway, South Korea. KSCE Journal of Civil Engineering 23(4):1473–1483, DOI: https://doi.org/10.1007/s12205-019-1444-9
Bao F, Chen C, Chan AP, Martek I, Shrestha A (2019) Dynamic framework transfer model for public-private partnerships: Lessons from a China water sector case study. Engineering, Construction and Architectural Management 26(7):1218–1239, DOI: https://doi.org/10.1108/ECAM-01-2018-0028
Benbachir M, Chenaf D, Cherrared M (2021) Managing sewerage networks using both failure modes, effects and criticality analysis (FMECA) and analytic hierarchy process (AHP) methods. Canadian Journal of Civil Engineering 48(12):1683–1693, DOI: https://doi.org/10.1139/cjce-2020-0287
Bhave PP, Naik S, Salunkhe SD (2020) Performance evaluation of wastewater treatment plant. Water Conservation Science and Engineering 5(1):23–29, DOI: https://doi.org/10.1007/s41101-020-00081-x
Bhushan N (2018) Digital learning transformation: A strategic framework using the analytic hierarchy process. In Proceedings of the Future of Learning Conference, FOL 2018, Indian Institute of Management, January 15–17, 2018. Bangalore, India, 11 pp, Available at SSRN: https://ssrn.com/abstract=3112050
Cai W (1987) Matter element analysis. Guangdong Higher Education Press, Guangzhou, China
Chan AP, Lam PT, Chan DW, Cheung E, Ke Y (2010) Critical success factors for PPP in infrastructure developments: Chinese perspective. Journal of Construction Engineering and Management 136(5):484–494, DOI: https://doi.org/10.1061/(ASCE)CO.1943-7862.0000152
Chen LA, Wang JQ, Hou HX (2013) Research on the operation performance evaluation of sewage treatment plants based on projection pursuit. China Water & Wastewater 29(19):7, DOI: https://doi.org/10.19853/j.zgjsps.1000-4602.2013.19.033
Cruz CM, Marqus RC (2013) Infrastructure public-private partnerships: Decision, management and development. Springer, New York
Dantas MS, Barroso GR, Oliveira SC (2021) Performance of sewage treatment plants and impact of effluent discharge on receiving water quality within an urbanized area. Environmental Monitoring and Assessment 193(5):289, DOI: https://doi.org/10.1007/s10661-021-09075-1
Deng X, Li JM, Zeng HJ, Chen JY, Zhao JF (2012) Analysis of analytic hierarchy process weight calculation method and its application research. Mathematics in Practice and Knowledge 24(7):8, DOI: https://doi.org/10.3969/j.issn.1000-0984.2012.07.012
Engstler E, Kerschbaumer DJ, Langergraber G (2022) Evaluating the performance of small wastewater treatment plants. Frontiers in Environmental Science 10:948366, DOI: https://doi.org/10.3389/fenvs.2022.948366
El-Kholy AM, Akal AY (2020) Assessing and allocating the financial viability risk factors in public-private partnership wastewater treatment plant projects. Engineering, Construction and Architectural Management 28(10):3014–3040, DOI: https://doi.org/10.1108/ECAM-05-2020-0373
Fallahiarezoudar E, Ahmadipourroudposht M, Yakideh K, Ngadiman NA (2022) An eco-environmental efficiency analysis of Malaysia sewage treatment plants: An incorporated window-based data envelopment analysis and ordinary least square regression. Environmental Science and Pollution Research 29:38285–38302, DOI: https://doi.org/10.1007/s11356-022-18742-w
Fanaei SS, Moselhi O, Alkass ST (2019) Performance prediction of construction projects using soft computing methods. Canadian Journal of Civil Engineering 46(7):609–620, DOI: https://doi.org/10.1139/cjce-2018-0305
Fang JH, Wang H, Qiu ZL (2016) Research and application of the performance evaluation system of small town sewage treatment plants based on AHP-grap. Environmental Protection and Circular Economy 36(2):7, DOI: https://doi.org/10.3969/j.issn.1674-1021.2016.02.013
Feng X, Zhu Y (2019) Research on cost control of sewage treatment plant project based on the theory of life cycle. Engineering Economics 29(03):36–39, DOI: https://doi.org/10.19298/j.cnki.1672-2442.201903036
Figueiredo A, Nascimento B, Marujo D, Oliveira D, Portelinha FM (2021) Energy from waste: A case study of the energy production estimative from biogas at the sewage treatment plant in Itajubá, Minas Gerais, Brazil. In: Tripathi, S.M., Sanjeevikumar, P. (eds.) Energy conversion systems: An overview. NOVA Science Publishers, Hauppauge, NY
Ganesan J, Namasivayam V (2015) Performance evaluation of sewage treatment plants (STPs) in multistoried buildings. Nature Environment & Pollution Technology 14(4):891–896, Available at http://www.neptjournal.com/upload-images/NL-54-25-(23)B-3145.pdf
Gonzalez-Ruiz JD, Arboleda A, Botero S, Rojo J (2019) Investment valuation model for sustainable infrastructure systems: Mezzanine debt for water projects. Engineering, Construction and Architectural Management 26(5):850–884, DOI: https://doi.org/10.1108/ecam-03-2018-0095
Guo Y, Guan HY, Chen YC (2015) Analysis of the characteristics and countermeasures of the construction of sewage treatment plants in small cities and towns in the southwestern minority areas: Taking Jiang** district, Chongqing city as an example. Heilongjiang Nationalities Series 3:5, DOI: CNKI:SUN:HLMZ.0.2015-03-012
Herrera-Navarrete R, Colín-Cruz A, Arellano-Wences HJ, Sampedro-Rosas ML, Rosas-Acevedo JL, Rodríguez-Herrera AL (2021) Municipal wastewater treatment plants: Gap, challenges, and opportunities in environmental management. Environmental Management 69(1):75–81, DOI: https://doi.org/10.1007/s00267-021-01562-y
Janna H (2016) Characterization of raw sewage and performance evaluation of Al-Diwaniyah sewage treatment work, Iraq. World Journal of Engineering & Technology 4(2):296–304, DOI: https://doi.org/10.4236/wjet.2016.42030
Karuppiah K, Sankaranarayanan B, Ali SM (2022) A novel quality function deployment based integrated framework for improving supply chain sustainability. Engineering Management Journal 34, DOI: https://doi.org/10.1080/10429247.2022.2097575
Keivanpour S (2021) Sustainability balanced scorecard approach to Internet of Things enabled logistics systems. Engineering Management Journal 34(3):450–474, DOI: https://doi.org/10.1080/10429247.2021.1946320
Kotagama H, Ahmed M, Al-Haddabi M (2016) Cost evaluation of desalination and sewage treatment based on plants operated in Oman and use of software models. Desalination and Water Treatment 57(19):8649–8656, DOI: https://doi.org/10.1080/19443994.2015.1027274
Lan F (2016) Research on the technology enterprise performance evaluation index system. iBusiness 5(3):6–9, DOI: https://doi.org/10.4236/ib.2013.53B002
Li MZ (2014) Review of foreign PPP development trends. Construction Economy 1:4, DOI: CNKI:SUN:JZJJ.0.2014-01-001
Li Q, Wang F, Yu, Y, Huang Z, Li M, Guan Y (2019) Comprehensive performance evaluation of LID practices for the sponge city construction: A case study in Guangxi, China. Journal of Environmental Management 231:10–20, DOI: https://doi.org/10.1016/j.jenvman.2018.10.024
Li Y, Zhang XY, Zhang Y, Lai LY, Chen C (2021) Research on construction and evaluation method of comprehensive evaluation index system for investment benefit of distribution network. 5 th International Workshop on Advances in Energy Science and Environmental Engineering, April 9–11, 2021, E3S Web of Conferences, 257:02063, DOI: https://doi.org/10.1051/e3sconf/202125702063
Li YH, Zhu XQ (2014) Application of BMK in operation performance evaluation system of sewage treatment plant. Guangzhou Chemical Industry 2014(15):178–179, DOI: https://doi.org/10.3969/j.issn.1001-9677.2014.15.064
Liu J, Hua Z, Pang Y, Wang X (2022) Risk sharing for PPP project in construction waste recycling industry in China. Environmental Science and Pollution Research 29(9):12614–12628, DOI: https://doi.org/10.1007/s11356-021-15816-z
Liu J, Lai JY, Sun XD (2015) Construction project management performance evaluation model based on matter-element analysis. Journal of Engineering Management 29(1):5, DOI: https://doi.org/10.13991/j.cnki.jem.2015.01.024
Liu F, Li J (2018) Study on the influencing factors of PAM dosage for sludge dewatering in municipal sewage treatment. IOP Conference Series: Earth and Environmental Science 170(3):032010, DOI: https://doi.org/10.1088/1755-1315/170/3/032010
Liu B, Shen JQ, Meng ZJ, Sun FH (2018) A survey on the establishment and application of social capital partner selection system for the new profit PPP project. KSCE Journal of Civil Engineering 22(10):3726–3737, DOI: https://doi.org/10.1007/s12205-018-0489-5
Łój-Pilch M, Zakrzewska A (2019) Analysis of risk assessment in a municipal wastewater treatment plant located in Upper Silesia. Water 12(1):23, DOI: https://doi.org/10.3390/w12010023
Long JY, Chuan C, Yan TT, Yan ZJ, Zhang MQ (2019) Research on performance evaluation in PPPs in sewage treatment. IOP Conference Series: Earth and Environmental Science 267(4):42016–42016, DOI: https://doi.org/10.1088/1755-1315/267/4/042016
Lu W, Du L, Feng Y (2022) Decision making behaviours and management mechanisms for construction and demolition waste recycling based on public-private partnership. Environmental Science and Pollution Research 29(54):82078–82097, DOI: https://doi.org/10.1007/s11356-022-21221-x
Luo Y, Zhao SL, Li XC, Han YH, Ding YF (2016) Text keyword extraction method based on word frequency statistics. Journal Computer Applications 36(3):718–725, DOI: https://doi.org/10.11772/j.issn.1001-9081.2016.03.718
Mai YZ, **ao W, Shi L (2015) Evaluation of operation efficiency of urban sewage treatment plants in China. Environmental Science Research 28(11):1789–1796, DOI: https://doi.org/10.13198/j.issn.1001-6929.2015.11.18
Majidipour F, Najafi SMB, Taheri K, Fathollahi J, Missimer TM (2021) Index-based groundwater sustainability assessment in the socioeconomic context: A case study in the western Iran. Environmental Management 67(4):648–666, DOI: https://doi.org/10.1007/s00267-021-01424-7
Mali GD, Saler PS, Mali DS (2020) Performance evaluation of a sewage treatment plant STP: A critical review. Journal of Trend in Scientific Research and Development 4(4):700–702, Available at www.ijtsrd.com/papers/ijtsrd31155.pdf
Mayer F, Bhandari R, Gäth SA (2021) Life cycle assessment of prospective sewage sludge treatment paths in Germany. Journal of Environmental Management 290(112557, DOI: https://doi.org/10.1016/j.jenvman.2021.112557
Meng FY, Fan QX, Ji N, Liang S (2012) Research on the construction and application of comprehensive evaluation index system for municipal wastewater treatment plants. Environment and Sustainable Development 37(2):7, DOI: https://doi.org/10.3969/j.issn.1673-288X.2012.02.016
Ministry of Housing and Urban-Rural Development of the People’s Republic of China (2014) CJJ/T228-2014: Evaluation standards for operation quality of urban sewage treatment plants. Bei**g, China
Morallos D, Amekudzi A, Ross C, Meyer M (2009) Value for money analysis in U.S. transportation public-private partnerships. Transportation Research Record: Journal of the Transportation Research Board 2115:27–36, DOI: https://doi.org/10.3141/2115-04
Pipi AR, Magdalena AG, Giafferis GP, Da Silva GH, Piacenti-Silva M (2018) Evaluation of metal removal efficiency and its influence in the physicochemical parameters at two sewage treatment plants. Environmental Monitoring and Assessment 190(5):263, DOI: https://doi.org/10.1007/s10661-018-6633-3
Rajpal A, Ali M, Choudhury M, Almohana AI, Alali AF, Munshi FMA, Khursheed A, Kazmi AA (2022) Abattoir wastewater treatment plants in India: Understanding and performance evaluation. Frontiers in Environmental Science 10:881623, DOI: https://doi.org/10.3389/fenvs.2022.881623
Selvam DDDP, Maitra S, Parthiban P, Hameed AZ (2021) Composite techniques of structural equation modeling and analytic hierarchy process for information technology vendor selection. International Journal of Information Technology and Decision Making 20(4): 1153–1187, DOI: https://doi.org/10.1142/s0219622021500346
Seo JM, Kim NH (2016) The comparative study on performance evaluations of social service delivery types. Journal of Digital Convergence 14(5):39–46, DOI: https://doi.org/10.14400/JDC.2016.14.5.39
Singh, ASK (2021) An overview of performance evaluation of sewage treatment plant. Journal of University of Shanghai for Science and Technology 23(4):306–316, DOI: https://doi.org/10.51201/JUSST/21/04238
Sun H, Wang Y, Liu S (2018) Allocation of residual control rights of a public-private partnership project based on 2-tuple linguistic model. KSCE Journal of Civil Engineering 22(11):4230–4239, DOI: https://doi.org/10.1007/s12205-017-0634-6
Surachman EN, Handayani D, Suhendra M, Prabowo S (2020) Critical success factors on PPP water project in a develo** country: Evidence from Indonesia. Journal of Asian Finance Economics and Business 7(10):1071–1080, DOI: https://doi.org/10.13106/jafeb.2020.vol7.no10.1071
Tang L, **ahou X, Li K, Li Q, Hu X (2022) Research on the relationship between flexible contract term setting method and setting effect of environmental protection PPP project. Engineering Management Journal 34, DOI: https://doi.org/10.1080/10429247.2022.2097493
Tariq S, Zhang X (2021) A critical analysis of water PPP failures in sub-Saharan Africa. Engineering, Construction and Architectural Management 29(8):3157–3180, DOI: https://doi.org/10.1108/ECAM-01-2021-0084
Tiruneh GG, Fayek AR (2021) Competency and performance measures for organizations in the construction industry. Canadian Journal of Civil Engineering 48(6):716–728, DOI: https://doi.org/10.1139/cjce-2019-0769
Tserng HP, Lin WS, Li CC, Weng KW, Loisel DC (2015) Research on the earned value management system applied in consultancy project performance. Journal of Marine Science and Technology 23(1):21–35, DOI: https://doi.org/10.6119/JMST-013-1224-1
Vinardell S, Astals S, Koch K, Mata-Alvarez J, Dosta J (2021) Co-digestion of sewage sludge and food waste in a wastewater treatment plant based on mainstream anaerobic membrane bioreactor technology: A techno-economic evaluation. Bioresource Technology 330:124978, DOI: https://doi.org/10.1016/j.biortech.2021.124978
Wang Y (2017) Project risk management based on analytic hierarchy process. Value Engineering 36(6):4, DOI: https://doi.org/10.14018/j.cnki.cn13-1085/n.2017.06.011
Wang JH, ** XX (2016) Contractual relationship between government and private enterprises under PPP model and its governance: A case study of urban infrastructure PPP in China. Economics and Management Research 37(3):62–68, DOI: https://doi.org/10.13502/j.cnki.issn1000-7636.2016.03.008
Wu T, Tang XJ, Zhao L (2015) Research on the construction of the emission reduction performance evaluation index system of urban domestic sewage treatment plants in Sichuan province. Environmental Science and Management 40(9):3, DOI: https://doi.org/10.3969/j.issn.1673-1212.2015.09.020
**ao Q, He R, Yu J (2018) Evaluation of taxi carpooling feasibility in different urban areas through the K-means matter-element analysis method. Technology in Society 53:135–143, DOI: https://doi.org/10.1016/j.techsoc.2018.01.008
Xu Z, Xu J (2022) Establishing an assessment index system for sewage treatment works in China. Engineering 19(12), DOI: https://doi.org/10.1016/j.eng.2022.07.009
Yadav D (2021) Performance evaluation of Baija Taal sewage treatment plant using moving bed biofilm reactor at Phoolbhaag Gwalior. International Journal for Research in Applied Science and Engineering Technology 9:92–97, DOI: https://doi.org/10.22214/ijraset.2021.32759
Yang T, Long R, Cui X, Zhu D, Chen H (2016) Application of the public-private partnership model to urban sewage treatment. Journal of Cleaner Production 142(2):1065–1074, DOI: https://doi.org/10.1016/j.jclepro.2016.04.152
Yazdian H, Shervin J (2021) Performance evaluation of wastewater treatment plants under the sewage variations imposed by COVID-19 spread prevention actions. Journal of Environmental Health Science & Engineering 19(2):1613–1621, DOI: https://doi.org/10.1007/s40201-021-00717-7
Ye XS, Qi HM (2015) Research on the key influencing factors of PPP project cooperation efficiency-based on the perspective of control rights. Project Management Technology 13(4):9–14, DOI: https://doi.org/10.3969/j.issn.1672-4313.2015.04.001
Yildiz A, Ayyildiz E, Gumus AT, Ozkan C (2020) A framework to prioritize the public expectations from water treatment plants based on trapezoidal type-2 fuzzy AHP method. Environmental Management 67(3):439–448, DOI: https://doi.org/10.1007/s00267-020-01367-5
You WJ, Xu ZS, Liu DL (2017) On the fire risk assessment of ancient buildings based on the matter-element analysis. Journal of Safety and Environment 17(3):6, DOI: CNKI:SUN:AQHJ.0.2017-03-015
Zhang YL, Cheng GW, Zhang L, Wei QQ, Duan SY, Wei JZ, Sun BZ, Yang X (2020) Evaluation of operation management of sewage treatment plants in Guangxi and analysis. IOP Conference Series: Earth and Environmental Science 510:042021, DOI: https://doi.org/10.1088/1755-1315/510/4/042021
Zhang Y, Ge T, Liu J, Sun Y, Liu Y, Zhao Q (2021) The comprehensive measurement method of energy conservation and emission reduction in the whole process of urban sewage treatment based on carbon emission. Environmental Science and Pollution Research 28(40):56727–56740, 2021-06-01, DOI: https://doi.org/10.1007/s11356-021-14472-7
Zhang WK, Yang YY, Wang YQ (2010) The key influencing factors of public-private partnership performance-based on the empirical research of several transitional countries. Journal of Public Management 7(3):103–112, DOI: CNKI:SUN:GGGL.0.2010-03-016
Zhang D, Yang S, Wang Z, Yang C, Chen Y (2020) Assessment of ecological environment impact in highway construction activities with improved group AHP-FCE approach in China. Environmental Monitoring and Assessment 192(7):451, DOI: https://doi.org/10.1007/s10661-020-08400-4
Acknowledgments
This work was supported by the Ministry of Housing and Construction of China under grant number 2021R046); and the Fujian Province Department of Science and Technology of China under grant number 2021R0028.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, X., Liu, Y., Li, M. et al. A Performance Evaluation System for PPP Sewage Treatment Plants at the Operation-maintenance Stage. KSCE J Civ Eng 27, 1423–1440 (2023). https://doi.org/10.1007/s12205-023-1729-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-023-1729-x