Log in

Estimating Individualized Treatment Regimes to Optimize Incremental Cost-Effectiveness Ratio

  • Original Paper
  • Published:
Statistics in Biosciences Aims and scope Submit manuscript

Abstract

Medical decision making can be challenging due to the trade-off between improving clinical efficacy and the associated medical costs. Evaluation of the incremental cost-effectiveness ratio (ICER) of different treatment programs is important for cost-effectiveness analysis. Individualized treatment regimes (ITRs) that consider patient heterogeneity can lead to varying health benefits and costs. To identify a promising ITR that balances efficacy and cost, the ICER criterion can be used to evaluate the quality of the ITR. We propose a method that considers both health benefits and costs to derive the the optimal ITR. We utilize Dinkelbach’s algorithm to transform a fractional program into a parametric program, which is easier to handle. We compare our method to ITRs that only optimize a single outcome (benefits or costs) through extensive simulation studies and show that our approach performs satisfactorily. To demonstrate the practical application of our method, we apply it to the Multicenter Automatic Defibrillator Implantation Trial with Cardiac Resynchronization Therapy (MADIT-CRT) study, a randomized trial. Our approach can help identify an optimal ITR that balances the trade-off between clinical efficacy and medical costs. Overall, our method provides a valuable tool for medical decision making that takes into account patient heterogeneity and cost-effectiveness analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Qian M, Murphy SA (2011) Performance guarantees for individualized treatment rules. Ann Stat 39(2):1180

    Article  MathSciNet  Google Scholar 

  2. Zhao Y, Zeng D, Rush AJ, Kosorok MR (2012) Estimating individualized treatment rules using outcome weighted learning. J Am Stat Assoc 107(499):1106–1118

    Article  MathSciNet  Google Scholar 

  3. Zhou X, Mayer-Hamblett N, Khan U, Kosorok MR (2017) Residual weighted learning for estimating individualized treatment rules. J Am Stat Assoc 112(517):169–187

    Article  MathSciNet  Google Scholar 

  4. Houede N, Thall PF, Nguyen H, Paoletti X, Kramar A (2010) Utility-based optimization of combination therapy using ordinal toxicity and efficacy in phase i/ii trials. Biometrics 66(2):532–540

    Article  MathSciNet  Google Scholar 

  5. Huang X, Xu J (2020) Estimating individualized treatment rules with risk constraint. Biometrics. https://doi.org/10.1111/biom.13232

    Article  MathSciNet  Google Scholar 

  6. Lee J, Thall PF, Ji Y, Müller P (2015) Bayesian dose-finding in two treatment cycles based on the joint utility of efficacy and toxicity. J Am Stat Assoc 110(510):711–722

    Article  MathSciNet  Google Scholar 

  7. Luckett DJ, Laber EB, Kosorok MR (2017) Estimation and optimization of composite outcomes. ar**v preprint ar**v:1711.10581

  8. Thall PF (2012) Bayesian adaptive dose-finding based on efficacy and toxicity. J Stat Res 46(2):187–202

    MathSciNet  Google Scholar 

  9. Lizotte DJ, Bowling M, Murphy SA (2012) Linear fitted-q iteration with multiple reward functions. J Mach Learn Res 13(1):3253–3295

    MathSciNet  Google Scholar 

  10. Laber EB, Lizotte DJ, Ferguson B (2014) Set-valued dynamic treatment regimes for competing outcomes. Biometrics 70(1):53–61

    Article  MathSciNet  Google Scholar 

  11. Wang Y, Fu H, Zeng D (2018) Learning optimal personalized treatment rules in consideration of benefit and risk: with an application to treating type 2 diabetes patients with insulin therapies. J Am Stat Assoc 113(521):1–13

    Article  MathSciNet  Google Scholar 

  12. Xu Y, Greene TH, Bress AP, Sauer BC, Bellows BK, Zhang Y, Weintraub WS, Moran AE, Shen J (2020) Estimating the optimal individualized treatment rule from a cost-effectiveness perspective. Biometrics. https://doi.org/10.1111/biom.13406

    Article  Google Scholar 

  13. Mushlin AI, Hall WJ, Zwanziger J, Gajary E, Andrews M, Marron R, Zou KH, Moss AJ (1998) The cost-effectiveness of automatic implantable cardiac defibrillators: results from madit. Circulation 97(21):2129–2135

    Article  Google Scholar 

  14. Wailoo AJ, Bansback N, Brennan A, Michaud K, Nixon RM, Wolfe F (2008) Biologic drugs for rheumatoid arthritis in the medicare program: a cost-effectiveness analysis. Arthr Rheum 58(4):939–946

    Article  Google Scholar 

  15. McIntosh E, Barlow J, Davis H, Stewart-Brown S (2009) Economic evaluation of an intensive home visiting programme for vulnerable families: a cost-effectiveness analysis of a public health intervention. J Pub Health 31(3):423–433

    Article  Google Scholar 

  16. Jiang G, Wu J, Williams GR (2000) Fieller’s interval and the bootstrap-fieller interval for the incremental cost-effectiveness ratio. Health Serv Outcomes Res Methodol 1(3–4):291

    Article  Google Scholar 

  17. O’Brien BJ, Briggs AH (2002) Analysis of uncertainty in health care cost-effectiveness studies: an introduction to statistical issues and methods. Stat Methods Med Res 11(6):455–468

    Article  Google Scholar 

  18. Chen S, Zhao H (2013) Estimating incremental cost-effectiveness ratios and their confidence intervals with different terminating events for survival time and costs. Biostatistics 14(3):422–432

    Article  Google Scholar 

  19. Dinkelbach W (1967) On nonlinear fractional programming. Manage Sci 13(7):492–498

    Article  MathSciNet  Google Scholar 

  20. Rubin DB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J Educ Psychol 66(5):688

    Article  Google Scholar 

  21. Schulte PJ, Tsiatis AA, Laber EB, Davidian M (2014) Q-and a-learning methods for estimating optimal dynamic treatment regimes. Stat Sci: Rev J Inst Math Stat 29(4):640

    Article  MathSciNet  Google Scholar 

  22. Liu Y, Wang Y, Kosorok MR, Zhao Y, Zeng D (2018) Augmented outcome-weighted learning for estimating optimal dynamic treatment regimens. Stat Med 37(26):3776–3788

    Article  MathSciNet  Google Scholar 

  23. Bang H, Tsiatis AA (2000) Estimating medical costs with censored data. Biometrika 87(2):329–343

    Article  MathSciNet  Google Scholar 

  24. Zhao H, Zuo C, Chen S, Bang H (2012) Nonparametric inference for median costs with censored data. Biometrics 68(3):717–725

    Article  MathSciNet  Google Scholar 

  25. Noyes K, Veazie P, Hall WJ, Zhao H, Buttaccio A, Thevenet-Morrison K, Moss AJ (2013) Cost effectiveness of cardiac resynchronization for the prevention of heart failure. J Cardiovasc Electrophysiol 24(1):66

    Article  Google Scholar 

  26. Martí R, Resende MG, Ribeiro CC (2013) Multi-start methods for combinatorial optimization. Eur J Oper Res 226(1):1–8

    Article  MathSciNet  Google Scholar 

  27. Laber EB, Zhao Y-Q (2015) Tree-based methods for individualized treatment regimes. Biometrika 102(3):501–514

    Article  MathSciNet  Google Scholar 

  28. Mi X, Zou F, Zhu R (2019) Bagging and deep learning in optimal individualized treatment rules. Biometrics 75(2):674–684

    Article  MathSciNet  Google Scholar 

  29. Murphy SA (2003) Optimal dynamic treatment regimes. J Royal Stat Soc B 65:331–366

    Article  MathSciNet  Google Scholar 

  30. Zhao Y-Q, Zeng D, Laber EB, Kosorok MR (2015) New statistical learning methods for estimating optimal dynamic treatment regimes. J Am Stat Assoc 110(510):583–598

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ying-Qi Zhao.

Appendices

Appendix A Proof

1.1 Proof of Proposition 2.1

Proof

We first note that (3) is equivalent to \(\underset{d \in D }{\max }\ \quad \{E^d(T) - T_0\}/\{E^d(max(R, R_0)) - R_0\}\), given the maximizer of (3) must be in the set D. Given any fixed \(d \in D\), we have

$$\begin{aligned} \underset{\theta \in \Theta }{\max }\ E^d(\max (R, \theta ))&=E^d(max(R, R_0)) \\ \underset{\theta \in \Theta }{\text {max}} \{E^d(\max (R, \theta )) - R_0\}/\{E^d(T) - T_0\}&= \{E^d(\max (R, R_0)) - R_0\}/\{E^d(T) - T_0\}\\ E^d(T) - T_0&>0 \\ E^d(\max (R, R_0)) - R_0&>0.\\ \end{aligned}$$

Thus, \(\underset{d\in D}{\max }\ \{E^d(T) - T_0\}/\{E^d(max(R, R_0)) - R_0\}\) is equivalent to minimizing its inverse, which is \(\underset{d\in D}{\min }\{E^d(max(R, R_0)) - R_0\} /\{E^d(T) - T_0\}\). The proof of the equivalence between (4) and (??) is similar, after observing \(\underset{\theta \in \Theta }{\min } E^d(\max (R, \theta ))=E^d(max(R, -\infty ))=E^d(R), \forall d\in D\). \(\square\)

1.2 Proof of Theorem 2.2

The proof of Theorem 2.2 directly follows from that of [19]. We define \(N(d)= E^{d}(T)-T_0\), and \(D(d)= E^{d}(\textbf{R})-R_0\). Our proposed objective can be formulated as

$$\begin{aligned} \underset{d \in {S}}{\max } \quad \frac{N(d)}{D(d)}. \end{aligned}$$
(A1)

We consider another related problem

$$\begin{aligned} \underset{d \in {S}}{\max } \quad \{N(d)- qD(d)\} , \end{aligned}$$
(A2)

where \(q\in \mathbb {R}\). We would want to prove \(q^*=\frac{N(d^*)}{D(d^*)}=\underset{d \in {S}}{\max } \quad \frac{N(d)}{D(d)}\) iff \(F(q^*)=\underset{d \in {S}}{\max } \quad \{N(d)- q^*D(d)\}=0\).

Proof

We first establish lemmas regarding \(F(q)=\underset{d \in {S}}{\max } \quad \{N(d)- qD(d)\}\).

  1. 1.

    F(q) is convex over \(\mathbb {R}\).

  2. 2.

    F(q) is continuous for \(q \in \mathbb {R}\).

  3. 3.

    F(q) is strictly monotonic decreasing function of q.

The proofs of lemmas are detailed in [19]. We can then prove \(F(q) = 0\) has an unique solution, say \(q^*\). This assertion results from (2), (3), and the following fact \(\lim _{q\rightarrow -\infty } F(q)=+\infty\), and \(\lim _{q\rightarrow \infty } F(q)=-\infty\).

\(\boxed {\hbox {Part 1}}\) In part 1, we prove if \(q^*=\frac{N(d^*)}{D(d^*)}=\underset{d \in {S}}{\max } \quad \frac{N(d)}{D(d)}\), then \(F(q^*)=\underset{d \in {S}}{\max } \quad \{N(d)- q^*D(d)\}=0\). We let \(d^*\) to be solution to (1). We then have \(N(d^*)/D(d^*)=q^*\ge {N(d)}/{D(d)}, \forall d\in S\). Given \(D(d)>0, \forall d\in S\), we have

$$\begin{aligned} N(d)-q^* D(d)&\le 0, \forall d\in S \nonumber \\ N(d^*)-q^* D(d^*)&=0. \end{aligned}$$
(A3)

From (3) we see that \(F(q^*)=\underset{d \in {S}}{\max } \quad \{N(d)- q^*D(d)\}=0\), and \(d^*\) is an maximizer of \(\underset{d \in {S}}{\max } \quad \{N(d)- q^*D(d)\}\).

\(\boxed {\hbox {Part 2}}\) In part 2, we prove if \(F(q^*)=\underset{d \in {S}}{\max } \quad \{N(d)- q^*D(d)\}=0\), then \(q^*=\frac{N(d^*)}{D(d^*)}=\underset{d \in {S}}{\max } \quad \frac{N(d)}{D(d)}\). We let \(d^*\) to be a solution to (2) such that \(N(d^*)- q^*D(d^*)=0\). The definition of (2) implies that \(N(d)- q^*D(d)\le N(d^*)- q^*D(d^*)=0, \forall d\in S\). Therefore, we have

$$\begin{aligned} N(d)-q^* D(d)&\le 0, \forall d\in S \nonumber \\ N(d^*)-q^* D(d^*)&=0. \end{aligned}$$
(A4)

From (4) we have \(q^*\ge N(d)/D(d),\forall d\in S\), that is \(q^*\) is the maximum of problem (3). Given that \(N(d^*)/D(d^*) =q^*\), we can conclude \(d^*\) is a solution for (1). Therefore, \(d^*\) that solves (2), with \(q=q^*\), also solves (1). \(\square\)

The above theorem does not guarantee the uniqueness of \(d^*\). While the strict conditions of N(d) and D(d) being continuous and S being compact may not always hold, we find practical success in solving a sequence of convex problems \(\underset{d \in {S}}{\max } \quad {N(d)- qD(d)}\) indexed by q, leading to convergence.

Appendix 2

1.1 Additional Simulation Results Under Small Sample Size (See Table 6)

Table 6 Estimated average iwICER(d) (sd) in Scenario 3

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dong, X., Zhao, YQ. Estimating Individualized Treatment Regimes to Optimize Incremental Cost-Effectiveness Ratio. Stat Biosci (2024). https://doi.org/10.1007/s12561-024-09440-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12561-024-09440-x

Keywords

Navigation