Log in

Forecasting the housing vacancy rate in Japan using dynamic spatiotemporal effects models

  • Original Paper
  • Published:
Japanese Journal of Statistics and Data Science Aims and scope Submit manuscript

Abstract

This study attempts to predict and forecast the future heterogeneous increase in the vacant house ratio among prefectures in Japan using spatial panel models with unobserved dynamic spatiotemporal effects. The study formulated models with autoregressive and random-walk spatiotemporal effects, referring to the dynamic spatiotemporal effects (DSE) models. We estimate the model parameters and latent spatiotemporal effects via Markov Chain Monte Carlo algorithm. Simulation studies demonstrated the superior performance of the DSE model in terms of future prediction when spatial and temporal correlation exists. The model is then applied to the prefecturewise ratio of vacant houses to the non-rental housing stock in Japan, and the results imply existence of spatiotemporal correlations that cannot be captured by explanatory variables. Furthermore, it is revealed that the DSE models can provide better forecasting than the existing spatial panel models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Source: Housing and Land Survey (MIC, Japan), 2018

Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. This nature is reported in “the survey of vacant houses situation” conducted by the MLIT (2020).

  2. Spatial interaction was originally approached by several researchers in late 1960s to 1970s. Ord (1975) employed the maximum likelihood estimator for estimating the certain output using the spatial weight matrix, assuming the existence of spatial autocorrelation. Paelinck (1978) coined the term “spatial econometrics” and pointed out the principles for the specification of spatial econometric models. Paelinck and Klaassen (1979) published a textbook on the specification estimation with consideration for and spatial autocorrelation with empirical results. While we do not primarily discuss the development of the spatial econometric model, including spatial econometric panel model, we exhibit estimation results using the representative spatial econometric models, which are the SAC and SDM model, in order to compare and reference prediction performance.

  3. A notable example in the spatial econometric literature on the predictive performance and development of a model with high performance is Baltagi et al. (2019). They introduced their dynamic spatial generalized moments (GM) estimator and yielded large improvements in predictive efficiencies through the Monte Carlo experiment. The prediction and forecast performance were also examined through real-world data. Its predictive performance showed a large improvement over older models.

  4. The vacancy rate, which is defined as a total vacant houses with respect to total housing stock is 13.6% in 2018 and it is almost 50% increased from 9.3% from 1993. More importantly, the number of vacant houses owned without any specific purpose, such as a selling inventory or temporal vacancy of rental housing, is 3.49 million nationally in 2018 and increased about 30% from 2008 according to the national survey.

  5. The externality of vacant houses for surrounding neighborhoods is reported, for example, in Sadayuki et al. (2020) and Suzuki et al. (2022), which showed the negative externality toward rent in a suburb of Tokyo, Japan.

  6. In their report in June 2019 after the announcement of the residential land statistics survey, Nomura Research Institute attributed their vacant housing rate estimation error to the fact that the predicted number of houses owned by retired residents was different from the actual number.

  7. The distances among prefectural capitals are publicly available at the website of the Geospatial Authority in Japan (https://www.gsi.go.jp/KOKUJYOHO/kenchokan.html, Japanese only), calculated by their shortest distance (geodesic length) in terms of the GRS80.

  8. Based on Ren et al. (2014) and Ou (2014), we computed the Moran’s I statistics of the residuals in the ordinary panel (OP) model, using the spatial weight matrix employed in SAC and SDM models. The value was 0.367, where the expectation and standard deviation under the null hypothesis are − 0.018 and 0.073, respectively, showing statistically significant spatial correlation.

  9. In Japan, the future value of explanatory variables, which is the number of prefectural populations for each age group, is publicly available up to 2045 at the website of the National Institute of Population and Social Security Research.

  10. Despite the difference in the width of the forecasting error distribution among models, we found that both distributions in Figs. 3(a) and 3(b) skewed to the right, indicating the tendency for overprediction of the vacant house rate in 2018. The cause of such biases in 2018 data is unknown. A possible explanation is the enactment of the Vacant Houses Special Measures Act enacted in 2015, which enabled municipalities to obtain information on vacant houses and demolish or change the property taxation of specific abandoned and regionally identified houses. It is less likely that this act itself directly affects the large number of demolition or disposition of vacant houses in this short time period. Nonetheless, it led some municipalities to change their attitude toward vacant houses, and it might have changed the decision for the possession of unused housing by individual owners.

  11. For example, Logan (2012) stated the importance of incorporating spatial information in sociological analysis. The benefit may be especially large when dealing with phenomena involving spatial clustering.

  12. Muto et al (2021) introduces the spatiotemporal geostatistical model for real estate prices, which accounts for and incorporates its spatially and temporally random occurrence of transaction, estimated through the Bayesian MCMC estimation.

References

  • Anselin, L. (1988). Spatial econometrics: Methods and models. Kluwer Academic Publisher.

    Book  MATH  Google Scholar 

  • Baltagi, B. H., Fingleton, B., & Pirotte, A. (2019). A Time-space dynamic panel data model with spatial moving average errors. Regional Science and Urban Economics, 76, 13–31.

    Article  Google Scholar 

  • Belotti, F., Hudges, G., & Mortari, A. P. (2017). Spatial panel-data models using Stata. The Stata Journal, 17(1), 139–180.

    Article  Google Scholar 

  • Banerjee, S., Carlin, B. P. & Gelfand, A. E. (2014). Hierarchical Modeling and Analysis for Spatial Data (Second Edition), Chapman & Hall/CRC Monographs on Statistics and Applied Probability.

  • Durbin, R. A. (1988). Estimation of regression coefficients in the presence of spatially autocorrelated errors. Review of Economics and Statistics, 70, 466–474.

    Article  Google Scholar 

  • Elhorst, J. P. (2014). Spatial econometrics: From cross-sectional data to spatial panels. Springer.

    Book  MATH  Google Scholar 

  • Kawabata, M., & Abe, Y. (2018). Intra-metropolitan spatial patterns of female labor force participation and commute times in Tokyo. Regional Science and Urban Economics, 68, 291–303.

    Article  Google Scholar 

  • Kelejian, H. H., & Prucha, I. R. (1998). A generalized spatial two-stage least squares procedure for estimating a spatial autoregressive model with autoregressive disturbances. The Journal of Real Estate Finance and Economics, 17(1), 99–121.

    Article  Google Scholar 

  • LeSage, J. P. (2014). What regional scientists need to know about spatial econometrics. Review of Regional Studies, 44, 13–32.

    Article  Google Scholar 

  • LeSage, J. P., & Pace, R. K. (2009). Introduction to spatial econometrics. CRC Press.

    Book  MATH  Google Scholar 

  • Logan, J. R. (2012). Making a place for space: Spatial thinking in social science. Annual Review of Sociology, 38, 507–524.

    Article  Google Scholar 

  • Ministry of Land, Infrastructure, Transport and Tourism (2020). The survey of vacant houses situation (Akiya-Jittai-Chosa), available at the MLIT’s website (https://www.mlit.go.jp/report/press/content/001377049.pdf, in Japanese)

  • Muto, S., Sugasawa, S. & Suzuki M. (2021) Hedonic real estate price estimation with the spatiotemporal geostatistical model, CREI Working Paper, University of Tokyo, Japan.

  • Ord, K. (1975). Estimation methods for models of spatial interaction. Journal of the American Statistical Association, 70, 120–126.

    Article  MathSciNet  MATH  Google Scholar 

  • Ou, B-L. (2014). Moran's I Tests for Spatial Dependence in Panel Data Models with Time Varying Spatial Weights Matrices, Proceedings of the 2014 International Conference on Economic Management and Trade Cooperation, Atlantis Press.

  • Paelinck, J. (1978). Spatial econometrics. Economics Letters, 1, 59–63.

    Article  Google Scholar 

  • Paelinck, J., & Klaassen, L. (1979). Spatial econometrics. Saxon House.

    Google Scholar 

  • Ren, T., Long, Z., Zhang, R. & Chen, Q. (2014). Moran’s I test of spatial panel data model—Based on bootstrap method, Economic Modelling, Elsevier, 41:C, 9–14.

  • Sadayuki, T., Kanayama, Y., & Arimura, T. H. (2020). The externality of vacant houses: The case of Toshima municipality Tokyo, Japan. Review of Regional Studies, 50(2), 260–281.

    Article  Google Scholar 

  • Sanso, B., & Guenni, L. (1999). Venezuelan rainfall data analysed by using a Bayesian space–time model. Journal of the Royal Statistical Society: Series C (applied Statistics), 48(3), 345–362.

    MATH  Google Scholar 

  • Sahu, S. K., & Bakar, K. S. (2012). A comparison of Bayesian models for daily ozone concentration levels. Statistical Methodology, 9(1–2), 144–157.

    Article  MathSciNet  MATH  Google Scholar 

  • Stroud, J. R., Müller, P., & Sansó, B. (2001). Dynamic models for spatiotemporal data. Journal of the Royal Statistical Society: Series B (statistical Methodology), 63(4), 673–689.

    Article  MathSciNet  MATH  Google Scholar 

  • Suzuki, M., Hino, K. & Muto, S. (2022) Negative externalities of long-term vacant homes: Evidence from Japan, Journal of Housing Economics, forthcoming.

  • West, M., & Harrison, J. (2006). Bayesian forecasting and dynamic models. Springer Science & Business Media.

    MATH  Google Scholar 

Download references

Acknowledgements

We would like to thank Yasushi Asami, Masayoshi Hayashi, Noriyuki Yanagawa, and participants at the Center for Real Estate Innovation (CREI) workshop at the University of Tokyo for their insightful comments. Sachio Muto is also from the Ministry of Land, Infrastructure, Transport and Tourism (MLIT), Government of Japan, and the views expressed in this paper are those of the authors and do not necessarily reflect the official policy or position of any ministry and agency of the Japanese government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sachio Muto.

Ethics declarations

Conflict of interest

The authors of this paper declare that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

Data generating process

 

Scenario I

Scenario II

Scenario III

 

Spatial autoregressive error

Spatiotemporal effects (moderate serial autocorrelation)

Spatiotemporal effects (strong serial autocorrelation)

Data generating process

\({y}_{t}=\alpha +\beta {x}_{t}+u+{\varepsilon }_{t}\),

where

\(u\sim N(0, cH\left(\phi \right))\),

\({\varepsilon }_{t}=\rho W{\varepsilon }_{t}+{v}_{t},\)

\({v}_{t}\sim N(0,{\tau }^{2}{I}_{n})\)

\({y}_{t}=\alpha +\beta {x}_{t}+u+{\xi }_{t}+{\varepsilon }_{t}\)

where

\(u\sim N(0, cH\left(\phi \right))\),

\({\xi }_{t}|{\xi }_{t-1}\sim N\left(\rho {\xi }_{t-1},{\sigma }^{2}H\left(\phi \right)\right),\)

\({\varepsilon }_{t}\sim N(0,{\tau }^{2}{I}_{n})\)

\({y}_{t}=\alpha +\beta {x}_{t}+u+{\xi }_{t}+{\varepsilon }_{t}\)

where

\(u\sim N(0, cH\left(\phi \right))\),

\({\xi }_{t}|{\xi }_{t-1}\sim N\left(\rho {\xi }_{t-1},{\sigma }^{2}H\left(\phi \right)\right),\)

\({\varepsilon }_{t}\sim N(0,{\tau }^{2}{I}_{n})\)

Regions

\(i\)(\(i=1,\dots ,n\) with \(n=47\))

Time periods

\(t\)(\(t=1,\dots ,T\) with \(T=5\))

Fixed parameters

\(\alpha =2\), \(\beta =5\), c = 9, \(\rho =0.5\), and \(\tau =0.3\)

Geographic weight matrix

\(H\left(\phi \right)\): Correlation matrix, where each element is \({\rho }_{G}\left({s}_{i}-{s}_{j};\phi \right)=\text{exp}(-||{s}_{i}-{s}_{j}|{\left.\right|}^{2}/{\phi }^{2})\),

where \(\phi =1\) and \(||{s}_{i}-{s}_{j}||\) is a geographical distance between region i and j

\(W=H\left(h\right)\) with \(h = 2\)

-

Explanatory variable

\({x}_{it}\) is generated by uniform distribution on \([t-1, t+1]\)

The mean value of \({x}_{it}\) is \(t\) \((t=1,\dots ,T)\)

Appendix 2

Details of the SAC and the SDM models

Let \({y}_{t}\) be an \(n\) dimensional response vector and \({X}_{t}={\left({x}_{1t},\dots ,{x}_{nt}\right)}^{T}\) be an \(n\times p\) matrix of explanatory (exogenous) variables at time \(t\), where \(n\) is the number of regions or individuals. Further assume that both \({y}_{t}\) and \({X}_{t}\) are geographically located, and the interaction among locations can be described by a user-specified spatial weight matrix W, which is a time-invariant \(n\times n\) matrix. The model considering the effect of spatial proximity and its correlation among geographical locations is commonly known as the spatial autoregressive model, such as in LeSage (2009). There are many variations for modeling spatial correlation for panel data by assuming the spatial effect on explanatory variables and error terms, and the subsequent studies, including LeSage and Pace (2009), Elhorst (2014), LeSage (2014) and Kawabata and Abe (2018) utilize the model called the spatial Durbin model (SDM) formulated as follows:

$$\left(\text{SDM}\right) {y}_{t}= \rho W{y}_{t}+{X}_{t}{\beta }_{\left(1\right)}+W{X}_{t}{\beta }_{\left(2\right)}+{\varepsilon }_{t},$$

where \({\varepsilon }_{t}\) is an independent error term, \(\beta\) is an unknown regression parameter, and \(\rho\) is a correlation parameter satisfying \(\left|\rho \right|<1\). Another specification that is often utilized in spatial econometrics is the Spatial Autoregressive Model with Auto Regressive disturbances (SAC), which is formulated as follows:

$$\left(\text{SAC}\right) {y}_{t}= \rho W{y}_{t}+{X}_{t}\beta +{u}_{t}, {u}_{t}=\lambda W{u}_{t}+ {\varepsilon }_{t},$$

where \(\lambda\) is an additional spatial correlation parameter in the error term, satisfying \(\left|\lambda \right|<1\). When \(\lambda =0\), the above SAC model reduces to the standard spatial autoregressive model. The SAC model allows correlation with specific spatial weights and this paper utilizes this model as one of the representative models in the spatial econometric models. The methods used to identify and estimate the SAC model are formulated in such as Anselin (1988) and Kelejian and Prucha (1998), which are essentially through the maximum likelihood (ML) and the generalized method of moments (GMM). In the simulation studies and data analysis, we used statistical software STATA to apply the SAC and SDM models for panel data analysis.

See Figs.

Fig. 5
figure 5

Trace plots of the posterior samples for the DSE-AR. (Estimation time periods 1988–2018). (Parameter \(\beta\) (coefficient for age 0–29 ratio), \(\tau\), \(\sigma\), \(\phi\), \(\delta\), in order)

5 and

Fig. 6
figure 6

Trace plots of the posterior samples for the DSE-RW. (Estimation time periods: 1988–2018). (Parameter \(\beta\) (coefficient for age 0–29 ratio), \(\tau\), \(\sigma\), \(\phi\), in order)

6.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Muto, S., Sugasawa, S. & Suzuki, M. Forecasting the housing vacancy rate in Japan using dynamic spatiotemporal effects models. Jpn J Stat Data Sci 6, 21–44 (2023). https://doi.org/10.1007/s42081-022-00184-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42081-022-00184-w

Keywords

Navigation