Penalized estimation of threshold auto-regressive models with many components and thresholds.

Kunhui Zhang, Abolfazl Safikhani, Alex Tank, Ali Shojaie
Author Information
  1. Kunhui Zhang: University of Washington, Department of Statistics, Padelford Hall, W Stevens Way NE, Seattle, WA 98195.
  2. Abolfazl Safikhani: University of Florida, Department of Statistics, 102 Griffin-Floyd Hall, Gainesville, FL 32611.
  3. Alex Tank: University of Washington, Department of Statistics, Padelford Hall, W Stevens Way NE, Seattle, WA 98195.
  4. Ali Shojaie: University of Washington, Department of Statistics, Padelford Hall, W Stevens Way NE, Seattle, WA 98195.

Abstract

Thanks to their simplicity and interpretable structure, autoregressive processes are widely used to model time series data. However, many real time series data sets exhibit non-linear patterns, requiring nonlinear modeling. The threshold Auto-Regressive (TAR) process provides a family of non-linear auto-regressive time series models in which the process dynamics are specific step functions of a thresholding variable. While estimation and inference for low-dimensional TAR models have been investigated, high-dimensional TAR models have received less attention. In this article, we develop a new framework for estimating high-dimensional TAR models, and propose two different sparsity-inducing penalties. The first penalty corresponds to a natural extension of classical TAR model to high-dimensional settings, where the same threshold is enforced for all model parameters. Our second penalty develops a more flexible TAR model, where different thresholds are allowed for different auto-regressive coefficients. We show that both penalized estimation strategies can be utilized in a three-step procedure that consistently learns both the thresholds and the corresponding auto-regressive coefficients. However, our theoretical and empirical investigations show that the direct extension of the TAR model is not appropriate for high-dimensional settings and is better suited for moderate dimensions. In contrast, the more flexible extension of the TAR model leads to consistent estimation and superior empirical performance in high dimensions.

Keywords

References

  1. PLoS One. 2014 Oct 17;9(10):e109454 [PMID: 25330160]
  2. J Am Stat Assoc. 2022;117(537):251-264 [PMID: 38375186]
  3. J Am Stat Assoc. 2017;112(520):1697-1707 [PMID: 29618851]
  4. J Mach Learn Res. 2015;16(13):417-453 [PMID: 34267606]
  5. Electron J Stat. 2016;10(1):1341-1392 [PMID: 28473876]
  6. J Stat Softw. 2010;33(1):1-22 [PMID: 20808728]

Grants

  1. R01 GM114029/NIGMS NIH HHS
  2. R01 GM133848/NIGMS NIH HHS

Word Cloud

Created with Highcharts 10.0.0TARmodeltimeseriesmodelsestimationhigh-dimensionalthresholdauto-regressivedifferentextensionthresholdsdataHowevermanynon-linearprocesspenaltysettingsflexiblecoefficientsshowempiricaldimensionsThankssimplicityinterpretablestructureautoregressiveprocesseswidelyusedrealsetsexhibitpatternsrequiringnonlinearmodelingAuto-Regressiveprovidesfamilydynamicsspecificstepfunctionsthresholdingvariableinferencelow-dimensionalinvestigatedreceivedlessattentionarticledevelopnewframeworkestimatingproposetwosparsity-inducingpenaltiesfirstcorrespondsnaturalclassicalenforcedparametersseconddevelopsallowedpenalizedstrategiescanutilizedthree-stepprocedureconsistentlylearnscorrespondingtheoreticalinvestigationsdirectappropriatebettersuitedmoderatecontrastleadsconsistentsuperiorperformancehighPenalizedcomponentsNon-linearfusedlasso

Similar Articles

Cited By