Inference and computation with generalized additive models and their extensions

• Simon N. Wood ^[1]
  1. [1] University of Bristol

     University of Bristol

     Reino Unido

     
• Localización: Test: An Official Journal of the Spanish Society of Statistics and Operations Research, ISSN-e 1863-8260, ISSN 1133-0686, Vol. 29, Nº. 2, 2020, págs. 307-339
• Idioma: inglés
• DOI: 10.1007/s11749-020-00711-5
• Texto completo no disponible (Saber más ...)
• Resumen

  • Regression models in which a response variable is related to smooth functions of some predictor variables are popular as a result of their appealing balance between flexibility and interpretability. Since the original generalized additive models of Hastie and Tibshirani (Generalized additive models. Chapman & Hall, Boca Raton, 1990) numerous model extensions have been proposed, and a variety of practically useful computational strategies have emerged. This paper provides an overview of some widely applicable frameworks for this type of modelling, emphasizing the similarities between the different approaches, and the equivalence of smoothing, Gaussian latent process models and Gaussian random effects. The focus is particularly on Bayes empirical smoother theory, fully Bayesian inference via stochastic simulation or integrated nested Laplace approximation and boosting.

• Referencias bibliográficas
  • Akaike H (1973) Information theory and an extension of the maximum likelihood principle. In: Petran B, Csaaki F (eds) International symposium...
  • Anderssen R, Bloomfield P (1974) A time series approach to numerical differentiation. Technometrics 16(1):69–75
  • Augustin NH, Sauleau E-A, Wood SN (2012) On quantile quantile plots for generalized linear models. Comput Stat Data Anal 56(8):2404–2409
  • Belitz C, Brezger A, Kneib T, Lang S, Umlauf N (2015). BayesX: software for Bayesian inference in structured additive regression models
  • Bissiri PG, Holmes C, Walker SG (2016) A general framework for updating belief distributions. J R Stat Soc Ser B (Stat Methodol) 78(5):1103–1130...
  • Claeskens G, Krivobokova T, Opsomer JD (2009) Asymptotic properties of penalized spline estimators. Biometrika 96(3):529–544
  • Clarke E, Speirs D, Heath M, Wood S, Gurney W, Holmes S (2006) Calibrating remotely sensed chlorophyll—a data by using penalized regression...
  • Craven P, Wahba G (1979) Smoothing noisy data with spline functions. Numer Math 31:377–403
  • Davis TA (2006) Direct methods for sparse linear systems. SIAM, Philadelphia
  • DuchonJ(1977)Splinesminimizingrotation-invariantsemi-normsinSolobevspaces.In:SchempW,Zeller K (eds) Construction theory of functions of several...
  • EilersPH,MarxBD,DurbánM(2015)Twentyyearsofp-splines.SORTStatOperResTrans39(2):149–186
  • Eilers PHC, Marx BD (1996) Flexible smoothing with B-splines and penalties. Stat Sci 11(2):89–121
  • FahrmeirL,KneibT,LangS(2004)Penalizedstructuredadditiveregressionforspace-timedata:aBayesian perspective. Stat Sin 14(3):731–761
  • Fahrmeir L, Lang S (2001) Bayesian inference for generalized additive mixed models based on markov random field priors. Appl Stat 50:201–220
  • Fasiolo M, Goude Y, Nedellec R, Wood SN (2017) Fast calibrated additive quantile regression. arXiv preprint arXiv:1707.03307
  • Fellner WH (1986) Robust estimation of variance components. Technometrics 28(1):51–60
  • Greven S, Kneib T (2010) On the behaviour of marginal and conditional AIC in linear mixed models. Biometrika 97(4):773–789
  • Gu C (1992) Cross-validating non-Gaussian data. J Comput Graph Stat 1:169–179
  • Gu C (2013) Smoothing spline ANOVA models, 2nd edn. Springer, New York
  • GuC,WahbaG(1991)MinimizingGCV/GMLscoreswithmultiplesmoothingparametersviatheNewton method. SIAM J Sci Stat Comput 12(2):383–398
  • Hastie T, Tibshirani R (1986) Generalized additive models (with discussion). Stati Sci 1:297–318
  • Hastie T, Tibshirani R (1990) Generalized additive models. Chapman & Hall, Boca Raton
  • Kimeldorf GS, Wahba G (1970) A correspondence between Bayesian estimation on stochastic processes and smoothing by splines. Ann Math Stat...
  • Klein N, Kneib T, Klasen S, Lang S (2014) Bayesian structured additive distributional regression for multivariate responses. J R Stat Soc...
  • Klein N, Kneib T, Lang S, Sohn A (2015) Bayesian structured additive distributional regression with an application to regional income inequality...
  • KristensenK,NielsenA,BergCW,BellHSBM(2016)TMB:automaticdifferentiationandlaplaceapproximation. J Stat Softw 70(5):1–21
  • Lang S, Brezger A (2004) Bayesian P-splines. J Comput Graph Stat 13:183–212
  • LangS,UmlaufN,WechselbergerP,HarttgenK,KneibT(2014)Multilevelstructuredadditiveregression. Stat Comput 24(2):223–238
  • LiZ,WoodSN(2019)Fastermodelmatrixcrossproductsforlargegeneralizedlinearmodelswithdiscretized covariates. Stat Comput 30:19–25
  • Lindgren F, Rue H, Lindström J (2011) An explicit link between Gaussian fields and Gaussian Markov random fields:thestochasticpartialdifferentialequationapproach.JRStatSocSerB(StatMethodol)...
  • MartinsTG,SimpsonD,LindgrenF,RueH(2013)BayesiancomputingwithINLA:newfeatures.Comput Stat Data Anal 67:68–83
  • Marx BD, Eilers PH (2005) Multidimensional penalized signal regression. Technometrics 47(1):13–22
  • Mayr A, Fenske N, Hofner B, Kneib T, Schmid M (2012) Generalized additive models for location, scale andshapeforhighdimensionaldata—aflexibleapproachbasedonboosting.JRStatSocSerC(Appl...
  • NychkaD(1988)Bayesianconfidenceintervalsforsmoothingsplines.JAmStatAssoc83(404):1134–1143
  • Parker R, Rice J (1985) Discussion of Silverman (1985). J R Stat Soc Ser B 47(1):40–42
  • Plummer M (2003) JAGS: a program for analysis of Bayesian graphical models using Gibbs sampling. In: Proceedings of the 3rd international...
  • Pya N, Wood SN (2015) Shape constrained additive models. Stat Comput 25(3):543–559
  • RigbyR,StasinopoulosDM(2005)Generalizedadditivemodelsforlocation,scaleandshape.JRStatSoc Ser C (Appl Stat) 54(3):507–554
  • RobinzonovN,HothornT(2010)Boostingforestimatingspatiallystructuredadditivemodels.In:Statistical modelling and regression structures. Springer,...
  • Rue H, Held L (2005) Gaussian Markov random fields: theory and applications. CRC Press, Boca Raton
  • Rue H, Martino S, Chopin N (2009) Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations...
  • RueH,RieblerA,SørbyeSH,IllianJB,SimpsonDP,LindgrenFK(2017)BayesiancomputingwithINLA: a review. Ann Rev Stat Its Appl 4:395–421
  • Ruppert D, Wand MP, Carroll RJ (2003) Semiparametric regression. Cambridge University Press, Cambridge
  • Schall R (1991) Estimation in generalized linear models with random effects. Biometrika 78(4):719–727
  • SchmidM,HothornT(2008)Boostingadditivemodelsusingcomponent-wiseP-splines.ComputStatData Anal 53(2):298–311
  • Shun Z, McCullagh P (1995) Laplace approximation of high dimensional integrals. J R Stat Soc Ser B 57(4):749–760
  • Silverman BW (1985) Some aspects of the spline smoothing approach to non-parametric regression curve fitting. J R Stat Soc Ser B 47(1):1–53
  • SpiegelhalterDJ,BestNG,CarlinBP,vanderLindeA(2002)Bayesianmeasuresofmodelcomplexityand fit. J R Stat Soci Ser B 64(4):583–639
  • StasinopoulosDM,RigbyRAetal(2007)Generalizedadditivemodelsforlocationscaleandshape(gamlss) in r. J Stat Softw 23(7):1–46
  • Stasinopoulos MD, Rigby RA, Heller GZ, Voudouris V, De Bastiani F (2017) Flexible regression and smoothing: using GAMLSS in R. Chapman and...
  • TutzG,BinderH(2006)Generalizedadditivemodelingwithimplicitvariableselectionbylikelihood-based boosting. Biometrics 62(4):961–971
  • UmlaufN,AdlerD,KneibT,LangS,ZeileisA(2015)Structuredadditiveregressionmodels:anRinterface to BayesX. J Stat Softw 63(21):1–46
  • Wahba G (1980) Spline bases, regularization, and generalized cross validation for solving approximation problems with large quantities of...
  • Wahba G (1983) Bayesian confidence intervals for the cross validated smoothing spline. J R Stat Soc B 45:133–150
  • WahbaG(1985)AcomparisonofGCVandGMLforchoosingthesmoothingparameterinthegeneralized spline smoothing problem. Ann Stat 13(4):1378–14
  • Wahba G (1990) Spline models for observational data. SIAM, Philadelphia
  • WoodSN(2000)Modellingandsmoothingparameterestimationwithmultiplequadraticpenalties.JRStat Soc Ser B (Stat Methodol) 62:413–428
  • Wood SN (2003) Thin plate regression splines. J R Stat Soc Ser B (Stat Methodol) 65:95–114
  • Wood SN (2008) Fast stable direct fitting and smoothness selection for generalized additive models. J R Stat Soc Ser B (Stat Methodol) 70(3):495–518
  • Wood SN (2011) Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J...
  • Wood SN (2013a) On p-values for smooth components of an extended generalized additive model. Biometrika 100(1):221–228
  • Wood SN (2013b) A simple test for random effects in regression models. Biometrika 100(4):1005–1010
  • Wood SN (2015) Core statistics. Cambridge University Press, Cambridge
  • Wood SN (2016) Just another Gibbs additive modeller: interfacing JAGS and mgcv. J Stati Softw 75(7)
  • Wood SN (2017a) Generalized additive models: an introduction with R, 2nd edn. CRC Press, Boca Raton
  • Wood SN (2017b) P-splines with derivative based penalties and tensor product smoothing of unevenly distributed data. Stat Comput 27(4):985–989
  • Wood SN (2019) Simplified integrated nested laplace approximation. Biometrika (in press)
  • Wood SN, Fasiolo M (2017) A generalized Fellner–Schall method for smoothing parameter optimization with application to Tweedie location, scale...
  • WoodSN,LiZ,ShaddickG,AugustinNH(2017)Generalizedadditivemodelsforgigadata:modellingthe UK black smoke network daily data. J Am Stat Assoc...
  • Wood SN, Pya N, Säfken B (2016) Smoothing parameter and model selection for general smooth models (with discussion). J Am Stat Assoc 111:1548–1575
  • Yee TW (2015) Vector generalized linear and additive models: with an implementation in R. Springer, Berlin
  • Yee TW, Wild C (1996) Vector generalized additive models. J R Stat Soc Ser B (Methodol) 58(3):481–493
  • de Boor C (2001) A practical guide to splines, Revised edn. Springer, New York