Thirty years of progeny from Chao’s inequality: estimating and comparing richness with incidence data and incomplete sampling

• Anne Chao ^[1] ; Robert K. Colwell ^[2]
  1. [1] National Tsing Hua University

     National Tsing Hua University

     Taiwán

     
  2. [2] University of Connecticut

     University of Connecticut

     Town of Mansfield, Estados Unidos

     
• Localización: Sort: Statistics and Operations Research Transactions, ISSN 1696-2281, Vol. 41, Nº. 1, 2017, págs. 3-54
• Idioma: inglés
• Enlaces
  • Texto completo (pdf)
• Resumen

  • In the context of capture-recapture studies, Chao (1987) derived an inequality among capture frequency counts to obtain a lower bound for the size of a population based on individuals’ capture/non-capture records for multiple capture occasions. The inequality has been applied to obtain a non-parametric lower bound of species richness of an assemblage based on species incidence (detection/non-detection) data in multiple sampling units. The inequality implies that the number of undetected species can be inferred from the species incidence frequency counts of the uniques (species detected in only one sampling unit) and duplicates (species detected in exactly two sampling units). In their pioneering paper, Colwell and Coddington (1994) gave the name “Chao2” to the estimator for the resulting species richness. (The “Chao1” estimator refers to a similar type of estimator based on species abundance data). Since then, the Chao2 estimator has been applied to many research fields and led to fruitful generalizations. Here, we first review Chao’s inequality under various models and discuss some related statistical inference questions: (1) Under what conditions is the Chao2 estimator an unbiased point estimator? (2) How many additional sampling units are needed to detect any arbitrary proportion (including 100%) of the Chao2 estimate of asymptotic species richness? (3) Can other incidence frequency counts be used to obtain similar lower bounds? We then show how the Chao2 estimator can be also used to guide a non-asymptotic analysis in which species richness estimators can be compared for equally-large or equally-complete samples via sample-size-based and coverage-based rarefaction and extrapolation. We also review the generalization of Chao’s inequality to estimate species richness under other sampling-without-replacement schemes (e.g. a set of quadrats, each surveyed only once), to obtain a lower bound of undetected species shared between two or multiple assemblages, and to allow inferences about undetected phylogenetic richness (the total length of undetected branches of a phylogenetic tree connecting all species), with associated rarefaction and extrapolation. A small empirical dataset for Australian birds is used for illustration, using online software SpadeR, iNEXT, and PhD.

• Referencias bibliográficas
  • Böhning, D. and van der Heijden, P.G.M. (2009). A covariate adjustment for zero-truncated approaches to estimating the size of hidden and...
  • Böhning, D., Vidal-Diez, A., Lerdsuwansri, R., Viwatwongkasem, C. and Arnold, M. (2013). A Generalization of Chao’s estimator for covariate...
  • Cadotte, M.W., Cavender-Bares, J., Tilman, D. and Oakley, T.H. (2009). Using phylogenetic, functional and trait diversity to understand patterns...
  • Cardoso, P., Rigal, F., Borges, P.A. and Carvalho J.C. (2014). A new frontier in biodiversity inventory: a proposal for estimators of phylogenetic...
  • Cavender-Bares, J., Ackerly, D.D. and Kozak, K.H. (2012). Integrating ecology and phylogenetics: the footprint of history in modern-day communities....
  • Chao, A. (1984). Nonparametric estimation of the number of classes in a population. Scandinavian Journal of Statistics, 11, 265–270.
  • Chao, A. (1987). Estimating the population size for capture-recapture data with unequal catchability. Biometrics, 43, 783–791.
  • Chao, A. and Lee, S-M. (1992). Estimating the number of classes via sample coverage. Journal of American Statistical Association, 87, 210–217.
  • Chao, A., Lee, S-M. and Jeng, C-L. (1992). Estimating population size for capture-recapture data when capture probabilities vary by time and...
  • Chao, A. (2001). An overview of closed capture-recapture models. Journal of Agricultural, Biological and Environmental Statistics, 6, 158–175.
  • Chao, A. (2005). Species estimation and applications. In Balakrishnan, N., C. Read, B, and B. Vidakovic (eds) Encyclopedia of Statistical...
  • Chao, A., Chazdon, R.L., Colwell, R.K. and Shen, T.-J. (2005). A new statistical approach for assessing compositional similarity based on...
  • Chao, A., Chazdon, R.L., Colwell, R.K. and Shen, T.-J. (2006). Abundance-based similarity indices and their estimation when there are unseen...
  • Chao, A., Colwell, R.K., Lin, C.-W. and Gotelli, N.J. (2009). Sufficient sampling for asymptotic minimum species richness estimators. Ecology,...
  • Chao, A., Chiu, C.-H. and Jost, L. (2010). Phylogenetic diversity measures based on Hill numbers. Philosophical Transactions of the Royal...
  • Chao, A. and Chiu, C.-H. (2012). Estimation of species richness and shared species richness. In: Balakrishnan, N (ed) Methods and Applications...
  • Chao, A. and Jost, L. (2012). Coverage-based rarefaction and extrapolation: standardizing samples by completeness rather than size. Ecology,...
  • Chao, A. and Lin, C.-W. (2012). A nonparametric lower bound for species richness and shared species richness under sampling without replacement....
  • Chao, A., Chiu, C.-H. and Jost, L. (2014a). Unifying species diversity, phylogenetic diversity, functional diversity, and related similarity...
  • Chao, A., Gotelli, N.J., Hsieh, T., Sander, E.L., Ma, K., Colwell, R.K. and Ellison, A.M. (2014b). Rarefaction and extrapolation with Hill...
  • Chao, A., Chiu, C.-H., Hsieh, T., Davis, T., Nipperess, D.A. and Faith, D.P. (2015). Rarefaction and extrapolation of phylogenetic diversity....
  • Chao, A. and Chiu, C.-H. (2016). Species richness: estimation and comparison. Wiley StatsRef: Statistics Reference Online. 1–26.
  • Chao, A., Chiu, C.-H., Colwell, R.K., Magnago, L.F.S., Chazdon, R.L. and Gotelli, N.J. (2017). Deciphering the enigma of undetected species,...
  • Chazdon, R.L., Colwell, R.K., Denslow, J.S. and Guariguata, M.R. (1998). Statistical methods for estimating species richness of woody regeneration...
  • Chiarucci, A., Bacaro, G., Rocchini, D. and Fattorini, L. (2008). Discovering and rediscovering the samplebased rarefaction formula in the...
  • Chiu, C.H., Wang, Y.T., Walther, B.A. and Chao, A. (2014). An improved nonparametric lower bound of species richness via a modified Good–Turing...
  • Coleman, B.D., Mares, M.A., Willig, M.R. and Hsieh, Y.H. (1982). Randomness, area, and species richness. Ecology, 63, 1121–1133.
  • Colwell, R.K. and Coddington, J.A. (1994). Estimating terrestrial biodiversity through extrapolation. Philosophical Transactions of the Royal...
  • Colwell, R.K., Mao, C.X. and Chang, J. (2004). Interpolating, extrapolating, and comparing incidencebased species accumulation curves. Ecology,...
  • Colwell, R.K., Chao, A., Gotelli, N.J., Lin, S.-Y., Mao, C.X., Chazdon, R.L. and Longino, J.T. (2012). Models and estimators linking individual-based...
  • Colwell, R.K. (2013). EstimateS: Statistical estimation of species richness and shared species from samples. Version 9 and earlier. User’s...
  • Colwell, R.K. and Elsensohn, J.E. (2014). EstimateS turns 20: statistical estimation of species richness and shared species from samples,...
  • Crozier, R.H. (1997). Preserving the information content of species: genetic diversity, phylogeny, and conservation worth. Annual Review of...
  • Faith, D.P. (1992). Conservation evaluation and phylogenetic diversity. Biological Conservation, 61, 1–10.
  • Good, I.J. (1953). The population frequencies of species and the estimation of population parameters. Biometrika, 40, 237–264.
  • Good, I.J. (1983). Good Thinking: The Foundations of Probability and Its Applications. University of Minnesota Press.
  • Good, I.J. (2000). Turing’s anticipation of empirical Bayes in connection with the cryptanalysis of the naval enigma. Journal of Statistical...
  • Good, I.J. and Toulmin G. (1956). The number of new species and the increase of population coverage when a sample is increased. Biometrika,...
  • Gotelli, N.J. and Chao, A. (2013). Measuring and estimating species richness, species diversity, and biotic similarity from sampling data....
  • Gotelli, N.J. and Colwell, R.K. (2001). Quantifying biodiversity: procedures and pitfalls in the measurement and comparison of species richness....
  • Gotelli, N.J. and Colwell, R.K. (2011). Estimating species richness. In: A. Magurran and B. McGill (eds). Biological Diversity: Frontiers...
  • Heck, K.L., Jr., van Belle G. and Simberloff, D. (1975). Explicit calculation of the rarefaction diversity measurement and the determination...
  • Hill, M. (1973). Diversity and evenness: a unifying notation and its consequences. Ecology, 54, 427–432.
  • Hsieh, T.C. and Chao, A. (2017). Rarefaction and extrapolation: making fair comparison of abundancesensitive phylogenetic diversity among...
  • Hughes, G. and Madden, L.P. (1993). Using the beta-binomial distribution to discrete aggregated patterns of disease incidence. Phytopathology,...
  • Hurlbert, S.H. (1971). The nonconcept of species diversity: a critique and alternative parameters. Ecology, 52, 577–586.
  • Jetz, W., Thomas, G.H., Joy, J.B., Hartmann, K. and Mooers, A.O. (2012). The global diversity of birds in space and time. Nature, 491, 444–448.
  • Jost, L., Chao, A. and Chazdon, R. (2011). Compositional similarity and beta diversity. In A. Magurran and B. McGill (eds). Biological Diversity:...
  • Lanumteang, K. and Böhning, D. (2011). An extension of Chao’s estimator of population size based on the first three capture frequency counts....
  • Magurran, A.E. (2004). Measuring Biological Diversity. Blackwell Publishing, Oxford.
  • Magurran, A.E. and McGill, B.J. (eds) (2011). Biological Diversity: Frontiers in Measurement and Assessment. Oxford University Press, Oxford.
  • Mao, C.X. (2006). Inference on the number of species through geometric lower bounds. Journal of American Statistical Association, 101, 1663–1670.
  • Mao, C.X. (2008). Lower bounds to the population size when capture probabilities vary over individuals. Australian and New Zealand Journal...
  • Mao, C.X. and Lindsay, B.G. (2007). Estimating the number of classes. Annals of Statistics, 35, 917–930.
  • Mao, C.X., Yang, N. and Zhang, J. (2013). On population size estimators in the Poisson mixture model. Biometrics, 69, 758–765.
  • McGrayne, S.B. (2011). The theory that would not die: how Bayes’ rule cracked the enigma code, hunted down Russian submarines, and emerged...
  • Pan, H.Y., Chao, A. and Foissner, W. (2009). A non-parametric lower bound for the number of species shared by multiple communities. Journal...
  • Petchey, O.L. and Gaston, K.J. (2002). Functional diversity (FD), species richness and community composition. Ecology Letters, 5,402–411.
  • Puig, P. and Kokonendji, C. (2017). Nonparametric estimation of the number of zeros in truncated count distributions. To appear in the Scandinavian...
  • Rivest, L.P. and Baillargeon, S. (2007). Applications and extensions of Chao’s moment estimator for the size of a closed population. Biometrics,...
  • Sanders, H.L. (1968). Marine benthic diversity: a comparative study. American Naturalist, 102, 243–282.
  • Shinozaki, K. (1963). Notes on the species-area curve, 10th Annual Meeting of the Ecological Society of Japan (Abstract), p. 5.
  • Shiyomi, M., Takahashi, S. and Yoshimura, J. (2000). A measure for spatial heterogeneity of a grassland vegetation based on the beta-binomial...
  • Simberloff, D. (1972). Properties of the rarefaction diversity measurement. American Naturalist, 106, 414–418.
  • Skellam, J.G. (1948). A probability distribution derived from the binomial distribution by regarding the probability of success as variable...
  • Tilman, D., Knops, J., Wedin, D., Reich, P., Ritchie, M. and Siemann, E. (1997). The influence of functional diversity and composition on...
  • Warwick, R.M. and Clarke, K.R. (1995). New ‘biodiversity’ measures reveal a decrease in taxonomic distinctness with increasing stress. Marine...
  • Webb, C.O. and Donoghue, M.J. (2005). Phylomatic: tree assembly for applied phylogenetics. Molecular Ecology Notes, 5, 181–183.