Determination of diagnostic species with statistical fidelity measures

Abstract. Statistical measures of fidelity, i.e. the concentration of species occurrences in vegetation units, are reviewed and compared. The focus is on measures suitable for categorical data which are based on observed species frequencies within a vegetation unit compared with the frequencies expected under random distribution. Particular attention is paid to Bruelheide's u value. It is shown that its original form, based on binomial distribution, is an asymmetric measure of fidelity of a species to a vegetation unit which tends to assign comparatively high fidelity values to rare species. Here, a hypergeometric form of u is introduced which is a symmetric measure of the joint fidelity of species to a vegetation unit and vice versa. It is also shown that another form of the binomial u value may be defined which measures the asymmetric fidelity of a vegetation unit to a species. These u values are compared with phi coefficient, chi‐square, G statistic and Fisher's exact test. Contrary to the other measures, phi coefficient is independent of the number of relevés in the data set, and like the hypergeometric form of u and the chi‐square it is little affected by the relative size of the vegetation unit. It is therefore particularly useful when comparing species fidelity values among differently sized data sets and vegetation units. However, unlike the other measures it does not measure any statistical significance and may produce unreliable results for small vegetation units and small data sets. The above measures, all based on the comparison of observed/expected frequencies, are compared with the categorical form of the Dufrêne‐Legendre Indicator Value Index, an index strongly underweighting the fidelity of rare species. These fidelity measures are applied to a data set of 15 989 relevés of Czech herbaceous vegetation. In a small subset of this data set which simulates a phytosociological table, we demonstrate that traditional table analysis fails to determine diagnostic species of general validity in different habitats and large areas. On the other hand, we show that fidelity calculations used in conjunction with large data sets can replace expert knowledge in the determination of generally valid diagnostic species. Averaging positive fidelity values for all species within a vegetation unit is a useful approach to measure quality of delimination of the vegetation unit. We propose a new way of ordering species in synoptic species‐by‐relevé tables, using fidelity calculations.