The microbiota in individual habitats differ in both relative composition and absolute abundance. While sequencing approaches determine the relative abundances of taxa and genes, they do not provide information on their absolute abundances. Here, we developed a machine-learning approach to predict fecal microbial loads (microbial cells per gram) solely from relative abundance data. Applying our prediction model to a large-scale metagenomic dataset (n = 34,539), we demonstrated that microbial load is the major determinant of gut microbiome variation and is associated with numerous host factors, including age, diet, and medication. We further found that for several diseases, changes in microbial load, rather than the disease condition itself, more strongly explained alterations in patients' gut microbiome. Adjusting for this effect substantially reduced the statistical significance of the majority of disease-associated species. Our analysis reveals that the fecal microbial load is a major confounder in microbiome studies, highlighting its importance for understanding microbiome variation in health and disease.

The interpretation of genomic, transcriptomic and other microbial 'omics data is highly dependent on the availability of well-annotated genomes. As the number of publicly available microbial genomes continues to increase exponentially, the need for quality control and consistent annotation is becoming critical. We present proGenomes3, a database of 907 388 high-quality genomes containing 4 billion genes that passed stringent criteria and have been consistently annotated using multiple functional and taxonomic databases including mobile genetic elements and biosynthetic gene clusters. proGenomes3 encompasses 41 171 species-level clusters, defined based on universal single copy marker genes, for which pan-genomes and contextual habitat annotations are provided. The database is available at http://progenomes.embl.de/.