We describe a general framework for testing neutral theory. We summarize similarities and differences between ten different versions of neutral theory. Two central predictions of neutral theory are that species abundance distributions will follow a zero-sum multinomial distribution and that community composition will change over space due to dispersal limitation. We review all published empirical tests of neutral theory. With the exception of one type of test, all tests fail to support neutral theory. We identify and perform several new tests. Specifically, we develop a set of best practices for testing the fit of the zero-sum multinomial (ZSM) vs. a lognormal null hypothesis and apply this to a data set, concluding that the lognormal outperforms neutral theory on robust tests. We explore whether a priori parameterization of neutral theory is possible, and we conclude that it is not. We show that non-curve-fitting predictions readily derived from neutral theory are easily falsifiable. In toto, there is a current overwhelming weight of evidence against neutral theory. We suggest some next steps for neutral theory.