A fast agglutination screening test (FAST) for the detection of Leishmania antibodies in human serum samples was evaluated under harsh field conditions in northern Ethiopia. Test performance was compared with a standard serological test, namely the direct agglutination test (DAT), and with parasitology. In total, 103 suspected cases were recruited for the study. Based on parasitological examination, 49 patients were confirmed of having visceral leishmaniasis (VL) and the other 54 suspected cases were parasitologically negative. Field evaluation of FAST was possible in blood samples of 89 patients. FAST had 4 false negative results and 13 false positive results. DAT had 2 false negative results and 20 false positive results. A good degree of agreement (86.9%) was observed between FAST and DAT (kappa value 0.73). In this field-based evalauation, the sensitivity and specificity of FAST were found to be 91.1% (95% CI 77.9-97.1) and 70.5% (95% CI 54.6-82.8), respectively, compared with 95.3% (95% CI 82.9-99.2) and 62.3% (95% CI 47.9-74.9) for DAT. FAST had a high predictive value of a negative test, demonstrating that FAST could be utilised to exclude rapidly non-VL patients from a large population of suspects with fever and splenomegaly in endemic areas.