We propose a self-propelled particle model for the swarming of Daphnia that takes into account mutual repulsion and attraction to a center. Surprisingly, a vortex is formed only for an intermediate strength of propulsion. The phase diagram and the transitions between states with and without a vortex are analyzed, and the nature of the phase boundaries is discussed based on a linear stability analysis of the motion of individual swimmers. This allows us to identify various key parameters determining the characteristic features of the collective motion.