In this article, we consider the distributed formation navigation problem of second-order multiagent systems subject to both velocity and input constraints. Both collision avoidance and connectivity maintenance of the network are considered in the controller design. A control barrier function method is employed to achieve multiple control objectives simultaneously while satisfying the velocity and input constraints. First, a nominal distributed leader-following formation controller is proposed which satisfies the velocity and input constraints uniformly and handles switching communication graphs. A nonsmooth analysis is employed to prove the global convergence of the controller. Then, a topology-based connectivity maintenance strategy using a new notion of the formation-guided minimum cost spanning tree is proposed and the corresponding barrier function-based constraints are derived. The barrier function-based collision-avoidance conditions are also developed. All barrier function-based constraints are then combined to formulate a quadratic programming problem which modifies the nominal controller when necessary to achieve both collision avoidance and connectivity maintenance. Simulation results demonstrate the effectiveness of the proposed control strategy.