This article proposes a distributed consensus tracking controller for a class of nonlinear multiagent systems under a directed graph, in which all agents are subject to time-varying asymmetric full-state constraints, internal uncertainties, and external disturbances. The feasibility condition generally required in the existing constrained control is removed by using the proposed nonlinear mapping function (NMF)-based state reconstruction technology, and the Lipschitz condition usually needed in the consensus tracking is also canceled based on the adaptive command-filtered backstepping framework. The composite learning of the neural network-based function approximator (NN-FAP) and the finite-time smooth disturbance observer (DOB) provides a novel scheme for handling internal and external uncertainties simultaneously. One advantage of this scheme is that the use of online historical data of the closed-loop system strengthens the excitation of NN's learning. Another advantage is that the DOB with NN-FAP embedding realizes that the finite-time observation for external disturbance in the case of the system dynamics is unknown. A complete controller design, sufficient stability analysis, and numerical simulation are provided.