Distributed formation control is presented for networked Euler-Lagrange systems (ELSs) over a directed interaction topology. This problem is defined by a layered framework in which information flow both among the leaders and among the followers is described by different layers. To empower the formation to make a variety of geometric transformations, we present the necessary and sufficient conditions for affine maneuverability under a directed graph. Unlike most existing results using a diagonal stabilizing matrix to achieve the stabilizability of affine formation, this fully distributed approach is feasible without any global information. Next, we propose an adaptive control law for agents in each layer, where the closed-loop errors are driven to a neighborhood of the origin in finite time. Adaptive neural networks are integrated to tackle the model uncertainties in ELSs by updating the norm of the weight matrix, which can simplify the control design and alleviate the computational burden compared with traditional ones. The simulation results are given to show the effectiveness of the proposed approach.