The SecA ATPase associates with the SecY complex to push preproteins across the bacterial membrane. Because a single SecY is sufficient to create the conducting channel, the function of SecY oligomerization remains unclear. Here, we have analyzed the translocation reaction using nanodiscs. We show that one SecY copy is sufficient to bind SecA and the preprotein, but only the SecY dimer together with acidic lipids supports the activation of the SecA translocation ATPase. In discs, the dimer is predominantly arranged in a back-to-back manner and remains active even if a constituent SecY copy is defective for SecA binding. In membrane vesicles and in intact cells, the coproduction of two inactive SecYs, one for channel gating and the other for SecA binding, recreates a functional translocation unit. These results indisputably argue that the SecY dimer is crucial for the activation of SecA, which is necessary for preprotein transport.