It was recently proved that solitons embedded in the spectrum of linear waves may exist in discrete systems, and explicit solutions for isolated unstable embedded lattice solitons (ELS) of a differential-difference version of a higher-order nonlinear Schrodinger equation were found [Gonzalez-Perez-Sandi, Fujioka, and Malomed, Physica D 197, 86 (2004)]. The discovery of these ELS gives rise to relevant questions such as the following: (1) Are there continuous families of ELS? (2) Can ELS be stable? (3) Is it possible for ELS to move along the lattice? (4) How do ELS interact? The present work addresses these questions by showing that a novel equation (a discrete version of a complex modified Korteweg-de Vries equation that includes next-nearest-neighbor couplings) has a two-parameter continuous family of exact ELS. These solitons can move with arbitrary velocities across the lattice, and the numerical simulations demonstrate that these ELS are completely stable. Moreover, the numerical tests show that these ELS are robust enough to withstand collisions, and the result of a collision is only a shift in the positions of the solitons. The model may apply to the description of a Bose-Einstein condensate with dipole-dipole interactions between the atoms, trapped in a deep optical-lattice potential.