Single-chain and single-fragment configurational entropies of lipid tails in hydrated lipid bilayers are evaluated from molecular dynamics simulations using the quasi-harmonic approximation. The entropy distribution along individual acyl tails is obtained and compared to that of corresponding hydrocarbon chains in the liquid phase. We consider pure dipalmitoylphosphatidylcholine and mixed dioleoylphosphatidylcholine/dioleoylphosphatidylethanolamine bilayers. The systems are modeled at different levels of spatial resolution: In an atomic-level (AL) model all (heavy) atoms are explicitly simulated; in a coarse-grained (CG) model particles (beads) representing groups of covalently bound atoms are used, which map approximately four non-hydrogen atoms to one interaction site. Single-chain and single-fragment entropies and correlations between the motions of (single) acyl chains are compared. A good correspondence is found between the flexibility of the AL and CG models. The loss in configurational entropy due to the reduction in the number of degrees of freedom upon coarse-graining of the model is estimated. The CG model shows about 4 times faster convergence of the chain entropies than the more detailed AL model. Corrections to the quasi-harmonic entropy estimates were found to be small for the CG model. For the AL model, the correction due to mode anharmonicities is small, but the correction due to pairwise (supralinear) mode correlations is sizable.