The ultra-low thermal conductivity of bulk polymers may be enhanced by combining them with high thermal conductivity materials such as carbon nanotubes. Different from random doping, we find that the aligned carbon nanotube-polyethylene composites has a high thermal conductivity by non-equilibrium molecular dynamics simulations. The analyses indicate that the aligned composite not only take advantage of the high thermal conduction of carbon nanotubes, but enhance thermal conduction of polyethylene chains.