Despite their indisputable clinical value, current tissue engineering strategies face major challenges in recapitulating the natural nano-structural and morphological features of native bone. The aim of this study is to take a step forward by developing a porous scaffold with appropriate mechanical strength and controllable surface roughness for bone repair. This was accomplished by homogenous dispersion of carbon nanotubes (CNTs) in a poly(lactide-co-glycolide) (PLGA) solution followed by a solvent casting/particulate leaching scaffold fabrication. Our results demonstrated that CNT/PLGA composite scaffolds possessed a significantly higher mechanical strength as compared to PLGA scaffolds. The incorporation of CNTs led to an enhanced surface roughness and resulted in an increase in the attachment and proliferation of MC3T3-E1 osteoblasts. Most interestingly, the in vitro osteogenesis studies demonstrated a significantly higher rate of differentiation on CNT/PLGA scaffolds compared to the control PLGA group. These results all together demonstrate the potential of CNT/PLGA scaffolds for bone tissue engineering as they possess the combined effects of mechanical strength and osteogenicity.