Carbon nanotubes (CNTs) have attracted attention for their remarkable electrical properties and have being explored as one of the best building blocks in nano-electronics. A key challenge to realize such potential is the control of the nanotube growth directions. Even though both vertical growth and controlled horizontal growth of carbon nanotubes have been realized before, the growth of complex nanotube structures with both vertical and horizontal orientation control on the same substrate has never been achieved. Here, we report a method to grow three-dimensional (3D) complex nanotube structures made of vertical nanotube forests and horizontal nanotube arrays on a single substrate and from the same catalyst pattern by an orthogonally directed nanotube growth method using chemical vapor deposition (CVD). More importantly, such a capability represents a major advance in controlled growth of carbon nanotubes. It enables researchers to control the growth directions of nanotubes by simply changing the reaction conditions. The high degree of control represented in these experiments will surely make the fabrication of complex nanotube devices a possibility.