Poly(4,4',4″-tris[4-(2-bithienyl)pheny]amine) (PTBTPA) was electrochemically synthesized on a ZnO-coated ITO electrode to form a PTBTPA/ZnO nanocomposite electrode. The composite film exhibited a noticeable electrochromism, with reversible color changes from orange in the reduced state (0 V), olive green in the middle state (0.9 V) to dark gray in the oxidized state (1.2 V). Furthermore, the composite film showed a fast switching time of 0.92 s and a high optical contrast of 65% at 1100 nm, and retained 97% of its original electroactivity after 500 cycles, while PTBTPA film had switching time of 1.63 s and an optical contrast of 52% at 1100 nm, and retained 75% of its original electroactivity. The results demonstrated that the electrochromic performances were significantly enhanced through incorporating PTBTPA with ZnO nanorods. ZnO nanorods were introduced to modify the structure of the electrode: on one hand, to offer a directional attraction for the counterions, and on the other hand, to enhance the adhesion between the polymer and the ITO electrode. Accordingly, a conducting polymer/inorganic nanocomposite system could improve the polymer's electrochromic performance, especially in terms of the switching speed and long-term stability of the electrochromic materials.