Appropriate plant height is crucial for lodging resistance to improve the rice crop yield. The application of semi-dwarf 1 led to the green revolution in the 1960s, by predominantly increasing the rice yield. However, the frequent use of single sd1 gene sources may cause genetic vulnerability to pests and diseases. Identifying useful novel semi-dwarf genes is important for the genetic manipulation of plant architecture in practical rice breeding. In this study, introgression lines derived from two parents contrasting in plant height, Zhenshan 97 and Pokkali were employed to locate a gene with a large effect on plant height by the bulk segregant analysis method. A major gene, ph1, was mapped to a region closely linked to sd1 on chromosome 1; the additive effects of ph1 were more than 50 cm on the plant height and 2 days on the heading date in a BC(4)F(2) population and its progeny. ph1 was then fine mapped to BAC AP003227. Gene annotation indicated that LOC_OS01g65990 encoding a chitin-inducible gibberellin-responsive protein (CIGR), which belongs to the GRAS family, might be the right candidate gene of ph1. Co-segregation analysis of the candidate gene-derived marker finally confirmed its identity as the candidate gene. A higher expression level of the CIGR was detected in all the tested tissues in tall plants compared to those of short plants, especially in the young leaf sheath containing elongating tissues, which indicated its importance role in regulating plant height. ph1 showed a tremendous genetic effect on plant height, which is distinct from sd1 and could be a new resource for breeding semi-dwarf varieties.