FLOWERING LOCUS T (FT) plays a key role as a mobile floral induction signal that initiates the floral transition. Therefore, precise control of FT expression is critical for the reproductive success of flowering plants. Coexistence of bivalent histone H3 lysine 27 trimethylation (H3K27me3) and H3K4me3 marks at the FT locus and the role of H3K27me3 as a strong FT repression mechanism in Arabidopsis have been reported. However, the role of an active mark, H3K4me3, in FT regulation has not been addressed, nor have the components affecting this mark been identified. Mutations in Arabidopsis thaliana Jumonji4 (AtJmj4) and EARLY FLOWERING6 (ELF6), two Arabidopsis genes encoding Jumonji (Jmj) family proteins, caused FT-dependent, additive early flowering correlated with increased expression of FT mRNA and increased H3K4me3 levels within FT chromatin. Purified recombinant AtJmj4 protein possesses specific demethylase activity for mono-, di-, and trimethylated H3K4. Tagged AtJmj4 and ELF6 proteins associate directly with the FT transcription initiation region, a region where the H3K4me3 levels were increased most significantly in the mutants. Thus, our study demonstrates the roles of AtJmj4 and ELF6 as H3K4 demethylases directly repressing FT chromatin and preventing precocious flowering in Arabidopsis.