This study used the Musical Ear Test [Wallentin, Nielsen, Friis-Olivarius, Vuust, and Vuust (2010). Learn. Indiv. Diff. 20, 188-196] to compare musical aptitude of native Japanese and Chinese speakers. Although the two groups had similar overall accuracy, they showed significant differences in subtest performance. Specifically, the Chinese speakers outperformed the Japanese counterparts on the melody subtest, but the reverse was observed on the rhythm subtest. Within-group comparisons revealed that Chinese speakers performed better on the melody subtest than the rhythm subtest, while Japanese speakers showed an opposite trend. These results indicate that native language pitch and durational patterns of the listener can have a profound effect on the perception of music melody and rhythm, respectively, reflecting language-to-music transfer of learning.