We analyzed the primary properties of ionic liquids (ILs) comprising quaternary phosphonium cations and bis(trifluoromethylsulfonyl) amide anions and compared them with those of corresponding quaternary-ammonium-cation-based ILs. Broadband dielectric spectroscopy was used to confirm the coupling between the translational and orientational motions of ions, and our results demonstrated that the high ionic conductivity of the phosphonium-based ILs was attributed to their fast rotational dynamics. The differences between ILs with different cations were further evaluated using vibrational (Raman and terahertz) spectroscopy. The Raman spectroscopy data revealed that the cation structure affected the conformation and flexibility (conformational change) of the anion. Furthermore, terahertz spectroscopy allowed us to evaluate the relationship between ion transport and intermolecular interactions between the cation and anion of ILs.