The optical and magneto-optical (MO) properties of magneto-plasmonic nanocomposite films made up of a transparent polymer with a dispersion of cobalt ferrite (CFO) nanoparticles (NPs) and different concentrations of Au NPs are investigated. The volumetric concentrations of CFO and Au NPs, around 3%, and below 7‰ respectively, are below the percolation limit, and hence the nanocom-posite films constitute models for investigating the influence of the electromagnetic field generated at the surface plasmon resonance of Au NPs on the magneto-optical properties of CFO NPs. The plasmon resonance is present in these magneto-plasmonic composites, red-shifted with respect to the bare Au NPs and covering the spectral region where charge-transfer and crystal field MO transitions can be excited. Moreover, the magneto-optical hysteresis loops were measured in the whole spectral region. We observe that the hysteresis loops shape is a fingerprint of the different MO transitions of the CFO NPs. The strength of the MO peak around 750 nm, corresponding to the Crystal Field transition is damped respect to the corresponding peak of the CFO NPs. The strength of this peak evolves non-monotonically with the Au NPs concentration. On the other hand, the MO band around 550 nm, excited by Charge Transfer transitions, changes sign when Au NPs are present. In addition, a second MO contribution is observed. Our results demonstrate that the interactions between plasmon resonance and MO effects are not only determined by the stronger local electromagnetic fields at the resonance but they depend on the type MO transition that is involved in these oxides. This study helps to understand and design the magneto plasmonic nano-structures and applications, for example in biomedicine and sensing, in which random and weak dipolar interparticle interactions between plasmonic and magnetic nanostructures are present.