We present measurements of the temperature dependence of the electrical resistivity ρ(T) of CeRhSn up to ~27 kbar. At low temperatures, ρ(T) varies linearly with T for all pressures, indicating non-Fermi liquid behavior. Below Tf ~ 6 K, ρ(T) deviates from a linear dependence. We found that the low-T feature centered at T = Tf shows a pressure dependence ∂Tf/∂P ≈ 30 mK kbar−1 which is typical of canonical spin glasses. This interplay between spin-glass-like and non-Fermi liquid behavior was observed in both CeRhSn and a Ce0.9La0.1RhSn alloy.