We numerically investigate the interaction of vectorial solitary waves propagating in a bulk crystal with a phase-matchable quadratic nonlinearity. We obtain coalescence, steering, crossing, or repulsion by controlling the launched intensities in two orthogonal polarizations without any coherent seed at the second harmonic.