We demonstrate self-trapping and rotation of higher-band dipole and quadruple-like gap solitons by single-site excitation in a two-dimensional square photonic lattice under self-focusing nonlinearity. Experimental results show that the second-band dipole gap solitons reside in the first photonic (Bragg reflection) gap, whereas the quadruple-like gap solitons are formed in an even higher photonic gap, resulting from modes of the third-band. Moreover, both dipole and quadruple-like gap solitons exhibit dynamical rotation around the lattice principle axes and the direction of rotation is changing periodically during propagation, provided that they are excited under appropriate initial conditions. In the latter case, the nonlinear rotation is accompanied by periodic transitions between quadruple and doubly-charged vortex states. Our numerical simulations find good agreement with the experimental observations.