We study the statistical properties of active Ornstein-Uhlenbeck particles (AOUPs). In this simplest of models, the Gaussian white noise of overdamped Brownian colloids is replaced by a Gaussian colored noise. This suffices to grant this system the hallmark properties of active matter, while still allowing for analytical progress. We study in detail the steady-state distribution of AOUPs in the small persistence time limit and for spatially varying activity. At the collective level, we show AOUPs to experience motility-induced phase separation both in the presence of pairwise forces or due to quorum-sensing interactions. We characterize both the instability mechanism leading to phase separation and the resulting phase coexistence. We probe how, in the stationary state, AOUPs depart from their thermal equilibrium limit by investigating the emergence of ratchet currents and entropy production. In the small persistence time limit, we show how fluctuation-dissipation relations are recovered. Finally, we discuss how the emerging properties of AOUPs can be characterized from the dynamics of their collective modes.