Small systems have higher surface area-to-volume ratios than macroscopic systems. The thermodynamics of small systems therefore deviates from the description of classical thermodynamics. One consequence of this is that properties of small systems can be dependent on the system's ensemble. By comparing the properties in grand canonical (open) and canonical (closed) systems, we investigate how a small number of particles can induce an ensemble dependence. Emphasis is placed on the insight that can be gained by investigating ideal gases. The ensemble equivalence of small ideal gas systems is investigated by deriving the properties analytically, while the ensemble equivalence of small systems with particles interacting via the Lennard-Jones or the Weeks-Chandler-Andersen potential is investigated through Monte Carlo simulations. For all the investigated small systems, we find clear differences between the properties in open and closed systems. For systems with interacting particles, the difference between the pressure contribution to the internal energy, and the difference between the chemical potential contribution to the internal energy, are both increasing with the number density. The difference in chemical potential is, with the exception of the density dependence, qualitatively described by the analytic formula derived for an ideal gas system. The difference in pressure, however, is not captured by the ideal gas model. For the difference between the properties in the open and closed systems, the response of increasing the particles' excluded volume is similar to the response of increasing the repulsive forces on the system walls. This indicates that the magnitude of the difference between the properties in open and closed systems is related to the restricted movement of the particles in the system. The work presented in this paper gives insight into the mechanisms behind ensemble in-equivalence in small systems, and illustrates how a simple statistical mechanical model, such as the ideal gas, can be a useful tool in these investigations.