Smoke, fog, jelly, paints, milk and shaving cream are common everyday examples of colloids, a type of soft matter consisting of tiny particles dispersed in chemically distinct host media. Being abundant in nature, colloids also find increasingly important applications in science and technology, ranging from direct probing of kinetics in crystals and glasses to fabrication of third-generation quantum-dot solar cells. Because naturally occurring colloids have a shape that is typically determined by minimization of interfacial tension (for example, during phase separation) or faceted crystal growth, their surfaces tend to have minimum-area spherical or topologically equivalent shapes such as prisms and irregular grains (all continuously deformable--homeomorphic--to spheres). Although toroidal DNA condensates and vesicles with different numbers of handles can exist and soft matter defects can be shaped as rings and knots, the role of particle topology in colloidal systems remains unexplored. Here we fabricate and study colloidal particles with different numbers of handles and genus g ranging from 1 to 5. When introduced into a nematic liquid crystal--a fluid made of rod-like molecules that spontaneously align along the so-called 'director'--these particles induce three-dimensional director fields and topological defects dictated by colloidal topology. Whereas electric fields, photothermal melting and laser tweezing cause transformations between configurations of particle-induced structures, three-dimensional nonlinear optical imaging reveals that topological charge is conserved and that the total charge of particle-induced defects always obeys predictions of the Gauss-Bonnet and Poincaré-Hopf index theorems. This allows us to establish and experimentally test the procedure for assignment and summation of topological charges in three-dimensional director fields. Our findings lay the groundwork for new applications of colloids and liquid crystals that range from topological memory devices, through new types of self-assembly, to the experimental study of low-dimensional topology.