The field of synthetic biology seeks to engineer reliable and predictable behaviors in organisms from collections of standardized genetic parts. However, unlike other types of machines, genetically encoded biological systems are prone to changes in their designed sequences due to mutations in their DNA sequences after these devices are constructed and deployed. Thus, biological engineering efforts can be confounded by undesired evolution that rapidly breaks the functions of parts and systems, particularly when they are costly to the host cell to maintain. Here, we explain the fundamental properties that determine the evolvability of biological systems. Then, we use this framework to review current efforts to engineer the DNA sequences that encode synthetic biology devices and the genomes of their microbial hosts to reduce their ability to evolve and therefore increase their genetic reliability so that they maintain their intended functions over longer timescales.