We use atomic force microscopy to image grain boundaries and ripples in graphene membranes obtained by chemical vapor deposition. Nanoindentation measurements reveal that out-of-plane ripples effectively soften graphene's in-plane stiffness. Furthermore, grain boundaries significantly decrease the breaking strength of these membranes. Molecular dynamics simulations reveal that grain boundaries are especially weakening when subnanometer voids are present in the lattice. Finally, we demonstrate that two graphene membranes brought together form membranes with higher resistance to breaking.