In vivo dosimetry (IVD) has been used in brachytherapy (BT) for decades with a number of different detectors and measurement technologies. However, IVD in BT has been subject to certain difficulties and complexities, in particular due to challenges of the high-gradient BT dose distribution and the large range of dose and dose rate. Due to these challenges, the sensitivity and specificity toward error detection has been limited, and IVD has mainly been restricted to detection of gross errors. Given these factors, routine use of IVD is currently limited in many departments. Although the impact of potential errors may be detrimental since treatments are typically administered in large fractions and with high-gradient-dose-distributions, BT is usually delivered without independent verification of the treatment delivery. This Vision 20/20 paper encourages improvements within BT safety by developments of IVD into an effective method of independent treatment verification.