Perovskite solar cells (PSC) are a favorable candidate for next-generation solar systems with efficiencies comparable to Si photovoltaics, but their long-term stability must be proven prior to commercialization. However, traditional trial-and-error approaches to PSC screening, development, and stability testing are slow and labor-intensive. In this Perspective, we present a survey of how machine learning (ML) and autonomous experimentation provide additional toolkits to gain physical understanding while accelerating practical device advancement. We propose a roadmap for applying ML to PSC research at all stages of design (compositional selection, perovskite material synthesis and testing, and full device evaluation). We also provide an overview of relevant concepts and baseline models that apply ML to diverse materials problems, demonstrating its broad relevance while highlighting promising research directions and associated challenges. Finally, we discuss our outlook for an integrated pipeline that encompasses all design stages and presents a path to commercialization.