The open science or credibility revolution has divided psychologists on whether and how the "policy" change of preregistration and similar requirements will affect the quality and creativity of future research. We provide a brief history of how norms have rapidly changed and how news and social media are beginning to "disrupt" academic science. We note a variety of benefits, including more confidence in research findings, but there are possible costs as well, including a reduction in the number of studies conducted because of an increased workload required by new policies. We begin to craft a study to evaluate the short- and long-term impacts of these changing norms on creativity in psychological science, run into some possible roadblocks, and hope others will build on this idea. This policy change can be evaluated in the short term but will ultimately need to be evaluated decades from now. Long-term evaluations are rare, yet this is the ultimate measure of creative scientific advance. Our conclusion supports the goals and procedures for creating a more open science.
Keywords: creativity; cumulative science; evaluation; future generations; policy change.