The exact mechanisms of spontaneous tumor remission or complete response to treatment are phenomena in oncology that are not completely understood. We use a concept from ecology, the Allee effect, to help explain tumor extinction in a model of tumor growth that incorporates feedback regulation of stem cell dynamics, which occurs in many tumor types where certain signaling molecules, such as Wnts, are upregulated. Due to feedback and the Allee effect, a tumor may become extinct spontaneously or after therapy even when the entire tumor has not been eradicated by the end of therapy. We quantify the Allee effect using an 'Allee index' that approximates the area of the basin of attraction for tumor extinction. We show that effectiveness of combination therapy in cancer treatment may occur due to the increased probability that the system will be in the Allee region after combination treatment versus monotherapy. We identify therapies that can attenuate stem cell self-renewal, alter the Allee region and increase its size. We also show that decreased response of tumor cells to growth inhibitors can reduce the size of the Allee region and increase stem cell densities, which may help to explain why this phenomenon is a hallmark of cancer.
Keywords: Allee effect; Cancer stem cell; Stable Manifold Theorem; Tumor extinction.