Sludge-based biochar could be used to remove phosphate and methylene blue (MB) from water. It is a highly efficient way to treat the sludge and contaminated water synergistically. The high ash content in sludge greatly influenced the adsorption property of the resultant biochar. In this work, the influence of carbonization-activation and acid treating on the adsorption performance of the sludge-based biochar was evaluated. The composition, structure, and surface properties of biochar were improved after acid treating. The biochar was obtained in a sequence of carbonization-activation first and then acid treating, providing the optimal adsorption property. Zn550-H and Zn750-H showed excellent adsorption capacity to phosphate and MB, respectively. The adsorption process was well described by the pseudo-first-order and pseudo-second-order kinetic models. Isothermal studies implied that it was controlled by multiple processes. What is more, sludge-based biochar performed well in the adsorption of phosphate and MB from weakly acidic to alkaline conditions, which was beneficial to utilize the sludge-based biochar in water remediation practically.