The extended electrochemical stability window offered by highly concentrated electrolytes allows the operation of aqueous batteries at voltages significantly above the thermodynamic stability limit of water, at which the stability of the current collector potentially limits the cell voltage. Here we report the observation of suppressed anodic dissolution of aluminum in "water-in-salt" electrolytes enabling roll-to-roll electrode fabrication for high-voltage aqueous lithium-ion batteries on cost-effective light-weight aluminum current collectors using established lithium-ion battery technology.