Bulk energy storage is generally considered an important contributor for the transition toward a more flexible and sustainable electricity system. Although economically valuable, storage is not fundamentally a "green" technology, leading to reductions in emissions. We model the economic and emissions effects of bulk energy storage providing an energy arbitrage service. We calculate the profits under two scenarios (perfect and imperfect information about future electricity prices), and estimate the effect of bulk storage on net emissions of CO2, SO2, and NOx for 20 eGRID subregions in the United States. We find that net system CO2 emissions resulting from storage operation are nontrivial when compared to the emissions from electricity generation, ranging from 104 to 407 kg/MWh of delivered energy depending on location, storage operation mode, and assumptions regarding carbon intensity. Net NOx emissions range from -0.16 (i.e., producing net savings) to 0.49 kg/MWh, and are generally small when compared to average generation-related emissions. Net SO2 emissions from storage operation range from -0.01 to 1.7 kg/MWh, depending on location and storage operation mode.