We highlight the importance of the delay arising from optical filters in slow-light-based microwave phase shifting systems. We calculate the filter delay numerically from the measured amplitude response by using the well-known Kramers-Kronig relations. The complex filter transmission response is then incorporated within a numerical model with which we explain phase shifting results obtained from experiments employing semiconductor optical amplifiers as slow light elements.