Recent progress in the generation of ultra-short laser pulses has enabled the measurement of photoionization time delays with attosecond precision. For single photoemission time delays the most common techniques are based on attosecond streaking and the reconstruction of attosecond beating by interference of two-photon transitions (RABBITT). These are pump-probe techniques employing an extreme-ultraviolet (XUV) single attosecond pump pulse for streaking or an attosecond pump pulse train for RABBITT, and a phase-locked infrared (IR) probe pulse. These techniques can only extract relative timing information between electrons originating from different initial states within the same atom or different atoms. Here we address the question whether the two techniques give identical timing information. We present a complete study, supported by both experiments and simulations, comparing these two techniques for the measurement of the photoemission time delay difference between valence electrons emitted from the Ne 2p and Ar 3p ground states. We highlight not only the differences and similarities between the two techniques, but also critically investigate the reliability of the methods used to extract the timing information.