The sample averaged longitudinal two-terminal conductance and the respective Kubo conductivity are calculated at quantum critical points in the integer quantum Hall regime. In the limit of large system size, both transport quantities are found to be the same within numerical uncertainty in the lowest Landau band, and , respectively. In the second-lowest Landau band, a critical conductance is obtained which indeed supports the notion of universality. However, these numbers are significantly at variance with the hitherto commonly believed value . We argue that this difference is due to the multifractal structure of critical wave functions, a property that should generically show up in the conductance at quantum critical points.