We designed and developed a confocal acoustic radiation force optical coherence elastography system. A ring ultrasound transducer was used to achieve reflection mode excitation and generate an oscillating acoustic radiation force in order to generate displacements within the tissue, which were detected using the phase-resolved optical coherence elastography method. Both phantom and human tissue tests indicate that this system is able to sense the stiffness difference of samples and quantitatively map the elastic property of materials. Our confocal setup promises a great potential for point by point elastic imaging in vivo and differentiation of diseased tissues from normal tissue.