The development of a proton radiography system to improve the imaging of patients in proton beam therapy is described. The system comprises gridpix based time projection chambers, which are based on the Timepix chip designed by the Medipix collaboration, for tracking the protons. This type of detector was chosen to have minimal impact on the actual determination of the proton tracks by the tracking detectors. To determine the residual energy of the protons, a BaF 2 crystal with a photomultiplier tube is used. We present data taken in a feasibility experiment with phantoms that represent tissue equivalent materials found in the human body. The obtained experimental results show a good agreement with the performed simulations.