We describe an algorithm for 3D interactive image segmentation by non-rigid implicit template deformation, with two main original features. First, our formulation incorporates user input as inside/outside labeled points to drive the deformation and improve both robustness and accuracy. This yields inequality constraints, solved using an Augmented Lagrangian approach. Secondly, a fast implementation of non-rigid template-to-image registration enables interactions with a real-time visual feedback. We validated this generic technique on 21 Contrast-Enhanced Ultrasound images of kidneys and obtained accurate segmentation results (Dice > 0.93) in less than 3 clicks in average.