Ideational apraxia is characterized by impaired knowledge of action concepts and proper object usage. The present functional magnetic resonance imaging study aimed at investigating the neural system underlying conceptual knowledge for proper object use in healthy subjects, when the effects of visuospatial properties and perceptual modality were taken into account. Subjects performed semantic decision tasks requiring retrieval of knowledge about either object functional purposes (functional task) or visuospatial object properties (visuospatial task) and perceptual control tasks. The semantic tasks were performed with pairs of either written object names or object drawings. Activation for the functional task in common for words and pictures, compared with the visuospatial and control tasks, was found in left parietal-temporal-occipital (PTO) junction, inferior frontal, anterior dorsal premotor, and presupplementary motor areas. Ventral inferior frontal cortex activation correlated negatively with reaction time in the functional condition. No specific activation characterized the visuospatial task compared with the functional task. The conceptual tasks, compared with the control tasks, demonstrated overlapping activation in left PTO junction, prefrontal, dorsal premotor, cuneus, and inferior temporal areas. These results outline the neural processes underlying conceptual knowledge for proper object use. The left ventral inferior frontal gyrus might facilitate behavioral decisions regarding functional/pragmatical object properties.