OsteoArthritis (OA) is the most common disorder of the musculoskeletal system and the major cause of reduced mobility among seniors. The visual evaluation of OA still suffers from subjectivity. Recently, Computer-Aided Diagnosis (CAD) systems based on learning methods showed potential for improving knee OA diagnostic accuracy. However, learning discriminative properties can be a challenging task, particularly when dealing with complex data such as X-ray images, typically used for knee OA diagnosis. In this paper, we introduce a Discriminative Regularized Auto Encoder (DRAE) that allows to learn both relevant and discriminative properties that improve the classification performance. More specifically, a penalty term, called discriminative loss is combined with the standard Auto-Encoder training criterion. This additional term aims to force the learned representation to contain discriminative information. Our experimental results on data from the public multicenter OsteoArthritis Initiative (OAI) show that the developed method presents potential results for early knee OA detection.