Capturing the error perception of a human interacting with a Brain-Computer Interface (BCI) is a key piece in improving the accuracy of these systems and making the interaction more seamless. Convolutional Neural Networks (CNN) have recently been applied for this task rendering the model free of feature-selection. We propose a new model with shorter temporal input trying to approximate its usability to that of a real-time BCI application. We evaluate and compare our model with some other recent CNN models using the Monitoring Error-Related Potential dataset, obtaining an accuracy of 80% with a sensitivity and specificity of 76% and 85%, respectively. These results outperform previous models. All models are made available online for reproduction and peer review.