The promotion of e-commerce platforms has changed the lifestyle of several people from traditional marketing to digital marketing where businesses are made online and the concurrence reached high levels. These platforms have helped the ease of purchases while providing more advantages to the customers such as benefiting from a wide range of high-quality products, low prices, buying at any time, and more importantly supplying information and reviews about the products, and so on. Unfortunately, a plethora of companies mislead the customers to buy their products or demote the competitors' by using deceptive opinion spams which has a negative impact on the decision and the behavior of the purchasers. Deceptive opinion spams are written deliberately to seem legitimate and authentic so that to misguide or delude the customer's purchases. Consequently, the detection of these opinions is a hard task due to their nature for both humans and machines. Most of the studies are based on traditional machine learning and sparse feature engineering. However, these models do not capture the semantic aspect of reviews. According to many researchers, it is the key to the detection of deceptive opinion spam. Besides, only a few studies consider using contextual information by adopting neural networks in comparison with plenty of traditional machine learning classifiers. These models face numerous shortcomings as long as their representations are obtained while mining each review considering only words, sentences, reviews, or a combination of them, thereby classifying them based on their representations. In fact, deceptive opinions are written by the same deceivers belonging to the same companies with similar aims to promote or demolish a product. In other words, Deceptive opinion spams tend to be semantically coherent with each other. To the best of our knowledge, no model tries to obtain a representation based on the contextual relationships between opinions. This article proposes to use a capsule neural network, bidirectional long short-term memory, attention mechanism, and paragraph vector distributed bag of words to detect deceptive opinion spam. Our model provides a powerful representation of the opinions since it centers on the preservation of their contexts and the relationships between them. The results show that our model significantly outperforms the existing state-of-the-art models.