The supervised sleep staging methods are challenged by their strict requirements of a labelled and large dataset. This study considers an unsupervised dimensionality reduction method, the Deep Boltzmann Machine (DBM), trained to a transient state for binary classification of sleep stages. First, the joint time-frequency domain features from the polysomnographic recordings are extracted. Second, the extracted features are smoothed using 2 min rolling window to include contextual temporal information, and finally, they serve as an input for unsupervised training of DBM_transient. The results show that our method effectively separates the sleep stages in two-dimensional feature space with a large Fisher's discriminant value. The classification performance by the DBM_transient achieves a 96.1% F1 score, which is higher than DBM converged to an equilibrium state (95.2%), Principal Component Analysis (92.5%), Isometric Feature Mapping (95.9%), t-distributed Stochastic Neighbor Embedding (94.9%), and Uniform Manifold Approximation (95.0%) on the widely used sleep-EDF database. Additionally, Fisher's discriminant function demonstrates the superiority of the DBM_transient. The significance of the DBM transient lies in its ease of interpretability in two-dimensional space, and future multi-class implementation of the method may facilitate its usage in clinical applications.