Bidirectional ultrafast fiber lasers capable of generating counter-propagating (CP) coherent solitons are promising to be served as a dual-comb light source for the applications in spectroscopy and gyroscope. In the absence of efficient numerical model, the understanding of the operation of bidirectional fiber lasers is very limited. In this paper, we experimentally explore the pulsating dynamics of CP solitons in a bidirectional mode locked fiber laser and present a set of rich complex dynamics of CP solitons, revealing for the first time, to the best of our knowledge, the periodic breathing and acyclic pulsating dynamics of CP solitons. With a bi-directional pumping configuration, the impacts of gain distribution along the fiber on the dynamics of CP solitons have been investigated and discussed. These results provide further evidence of the universality of breathing dynamics of solitons. More importantly, the abundant dynamical behavior of CP solitons demonstrated in this paper, collaborating with a handful of previous reports on the buildup dynamics of CP solitons in bidirectional fiber lasers, underline further the independent evolving dynamics of CP solitons. These findings contribute to the understanding of how bidirectional lasers work and, consequently, will accelerate the development of bidirectional lasers in the applications such as gyroscope.