In Bangladesh the exclusive breastfeeding rate remains low and prelacteal, formula and bottle feeding is increasing. This study aims to explore reasons behind infant formula feeding practices from mothers, caregivers, and health care provider's perspective. This was a qualitative study carried out in four sub-districts of Sylhet and Jessore of rural Bangladesh. Data were collected through focus group discussions (12), in-depth interviews (4) and key informant interviews (12) from January to February 2014. The qualitative data collected and were analyzed using thematic content analysis. This study clearly showed the factor behind formula feeding by Bangladeshi rural women. One of the major findings was that women could not differentiate between formula and other milk. Main differences between formula and powder milk were the type of consumer where formula only was taken by infant and children less than 2 years. Other major reasons include; poor breastfeeding practices, lack of appropriate breastfeeding practices, superficial knowledge on harmful effect on infant formula; perceived insufficient breast milk production, the influence of family and society and authoritarian power of hospital staff. Rural mothers have intension to feed infant formula to their infants due to various factors including individual, social, cultural and institutional. These identified factors can contribute to policy making and develop more specific interventions targeting expected mother and their family members that can contribute to stop formula feeding and increase breastfeeding practices in rural Bangladesh.