Breast is a dynamic organ mainly composed of adipose and fibroglandular tissues. The adipose tissue extends from the collarbone to the underarm and around the center of the ribcage. Adipose tissue as an endocrine organ constantly affects the dynamics of the breast. However, the role of adipose tissue in breast has been mostly studied in terms of obesity and cancer. In this review, we have discussed the role of breast adipose tissue in breast development from embryonic stage to mature breast. Further, we draw attention to the involvement of breast adipose tissue in pregnancy, lactation and involution associated breast changes. Finally, we depict how breast adipose tissue can affect breast cancer.