Albert was born in Ladysmith, South Africa, and was the eldest of six sons; the others being Milton, Funokwakhe, Mehlo, Abednego, and Ngali Mazibuko]][citation needed]. He grew up on a farm.[2] Although his father Gaphu Densa believed in the importance of education[3] it was necessary for Albert to leave school early and he worked full-time on the farm between the ages of eight[2] and fifteen.[3] He worked as a manual labourer in a number of jobs[3] including working in an asbestos-making factory[1] prior to joining Mambazo. Albert joined Mambazo in 1969[4] as a tenor voice, with his brother Milton as an alto voice. Albert is the only original member left in the group and has seen many changes; whereas the early line-ups were formed of a few Shabalalas and two Mazibukos, the group largely included members unrelated to Joseph.
After the killing of his brother Milton on 26 March 1984 after the Ibhayibheli Liyindlela album [citation needed] (by which time his brothers Funokwakhe Mazibuko retired from mambazo in 1985 after the Ulwandle Olungcwele album and Ngali Mazibuko had retired from mambazo in 1974 after the Umama lo album whilst his youngest brother Abednego had joined), Albert remained in the line-up and has been a full-time member of the group since 1973.