The club was formed in 1921, and played its first competitive match on 17 September 1921, when it lost 5–1 against SAŠK Napredak. As of 2024, Željezničar is one of only four clubs never to have been relegated from the top level of Bosnian football, the others being Sarajevo, Zrinjski Mostar and Široki Brijeg.[1]
2^ During season 1991–92 all of Željezničar's matches in the second half of the season were declared void due to Bosnian War resulting in Željezničar abandoning the competition as a result of Republic of Bosnia and Herzegovina declaring independence from Yugoslavia. The return leg of club's 1991–92 Yugoslav Cup semi-final tie was scheduled to be played on May 6, 1992; but due to Željezničar club leaving the competition earlier, Partizan were awarded the 3-0 win.[4]
In seasons 2000–01 and 2011–12 the club won a double; national cup and league titles. Top goalscorer; Indicates overall top league scorer for the season.