In 1892, Margolin immigrated to Ottoman Palestine with his family and settled in Rehovot. He became involved in agricultural labor and defense. Due to the death of his parents and the poor economic conditions in the region,[2] he immigrated to Australia in 1902. He then spent the next two years living in Perth, Coolgardie, Kalgoorlie, and Lawlers. He was living in the latter town when he became a naturalized Australian citizen in 1904, by which point he was working as a green grocer.[3] He spent three years working as manager of Silbert and Sharp's Menzies branch and was treasurer of the Menzies Rifle Club. In 1907, he moved to Leonora to manage the Silbert and Sharp branch there.[4] He later moved to Collie, Western Australia and ran a cordial factory.[5]
In 1911, Margolin was made second lieutenant of the Collie Half-Company of the First West Australian Infantry Regiment.[6] In August 1914, shortly after the start of World War I, he was lieutenant and commanding officer of the Collie division of the "A" Company, 86th Regiment when the division was mobilized.[7] In December 1914, he became captain of the 88th Infantry of the Australian Imperial Forces.[8] In April 1915, he was one of the first in his battalion to land in Gallipoli during the Gallipoli campaign.[5] While fighting there, his senior officer was killed and he took charge of his men until he was shot through the arm.[9] In September 1915, he was promoted to major and became second in command of the 16th Battalion.[10] He was part of the last detachment to leave Gallipoli. In June 1916, in honor of the 1916 Birthday Honours, he received the Distinguished Service Order.[11] He served on the Western Front in France from 1916 to 1917 and was wounded several times there. From June to September 1917, he was temporarily made lieutenant-colonel in command of the 14th Battalion, after which he returned to the 16th. In September 1917, he was mentioned in dispatches. He was with the 16th until he was evacuated to a London hospital with a knee injury.[5]
In March 1918, Margolin assumed command of the 39th Battalion, Royal Fusiliers.[1] He met Ze'ev Jabotinsky and volunteers from the Zion Mule Corps while serving in Gallipoli, and Jabotinsky offered him command of the Battalion, which was part of the Jewish Legion. The Battalion mostly consisted of Jewish volunteers from America and Canada and included David Ben-Gurion and Yitzhak Ben-Zvi. In the summer of 1918, he went to Palestine as the Battalion's commander. The Battalion broke through the Turkish front on the Jordan River and participated in the Capture of Es Salt. He was then made military governor of Es Salt. He also disregarded military norms by cultivating friendly relations with Palestinian volunteers in the third battalion of the Jewish Legion.[2] By August 1918, he was officially promoted to colonel.[12]
After the Armistice and the end of World War I, most of the Jewish Legion volunteers returned home. Margolin remained in Mandatory Palestine.[5] In December 1919, he became commander of the newly organized First Judaeans, which consisted of former members of the Jewish Legion. He struggled with hostility the British military had with the First Judaeans and maintained a deep relationship with the Yishuv. In the 1920 Nebi Musa riots, his men were dispersed throughout the Arab villages, with his knowledge, in an attempt to prevent further bloodshed. In March 1921, the British military replaced the First Judaeans with the Palestine Defense Force, which consisted of a Jewish unit and an Arab unit. Margolin commanded the Jewish unit. In May 1921, during the Jaffa riots, Jewish soldiers and former soldiers took arms from Sarafand military camp without Margolin's knowledge and used them to stop the riots. A day later, he arrived in Tel Aviv, mobilized soldiers and former soldiers, and provided them with military arms. This was used as a pretext to dismantle the Palestine Defense Force and what was left of the Jewish Legion. Margolin resigned to escape court marshal and returned to Australia.[2]
When Margolin returned to Australia in 1921, he bought and ran a service station in Nedlands, Perth. He then became vice-president of the local Returned Sailors' and Soldiers' Imperial League of Australia, a foundation member of the Perth Legacy Club, and president of the Naval and Military Club and the 16th Battalion Association. In 1926, he married Hilda Myrtle England. They had no children.[5]
Margolin died from a cerebral haemorrhage[5] at a private hospital on 2 June 1944.[13] His funeral was held in Karrakatta and was attended by, among other people, Brigadier Hoad of the G.O.C. and the state executives and members of the RSL. The ceremony was conducted at the crematorium by acting state RSL president E. S. Watt. He was cremated.[14] In 1950, his remains were sent to Israel and buried in a grave near his parents in Rehovot. The burial was attended by, among other people, Prime Minister David Ben-Gurion, Australian Minister to Israel Osmond Charles Fuhrman, Minister of Supply and Rationing Dov Yosef, Knesset member Yitzhak Ben-Zvi, Aloof Moshe Dayan, former Haganah commander Yaacov Pat, and veterans of the Jewish Legion. Author Moshe Smilansky delivered the eulogy.[15] His widow donated his ceremonial sword and medals to Chief of the General Staff Yigael Yadin, who accepted it on behalf of Israel and the army. Yadin turned them over to the Menorah Club, which was founded by veterans of World War I, in a ceremony attended by veterans of the Zion Mule Corps and the Jewish Legion.[16]