Joe was the eldest son of Albert William and Sarah Ann Bacon (née Mellors). His birth was registered as 'Joe Bacon.'
His father Albert was born in South Collingham, Nottinghamshire, in 1868, the son of Joseph and Adeline Bacon. The family later moved to Alfreton, Derbyshire (1871), Stanton Hill, Skegby (1881) and Bolsover, Derbyshire (1891) by which time Albert was working as a coal miner. His mother Sarah was born in Cuckney/Langwith, Nottinghamshire, in 1869, the daughter of Charles and Ann Mellors.
Albert and Sarah were married at Norton Cuckney St Mary in April 1893 and had nine children, seven of whom died young: Annie Elizabeth birth registered 1894 (J/F/M) d. 1894, Joe b. 1895, Emma b. 1896, Adeline b. 1899, Charles William birth registered 1901 (J/F/M), Robert Harry b. 1903, Ernest birth registered 1904 (J/F/M) d. 1908, Edith b. 1906 and Ann b. 1908 (d. 1921). The census records gave the children's place of birth as Langwith (1901) and Cuckney (1911).
In 1901 Albert, a coal miner hewer, his wife and their children Joe, Emma, Adeline and Charles, were living at Cotton Mill, Nether Langwith, with Sarah's elderly widowed father, Charles Mellors, a retired labourer, and his unmarried sons, Charles and Joe, who were coal miners. Also in the household was a general domestic servant.
Albert and Sarah were still living at the same address with her father and brother Charles in 1911. Six of the couple's seven children were in the home on the night of the census: Joe, a farm labourer, Adeline, Charles, Robert, Edith and Ann who died in 1921 aged 13. The eldest daughter, Emma, was living on High Street, Mansfield Woodhouse, where she was employed as a domestic servant in the household of George Blythe, a carter, and his wife Sarah.
Joe's father died in 1930 and his mother in 1938.