His father, Thomas Montgomery, was a former British Army officer and a Member of Parliament for the 'rotten borough' of Lifford in East Donegal, which nonetheless returned two members to the Irish Parliament at College Green.[2] He was a brother of Colonel Alexander Montgomery (1720-1800) and a cousin of Colonel Alexander Montgomery (1686-1729), both Members of Parliament for County Donegal.