Hughes had English, Welsh and some French Huguenot ancestry, and was a descendant of John Gano (1727–1804), the minister who allegedly baptized George Washington.
His uncle Rupert authored a scholarly bio of George Washington that broke ground in demythologizing him.