Lord Aldridge is the son and heir of the Duke of Haverford and his wife, Eleanor, Duchess of Haverford. Born in 1780, he was an only son until he was seven, and raised mostly by servants in the nursery of Haverford Castle until he was nearly eight. He saw his father seldom, and his mother only when she was in residence, and then for brief visits each day.

He has always been called, even by his mother and siblings, by the title that descended upon him at birth. His full name, however, is Anthony James, Edward Timothy Grenford, Marquis of Aldridge.

Shortly after his brother Lord Jonathan, was born in 1787, their mother made room in their home for their older half-brother, David Wakefield, son of the Duke of Haverford and the daughter of a man who managed one of Haverford’s mines in Wales. Aldridge adored David, and was heartbroken when the Duke exiled him when Aldridge was twelve.