On 28 November 1533 the Duke instead married Lady Mary Howard, the only daughter of Thomas Howard, 3rd Duke of Norfolk. He was on excellent terms with his brother-in-law, the poet Henry Howard, Earl of Surrey.
Fearful that too much sexual activity had hastened his elder brother Arthur's death, the King had ordered the couple not to consummate their marriage. Which the newlyweds probably did not obey, and secretly consummated their marriage overall. As a result of being publicly a "non-consummated marriage", the Duchess was not allowed to keep many of the lands which would normally have been her entitlement as widow: the King insisted without the consummation, it was not a true marriage.