According to rumor, Henry Jermyn's most notable conquest was Charles's widowed sister Mary of Orange, whom he met several times during her brother's exile, and there were even stories that they were secretly married. Historians generally discount these rumors, but Charles II took them seriously, and reprimanded his sister for her lack of discretion, but with no effect: Mary sharply reminded her brother that his own love affairs hardly entitled him to judge her moral conduct. Charles was especially angry because of the similar rumors that Jermyn's uncle St Albans had secretly married the Queen Dowager Henrietta Maria. As John Phillipps Kenyon remarked, one Jermyn as an in-law would have been bad enough; two would have been intolerable.