You actually feel like his son

You don't feel like a wife, you feel like his son so you say "I know I kinda look like mom...I am.not her dad".

Hugh understands your change and adjusts immediately to your new role "Sorry son, I didn't mean to offend you...I just...let's just say daddy had a long day at work and can't think straight" he looks tired and really beaten up.

While the characters and their relationship type changes the set up that Hugh gave originally did not.

So it's up to you know to take the next step-