No, he wants her for himself

"Oh, is that how it is?" Joseph spoke up defiantly, "I'm just supposed to sit back and let you have your way with my wife?"

"Because thou hast blasphemed me so," the vision darkened in tone, "thou art cursed. Neither shalt thou ever see that woman again in thy or her life!"

With that, the vision disappeared as Joseph started kicking himself for having been insolent before the LORD. Sighing, he sat back down and went back to work, trying to get that, and her, off his mind.