Report the whole matter to your grandfather

The next morning, you went to meet grandfather with Inoue. The two of you bowed at the man and then you announced you got Inoue pregnant. Your grandfather was quiet for a long time as the two of you sat facing him.

"From this moment,you would be known as Doe Inoue. With your new family name, comes the responsibilities and privileges it accords you. Do not besmirch it."

"Yes, My Lord," Inoue answered.

"The ceremony would be held this weekend. I will send people to prepare the uchikake set for you," he said, referring to the white wedding kimono called uchikake with a white headdress. "You may go."

Inoue left the room, leaving you alone with your grandfather.

"You're surprisingly alright with me marrying her."

Your grandfather nodded. "I shouldn't complain, since I asked you to make a child, and you did, with a woman of the trade. It is a surprise, but inconsequential."