Yes

"Sure, whatever" as he hands you back the rulebook

As soon as you have it back in your hands you open a new page and write:

New Rule: When the book is in someone's possession only they can notice its existence.

You breathe in relief, that could have gone sideways fast. But now the book is back in your hands and at no risk of being taken again.