He takes the key.

You watch as the opens the envelope and looks inside, tipping the envelope he takes the key in hand and places in his pocket. He has accepted your invitation. You purposely avoid him for the rest of the day and get back to your work.