"Let's get a little closer."
"It is OK to touch me."
So far you have given him all the right nonverbal body language cues to show that you are interested in him and you have accepted him into your space, for now. He also proved he could carry on a decent conversation, you share some common interests, and he is socialized and not weird.
Comment: But NPs are weird!
We do not necessarily respond to body language, because firstly our Intuition says something is awry, and secondly our Perception might say so. Thirdly, a third party might punch our lights out!