Does he love me or not, im so confused!?

Don't think so. He has plenty of time to talk/ hang out with that other girl, and he won't physically touch you, most likely because the girl was around. He might be cheating on you.