Personally, I have been in both yours and your guy's shoes. I know how he feels, and I also know where you're coming from for the most part. It seems to me that he is investing more into the relationship than you are, and you should definitely make your feelings clear to him. Even if you like him a lot, how fair is it for you to "stay with him" if you honestly from your heart do not see a future with him. That is almost like leading him on. Give yourself time to weigh the pros and cons with being in a committed relationship with him.
Also, although he loves you, he also needs to understand that the world does not revolve around him and that it's totally okay if you're spending time with others and not him. It would turn out to be a disaster down the road if he is not okay with you and him not spending every moment together. There should be balance in a relationship.