He's my roommates best friend, we've hooked up but he wants to take it slow. What should I do?

We met about 7 weeks ago through his best friend who is also my roommate. I had just ended a relationship a few weeks prior (it was a short 2 month fling...and I could have avoided it had I taken my time to get to know him first before jumping into it). Anyway, we became friends, hung out around each other for about 2 weeks. One night we stayed up really late after everyone had gone to bed and he kissed me. I went to bed shortly after and he stayed on the couch. (The next day when i got up he came and gave me a long hug before he left) We continued hanging out and slept together a few weeks later when we both felt ready. He was really sweet about it and made me feel like I wasn't just a fling. Now fast forward to this past weekend, I had just gotten back from a 5 day trip and my roommates were having a party. He came over and we both were so excited to see each other that we snuck off every second we could get to make-out/mess around. Drunkenly he told me he wanted to be my boyfriend but was just afraid of the fall out if we ever broke up. He also said "I just want you to be mine...i really like you" and I told him we could wait a few more weeks to feel each other out. He seemed happy with that answer. The next night he invited me to his house to hang out with his friends and we didn't hook up. We had a sober conversation that mirrored the conversation from the night before. He said "I think we could make a good couple, i just want to get to know you better.." I agreed and we continued to lay there and watch TV. Now, fast forward again to last night. I blame my stupid mouth for bringing it up but I decided to talk about it again. This time throwing in how much I like him and how I want to take it slow because I jumped into the last relationship I had. We hooked up last night after hanging out all afternoon and I was the one who initiated it. He calls me baby, looks me in the eyes, holds my face when we kiss. He does all the sweet things. Kisses my hand, is always touching me. He calls me everyday on his break, without fail and we get really giddy around each other. I guess I just want to hear someone else's opinion that doesn't know either of us. I find myself worrying all day if he is going to call me or if we will hang out again and then he calls, and I'm back to reality. I also feel scared because of how much I like him and how well we communicate. Ive never had a guy tell me exactly how was feeling so early on.