alot of good info here and tonight on site. You say he works in the medical field but do you know this? Everyone here has great advice...esp rushing into things. Someone said waiting awhile is best and that seems best. You Really don't know this person except a week of texting- ? Better to be cautious, have a friend at a nearby table, let people know where you're going and when coming back, take a friend etc if you're going to go right off. Pressure is something that makes my head think...why? In todays world, any person would reasonably understand if you said lets get to know each other a bit more. I know I'm not one to give advice since am new to this but little alarms went off when reading your words. Vague knowledge of him. From him? No offense.

You have only talked on the phone once.
You do not know what hours he works, do you know his occupation?
I think you should wait awhile.