I've hosted a few times. There are a couple of guys in Denver that live with families or roommates and can't host at all and I didn't really want to pay for a hotel room in addition to the time with the gentlemen. I haven't had any major problems.
Here are a few things I've done to make me feel a bit more confident about inviting a stranger into my place:
My apartment is rather small so I think that makes it easier. I do keep all my mail and wallet and stuff out of site. Even my computer I put away. Basically anything that will identify you, especially on that first meeting. Whatever payment is specified I put on a table out in the semi-open so they can see right away that it's there but also so we don't have to let it get in the way of anything.
Another little trick I learned is to have them text or call when they arrive and then I physically meet them outside of the building and we walk in together. Not only do I get to see them in public and do a quick "spider sense" on them, but it keeps it a bit more anonymous as my apartment has a digital directory with my last name and first initial to get in so "buzzing in" actually reveals a surprising amount of information. I also feel like meeting them outside kind of establishes that this is my space and my neighbors see that this person is with me (I have neighbors that are kind of weird with people they don't know being in the building).
In addition, I always talk to the person on the phone before I meet them just to get a sense of who they are and if they sound legitimate and cool. It doesn't have to be a long conversation, but I do like to do it if I am hosting especially. I often use the time to talk about what I would like from the experience and also to give directions and parking information. I live in kind of a busy area so it's useful to have that anyway. The one time I didn't talk to the man on the phone was one of the worst experiences I've had as a client so I kind of feel like I don't want to meet at all if I can't do that. Not that the escort did anything to compromise my anonymity or did anything to my property, but more just didn't really give me the experience that I wanted.
Just some things that I do...haven't had any problems with any privacy issues or things gone missing.