Although it's been hinted at in some of the other answers, your main concern should be setting the expectations for anyone that comes to see you. No one should be "visiting" new parents, because visiting implies that you are the hosts and will care for them along with your baby. Friends and relatives should only "come to help" - anyone coming into your house should expect to cook, feed you, clean up for you, perhaps even make a shopping run. And for the record, "holding the baby" is not "helping". That is the mother's job, and everyone else's job is to do things for the mother.
If you can get your relatives to accept that message, you should not have to fear them coming over, and indeed they should be relieving more burden than they impose.