wrong number

I always pondered, how come wrong numbers never happen to call and find a busy tone? I mean I actually always answer the phone to unknown number thinking that what if somebody important tries to find me. In fact, well, I do it to avoid facing my conscience after this for not answering and having too many second thoughts. How do people generally cope with this?