I think it has to do with not wanting to be the first to "hang up." like being the first to leave the party, you think everyone will think you can't wait to get away from them. I too never can say goodbye (sorry Diana), and usually because I feel the other person will think I am trying to get away from them. I sure this breems of deeper issues!