There are also people who have driven for 40 years without a seat belt and never had a problem. It is that one time you get into a serious accident that it becomes an issue.
You are a smart man roadfix, for reconsidering your practices. It is very possible neither you or your family have ever gotten sick from doing it, but the chance is always there. Better safe than sorry is how I see it.