The Verge provides us with 3 reasons why the United States has been a hold out regarding the adoption of the metric system.
Having experienced the transition to metric by Canada in the 1970's I can tell you it's not that scary, but I'll be honest I still convert in my head. I have also never referred to my height in meters or my weight in kilograms.