I have Aero, Vanson, Eastman, and maybe another one or two brands with the side buckles, and they have never gotten in my way. The buckles do add quite a bit to the fit of the jacket. Not being big through the hips or the waist, I usually need a bit of adjustment in that area to give a good fit. This is especially true when the jacket is used as a motorcycle jacket on a cool day. A close adjustment at the hips/waist cuts down on the airflow. One brand I don't need buckles with is Johnson Leathers. Even their off the rack jackets give a close fit that requires no external adjustment.
In my opinion, you would be making a mistake in leaving the buckles off the jacket. Features, such as buckles, are there for a reason. If one starts monkeying with the basic design of the jacket, bad things sometimes happen.
I've read n some car forums that people have hosed expensive car seats like you. Me, that's why I ride and buy ***t cars lolI like them for the fit, but one of my cars has deep bucket seats and the side buckles dig into the seat leather and causes some scuffs.