I've spent some time investigating sudden car vs track collisions.
A part of them can be attributed to how bullet handles triangle mesh collisions. It allows to collide against triangle eges. Which is bad news for our tracks, can be fixed with edge filtering though.
There is a minor issue with edge filtering for 2d collision objects like tree billboards as you can imagine. Just get the approach angle right and you might pass through one or be pushed to the side. But then trees, masts, poles should use capsule shapes maybe.
The other source of unwanted collisions is geometry that looks like this (dirt-3 track):
Here we have road guard rails with caps. Even if there is no gap to the next wall. Bullet will hit this cap faces really hard, while you might be just sliding along the rails. This is something that can not be fixed, as the simulation is running at discrete timesteps.
For dirt-3 the rail geometry is already pre-split. The cap belongs to a separate object, so this object just needs to have collisions disabled.
I am not sure how it looks for other tracks. Sounds like a lot of work...
Anyway, I'll test the edge filtering a bit more and push it to master, as it helps already.