The comment here suggests that attempting changes to $ms will likely have negative impacts.
Is your Gcode created in inch or mm? Inch moves create some inaccuracy dues to conversion calculations, you could try mm but doubtful it will help.
You could also try turning off arc (G2 and G3 moves), which will generate just linear moves with different computations but nearly identical results.
It sounds like your Gcode is unnecessarily detailed, can you dial back the precision in the Gcode generator or it’s post processor?
.
