I realize these pages are server rendered and the SVG is being loaded after the page is loaded. But I would assume that after first load, the SVG would be cached and load super fast.
Maybe it is just a silly matter of setting an explicit width and height so the shift is not noticeable?