I'm about 300k tracks so similar in library size. I get no issues because of that. That you have changed core device and still have some issues might suggest your issues are elsewhere e.g. network related.

I don't use NAS as live storage for music playback. I use a USB attached RAID drive. It might we worth temporarily using something similar to see if that helps. Just try a subset of library first.

Rgds,
Nick