I switch to the input for the phono stage I hear a moderately loud pop
This could be a difference in ground levels, or a DC offset in the phono stage.
After doing a few tests earlier I left the system on for a few hours. I tried switching inputs again and now I hear no popping noise.
As above, the offset may have levelled out over time, this points to (very) tired power supply capacitors.
You could try linking the earth points on the phono stage and the 502 to make sure there is no difference in ground levels, but this could lead to an earth loop hum, but cheap and easy to try.
All the best,
Steve