Yes, I'd avoid a switcher like the plague on the CD source to speakers where I want max SQ, but something like the Meridian switcher you mentioned might be of sufficient quality for the other sources on input-2, for sure, and pretty cheap s/h.

HC: 861v4/ID40/LPS, DSP5000, DSP5000VC, DSP3100, SW1600, HD621, Oppo BDP-105, Sony VPL-HW55ES
2-Channel: Oppo BDP-105, TEAC VRDS-7/Trichord Clock 3/PSU, 551, Quad 303, Harbeth Compact 7ES-3, Kimber cables, Russ Andrews mains and supports.
Previous Meridian: 5000C, 5200SL, 7200.2, 6000, 562V.2, 568.2mm, 800v4, 808.2i, 818v2/v3, 861v8, 502