I am working to this end as well (dual boards with differing CAM firmware). I plan on using (3) push on-off 8-pole SPDT switches as a master controller selector. I have all the parts but I have yet to start on the wiring. I’m documenting my build in this thread. We should compare notes. Right now it’s less than a minute to switch servos, power and USB.