I like the suggestion that cracauer@ made to use a USB card with four (4) separate controllers, so each controller can be assigned to a different VM.
I need a clarification; can a single "dumb" PCIe USB card (without individual controllers) be assigned to more than one (1) VM as long as only a single VM runs at any given time? Or, do you have to have one of the PCIe cards with individual controllers (like: https://www.amazon.com/gp/product/B00HJZEA2S/ref=ox_sc_saved_title_5?smid=ATVPDKIKX0DER&th=1 ) with each controller assigned to a different VM, even if only a single VM runs at any time?
I hope that makes sense.

Ed
I need a clarification; can a single "dumb" PCIe USB card (without individual controllers) be assigned to more than one (1) VM as long as only a single VM runs at any given time? Or, do you have to have one of the PCIe cards with individual controllers (like: https://www.amazon.com/gp/product/B00HJZEA2S/ref=ox_sc_saved_title_5?smid=ATVPDKIKX0DER&th=1 ) with each controller assigned to a different VM, even if only a single VM runs at any time?
I hope that makes sense.
Ed