From my own testing, I found at least one device which only works in Windows under VirtualBox if both the host and the guest is 32-bit, but I guess this has something to do with said device and the Windows driver. A few other device that I tested (USB memory sticks, usb TV tuner (DVB-C)) worked. But my testing was very short and limited. YMMV