brcm63xx: set usb host port number for some devices