I hope someone reads this and wanted to do something similar to me.

If you purchase a "3.5mm Car Boat Dash Flush USB Aux Extension Cable Lead Mounting Panel", they'll fit directly into that worthless plug near the stick. About $5 from china.
There's a few sellers, I think you can get a USB 3.0 one as well. The important part is the diameter, which of course not all sellers list.
It looks like you need a ~26mm diameter for the part that goes through, and around 31mm for the face.

I copied a picture of one that does list dimensions. Obviously, you don't need the mounting bracket.
Picture album of it installed:
https://imgur.com/a/dwm6aIx