TRRS troubleshooting
Which firmware do you have on the tidbit? I would look and see if you can figure out why your LEDs are going dim. That seems like a clue. The boards should behave and look exactly the same when connected over TRRS as they do when connected with USB. If one/both are going dim, something might not be right.