You might be able to use Origin Rules to override the destination port and then just have the worker
You might be able to use Origin Rules to override the destination port and then just have the worker fetch from that domain, but tbh I haven't played around with them yet. Hopefully they are in the dash sometime