New Integration: Inference.net (wholesaler of LLM inference tokens)
Portkey is now integrated with the Inference.net API, which is a "wholesaler" of LLM inference tokens for open source models like Llama 3.
Inference.net is 50-90% cheaper than leading inference providers in the market, and could be especially useful for batch inference jobs!
Check out the integration docs here.
0 Replies