alternative to openai

If I have an alternative "open AI compatible" API endpoint can I configure mage to use that instead? is all you need a completion endpoint? function calling too i assume
1 Reply
martinsos
martinsos12mo ago
Currently we actually don't use function calling yet (but we might want to in the future). So yeah, at the moment it is only a completion endpoint. But Mage is currently hardcoded for OpenAI, and I don't think we are ready to invest time into making it more agnostic, we don't really have the manpower to maintain more agnostic logic I am afraid.
Want results from more Discord servers?
Add your server