How to use AI Chat Completion and Assistent
Does anyone have a full tutorial on how to use these two options? Inside each one there are several fields to fill in and I don't understand what to do.
Unfortunately the docs don't have much explanation https://docs.typebot.io/editor/blocks/integrations/openai#tools
For example, in this image taken from the link above, why are you using the append variable? don't get the logic
4 Replies
You append the assistant message to a Chat history variable
The Chat history is a basically a list of all the messages between user and assistant here
and we pass it to the "Dialogue" option so that it parses the entire conversation and ultimately remember things
Thanks! With the growth of the conversation history, does it spends more tokens with each response due to the size of the history? I imagine that the history is attached to the prompt + user question evertyime. I don't know if I'm thinking right here
Yes, it spends more token, that's the tradeoff of remembering the conversation!
To spend less, you could potentiatlly ask chatgpt to summarize the conversation at some point and feed the summary to subsequent OpenAI blocks
A summary, nice insight! gonna test it, thanks