Is anyone else getting response timeouts when trying to run MageGPT locally with GPT4
Caught retryable HTTP exception while doing ChatGPT request: HttpExceptionRequest Request {
host = "api.openai.com"
port = 443
secure = True
requestHeaders = [("Content-Type","application/json; charset=utf-8"),("Authorization","<REDACTED>")]
path = "/v1/chat/completions"
queryString = ""
method = "POST"
proxy = Nothing
rawBody = False
redirectCount = 10
responseTimeout = ResponseTimeoutMicro 90000000
requestVersion = HTTP/1.1
proxySecureMode = ProxySecureWithConnect
5 Replies
This is not happening every time, but if the program generates 10 modules I am getting these errors 4-6 of the modules.
This problem is also replicated with the MageGPT hosted at WASP using 3.5 and 4. This only recently started.
This problem is also replicated with the MageGPT hosted at WASP using 3.5 and 4. This only recently started.
We don't control the open AI API 🤷🏻♂️ they maybe have problems
Maybe your prompt is too long or has bad words in it?
@foxtrotunicorn does Mage still manage to finalize the project though, or does it die on these errors? Sometimes, OpenAI API can be overloaded and therefore it rejects some requets, but Mage will try to repeat them a couple of times to make sure they go trhough. So if you saw a couple of these errors, but it finished generating all the files, then all is good, you can ignore those errors.
Also, if your description is too big, it can just take GPT4 too long to generate that initial plan, and it times out.
Okay yes it does finish, however I have had issues with hallucinations forgetting to create pages, and I have found that if I am getting time outs it seems more likely based on my testing that it forgets to create pages.
Lets say I am trying to create a large program with many modules, are there any suggestions on getting better results?
Should I try to create one module at a time and then piece it together? Would this be difficult for a beginner? I am not that great at coding...
Should I try to create one module at a time and then piece it together? Would this be difficult for a beginner? I am not that great at coding...
@foxtrotunicorn yeah that will be tricky, Mage is not yet at the level where it can produce complex web apps (we do hope to get it there with time though!).
Right now it is perfect for giving you an idea of what Wasp app looks like, and for kickstarting some smaller apps.
You could try to do what you said, module by module, but I think it will be a lot of work on your side and pretty hard, and at the end you will have to connect it all and that will also not be easy. You would probably have better luck having Mage generate a simpler version of your app and then figuring out the rest with ChatGPT4, on your own.
We plan to upgrade Mage to have an option to interact with it beyond initial generation, so you could tell it "ok, now add this" or "ok, I don't like this, please change it like this", but we are not yet there yet, possibly in a couple of months.