R
Railway
โ๏ฝhelp
save temporary archives
Can i save temporary pdfs to a back-end host ?
I'm trying to save a pdf file from a client upload but can't, have any form to do that ?
I'm trying to save a pdf file from a client upload but can't, have any form to do that ?
it's a front-end calling a back-end api, and fron't gives a pdf, back-end need to saves to camelot read, and after that give back a archive to front
Use railway volumes, saving directly into your service will cause it to be deleted at every redeploy/deploy
hmmmm
nice, i will see that
nice, i will see that
If u don't need it to be persistent, theres no problem with that
noo it's like a temp archive
ever persons to call will give the same name, temp_pdf... and exclude after
i will try volumes
ever persons to call will give the same name, temp_pdf... and exclude after
i will try volumes
volumes are meant for persistent files, and they cost an additional 0,25USD/Gb/month
slow down here
brody knows better
I'm trying to save a pdf file from a client upload but can'tyou have yet to tell us why you "can't"
in my locally server i just save in the src directory like "./temp-pdf.pdf' and debugging the server in rail, the app just don't save this
can't have access to this pdf
can't have access to this pdf
my local is like this
i trying to give a buffer or something
i trying to give a buffer or something
oh rail = railway
noo
this is python
aaa brody
is you
you helped me like 30 mins ago hahahah
with the opencv2
is you
you helped me like 30 mins ago hahahah
with the opencv2
indeed
okay so lets slow down here
do you see a print 4
in the deployment logs
okay so lets slow down here
do you see a print 4
in the deployment logs
yeees
i will send some screens
a sec
i will send some screens
a sec
and then i assume there is no error printed from the catch?
the 6 i did'nt see
but you dont see error logs?
hmmm
you are calling me ?
you are calling me ?
no?
wtf.. my discord is souding but i did'nt see the call
sorry
a sec
hm
i not debbug, only prints
sorry
a sec
hm
i not debbug, only prints
i have not called you, or have ever called anyone in #help
sorry
show me the deployment logs please, use this https://bookmarklet.up.railway.app/log-downloader/
okaay
i will download
i need to drag this
i will download
i need to drag this
yes
you dont have a bookmarks bar
oh i see that now, i will se a video, really don't know what is this
i come back in some minutos for study this
oh nice
i will send the logs
[2023-08-25 17:27:41 +0000] [1] [INFO] Starting gunicorn 20.0.4
[2023-08-25 17:27:41 +0000] [1] [INFO] Listening at: http://0.0.0.0:5737 (1)
[2023-08-25 17:27:41 +0000] [1] [INFO] Using worker: sync
[2023-08-25 17:27:41 +0000] [10] [INFO] Booting worker with pid: 10
1
2
3
4
5
i come back in some minutos for study this
oh nice
i will send the logs
[2023-08-25 17:27:41 +0000] [1] [INFO] Starting gunicorn 20.0.4
[2023-08-25 17:27:41 +0000] [1] [INFO] Listening at: http://0.0.0.0:5737 (1)
[2023-08-25 17:27:41 +0000] [1] [INFO] Using worker: sync
[2023-08-25 17:27:41 +0000] [10] [INFO] Booting worker with pid: 10
1
2
3
4
5
this came with the txtr
logs
logs
you didnt use the bookmarklet but okay
sorry for long time response
i use
see
i use
see
is coming the same
message of direct consol
message of direct consol
cool but then you where just supposed to send that file here
ok
it doesnt matter now
show me a screenshot of your service metrics
i assume this code does work locally?
yes, work
it is an application that takes a pdf from an educational institution (transfers it from one to another) and treats it, the flow is basically this, it sends the pdf through an api, the back-end saves this pdf, treats it, and sends it to return an excel
it is an application that takes a pdf from an educational institution (transfers it from one to another) and treats it, the flow is basically this, it sends the pdf through an api, the back-end saves this pdf, treats it, and sends it to return an excel
try adding this as a nixpacks.toml file in your project
[phases.setup]
aptPkgs = ['...', 'ghostscript', 'python3-tk']
okay !
apt packages gathered from here https://camelot-py.readthedocs.io/en/master/user/install-deps.html#os-specific-instructions
nice, added
stay in the 5 print
stay in the 5 print
send me the build logs please
okay
can you implement the Ghostscript and Tkinter checks this docs page shows you? (for ubuntu)
https://camelot-py.readthedocs.io/en/master/user/install-deps.html#checks-to-see-if-dependencies-are-installed-correctly
https://camelot-py.readthedocs.io/en/master/user/install-deps.html#checks-to-see-if-dependencies-are-installed-correctly
YES
will do that a sec
hmm... not correctly
will do that a sec
hmm... not correctly
explain
Giving back
None
None
show me the code you implemented
Okay
i give this in out of app and in
i give this in out of app and in
but my local return None too
yeah because locally you are using windows?
'-'
will test
with the windows
sorry.
D:\gs10.01.2\bin\gsdll64.dll
yes, local is ok
will test
with the windows
sorry.
D:\gs10.01.2\bin\gsdll64.dll
yes, local is ok
okay but that's irevlent, we already knew it worked locally
will try to redeploy
and see if it's work
will print the current directory files too
to see if it's saving the archive
and see if it's work
will print the current directory files too
to see if it's saving the archive
what version of python do you use locally
yes.. it's saving
locally i use...
3.11.4
3.11.4
why do you have a
phases.setup
filewhen I was trying to solve it by searching the internet, I had created... it was an error
i will delete
i will delete
try this instead
[variables]
NIXPACKS_PYTHON_VERSION = '3.11'
[phases.setup]
nixPkgs = ['...', 'ghostscript', 'python311Packages.tkinter']
aptPkgs = ['...', 'ghostscript', 'python3-tk']
okay
have the "-" ?
sending the log
have the "-" ?
sending the log
i updated it
building
will change version
of pdftopng
to 0.1.0
None ๐ฆ
nixPkgs = ['...', 'ghostscript', 'python311Packages.tkinter']
aptPkgs = ['...', 'ghostscript', 'python3-tk']
for use the version older
like 39.13
3.9..13
in the python311packages
can change it ?
of pdftopng
to 0.1.0
None ๐ฆ
nixPkgs = ['...', 'ghostscript', 'python311Packages.tkinter']
aptPkgs = ['...', 'ghostscript', 'python3-tk']
for use the version older
like 39.13
3.9..13
in the python311packages
can change it ?
show me your current nixpacks.toml file
show me a screenshot of your service variables please
that is not what I asked for
sorry.
I asked for your railway service variables
my english not too good
okay
i will print
a sec
okay
i will print
a sec
do you happen to have a runtime.txt file?
didn't have
show me a screenshot of your backends project files
okay
can you make sure you have that temp.pdf file in your gitignore and that you go and remove that pdf file from your github repo
okay
done
done
changed this too
lets see
lets see
why
do you not use 3.11 locally?
do you not use 3.11 locally?
i use 3.11, i see venv
and venv
is in the 3.9.13
and venv
is in the 3.9.13
why would your venv be a different version
i really don't know... i just start the project with the pycharm, and will se the venv now
it is in the 3.9
๐ข
okay
now servers up
it is in the 3.9
๐ข
okay
now servers up
the gs don't find
I think it may be time to move to a Dockerfile
Oh nice
My tech lead saw the same thing :c
i will study it
Buuuut, for now, thank u so much, u are very smart men
I will do a docker for this
My tech lead saw the same thing :c
i will study it
Buuuut, for now, thank u so much, u are very smart men
I will do a docker for this
dockerfile*
I can write one for you, I'm just eating right now
I can write one for you, I'm just eating right now
i really don't know nothing from infra / docker
^
oh nice
i'm doing one here, viewing what gonna result hahaha
can i add u on disc ?
i'm doing one here, viewing what gonna result hahaha
can i add u on disc ?
no thank you
nice hahahah
i will do the docker
thanks for the help men !!
i will do the docker
thanks for the help men !!
dockerfile*
but once done, show me it please
but once done, show me it please
okay
i be back
i be back
version: '3.4'
services:
anima:
image: node:14 # Use a versรฃo adequada do Node.js
container_name: anima
ports:
- "3000:3000" # Mapeie a porta do container para a porta do host, se necessรกrio
volumes:
- ./anima:/app # Mapeie o diretรณrio do cรณdigo-fonte do frontend para o container
working_dir: /app
command: sh -c "npm install && npm start" # Comando para iniciar o frontend
mvp-achievement-rates:
image: python:3.9 # Use a versรฃo adequada do Python
container_name: mvp-achievement-rates
ports:
- "8000:8000" # Mapeie a porta do container para a porta do host, se necessรกrio
volumes:
- ./mvp-achievement-rates:/app # Mapeie o diretรณrio do cรณdigo-fonte do backend para o container
working_dir: /app
command: sh -c "apt-get update && apt-get install -y ghostscript && pip install -r requirements.txt && python main.py" # Comando para iniciar o backend
database:
image: postgres:13 # Use a versรฃo adequada do PostgreSQL
container_name: database
ports:
- "5432:5432" # Mapeie a porta do container para a porta do host, se necessรกrio
environment:
POSTGRES_DB: Databases
POSTGRES_USER: postgres
POSTGRES_PASSWORD: 1789
volumes:
- postgres_data:/var/lib/postgresql/data # Volume para persistรชncia dos dados do banco
volumes:
postgres_data: # Defina o nome do volume para persistรชncia dos dados do PostgreSQL
that is not a dockerfile
thats a docker-compose
thats a docker-compose
i'm doing a compose
railway does not support docker-compose
hmmmmm
so i will do a dockerfile
so i will do a dockerfile
yeah i kept saying dockerfile everytime you said docker
like this
i will do in the front / back and i do no, tomorrow
show to u
show to u
that is not an ideal dockerfile
but it is a dockerfile, ill give you that much
but it is a dockerfile, ill give you that much
nice, tomorrow send to u
have a good night, cya
have a good night, cya
you too!
running on railway now, but i can't acess the api
send me the dockerfile, I'll fix it for you
FROM python:3.9
RUN apt-get update && \
apt install libgl1-mesa-glx -y && \
apt-get install 'ffmpeg'\
'libsm6'\
'libxext6' -y && \
apt-get install -y ghostscript && \
apt-get clean
WORKDIR /app
COPY . /app
RUN pip install -r requirements.txt
CMD ["python3", "main.py"]
i try to do with the debian:bookworm but some error ocurred
yeah i know
and i do that with the base py:3.9
ill fix it
thank you
send me your requirements.txt file too please
aiohttp==3.8.5
aiosignal==1.3.1
async-timeout==4.0.2
attrs==23.1.0
blinker==1.6.2
camelot-py==0.11.0
certifi==2023.7.22
cffi==1.15.1
chardet==5.1.0
charset-normalizer==3.2.0
click==8.1.6
colorama==0.4.6
cryptography==41.0.2
distro==1.8.0
et-xmlfile==1.1.0
flask==2.3.3
Flask-Cors==4.0.0
frozenlist==1.4.0
ghostscript==0.7
greenlet==2.0.2
idna==3.4
importlib-metadata==6.8.0
itsdangerous==2.1.2
Jinja2==3.1.2
lxml==4.9.3
MarkupSafe==2.1.3
multidict==6.0.4
numpy==1.24.4
openai==0.27.8
opencv-python==4.8.0.74
openpyxl==3.1.2
pandas==2.0.3
pdfminer.six==20221105
pdftopng==0.2.3
Pillow==10.0.0
psycopg2==2.9.7
pycparser==2.21
pypdf==3.14.0
pypdf2==3.0.1
python-dateutil==2.8.2
python-docx==0.8.11
pytz==2023.3
requests==2.31.0
six==1.16.0
SQLAlchemy==2.0.20
tabula-py==2.7.0
tabulate==0.9.0
tqdm==4.65.0
typing-extensions==4.7.1
tzdata==2023.3
Unidecode==1.3.6
urllib3==2.0.4
werkzeug==2.3.7
yarl==1.9.2
zipp==3.16.2
are you using all those?
yees
what variable did you give to your flask app? app or main?
like this
add
gunicorn=21.2.0
to that list, but dont push changes yetthe same
of yours
olay
okay
of yours
olay
okay
give this dockerfile a shot
and once you changed your dockerfile for that one, push your changes
FROM python:3.9
ENV PYTHONUNBUFFERED="1"
ENV PIP_DISABLE_PIP_VERSION_CHECK="1"
RUN apt-get update && apt-get install -y --no-install-recommends \
libgl1-mesa-glx \
ffmpeg \
libsm6 \
libxext6 \
ghostscript \
&& apt-get clean
WORKDIR /app
COPY . /app
RUN pip install -r requirements.txt
CMD gunicorn main:app
and once you changed your dockerfile for that one, push your changes
okay
my bad
i edited the dockerfile message
i edited the dockerfile message
WOOOOOOOOOOOOOOOOOW
this workssssss
this workssssss
awesome
thank you
so much !
so much !
no problem!
will use docker file ever now, hahahahah, have a good night !! ๐
you too!
the finally thing, the guicorn have how to configure the works ?
show me a screenshot of your metrics please
Why'd you send that twice
i do another request
for view the actual
for view the actual
nothing really changed
k, sorry
how long should an http request take locally?
here an GPT response like 1~~2sec
something in your code took longer than 30 seconds, that is the default timeout from gunicorn
should a request ever take longer than 30 seconds?
should a request ever take longer than 30 seconds?
no, i have a treatment in responses that take more than 10sec, retry
i will try do to a time.sleep
why would you want to make the function take longer??
could it be giving an error, because it makes many requests quickly?
should a request ever take longer than 30 seconds?
because every request he makes takes around 1 second, and he makes maybe more than 1000 per execution
no, no
no, no
then there is a bug in your code
from the user, requested the api
yes
this take like 4~~5 minutos
yes
this take like 4~~5 minutos
30 seconds is the default timeout from gunicorn
aaaaaaaah okay
for the user
for the user
i just asked you and you said no ๐
i think you say in the application
like, in the back-end
i do only request like 12 sec, but muchs requests
like 1000 1500
and return to the user the answer
but it's take 5 minutes, i really don't undertand the starter question, sorry.
like, in the back-end
i do only request like 1
like 1000
and return to the user the answer
but it's take 5 minutes, i really don't undertand the starter question, sorry.
running locally what is the total request time the client will see
like 5 minutes
is that normal?
yees
5 minutes for one single network request?
yes, it's an AI project I'm working on, which treats school transcripts based on pdfs, and returns the answer of where it should go when changing course, or institution.
There are many requests, treated with chatGPT in search of similarities in the school grade
There are many requests, treated with chatGPT in search of similarities in the school grade
one single network request that the client does takes 5 minutes? are you sure? you have been unsure in the past
yes, take, when i call the api
the response for client, take like 5 minutes
the response for client, take like 5 minutes
alright then add
--timeout 360
to the end of the CMD command in the dockerfile, this sets the request max timeout to 6 minutesokay
now, this work fine
thank u agaaaain
and all solved ๐
now, this work fine
thank u agaaaain
and all solved ๐
for sure this time lol
Looking for more? Join the community!
R
Railway
โ๏ฝhelp
R
Railway
โ๏ฝhelp
Recommended Posts
How to host websockets?This is my first time hosting socket server, how can i do that on railway? I docs there are only webI cannot use opencv2 and received ImportError: libgl.so.1 cannot open shared object file no such filCan anyone help me with that ??LibreofficeHi I need libreoffice installed to use in my code.
I attempted using the below nixpacks.toml
```
[Random app crash, no logs or other indicatorWhen trying my healtcheck I get random crashes, no recent deploy was made, I don't see any logs on mModify build commandHow would I modify the build command so it does a pip install of `psycopg2` ?
I was told to remove tPayment method removalHey, how do I remove my payment method? I opted in for a credit subscriptions but still see my crediDeploying crashedHello, i'm facing a problem when deploying my spring boot application to railway, my application worInternal server error when accessing TypebotI noticed that since yesterday the new installations with the Typebot template present the error IntRAILWAY_PUBLIC_DOMAIN replaces RAILWAY_STATIC_URLHi team, we've been hunting down a bug with our app today, occurring on many PR Environments and it'My Subscription issueHello dear support guys:
I found that I have been downgraded to No Subscription.. If my memory is rIs it normal for hello world json to return in 600ms? - GO FIBERHelp setting up a monorepoI'm getting this error when deploying my project. I made sure no other deployments are running, but Deployment and logging issues (Maven)Hello,
My program is running fine locally, but when I deploy it with Railway, I start seeing issuesIssues with Postgres DBI don't really understand why I am not seeing any tables in my DB.
Seeding works, but the database sversion 'GLIBC 2.29' not foundweird error that seems to be because of my code, but it works on my computer <:bing_shrug:5837915814Use rust nightlyidk how docker works but i cant use the nightly rust dockerfile image for some reasonFix Missing libuuid LibraryHey, I am currently runnig into problems deploying my FastAPI backend after adding a new dependency I can no longer connect to my MySQL database, even after restarting the databaseI'm not sure what my project id is. My link is this:
https://railway.app/project/31b9ee92-06cc-44c1-RPC showing forbidden access 403Hi. I've got some crypto related script which pings an RPC server - it works fine locally but on raiHow would I connect my project with the SQL database ?I have a model for users and I would like to populate my production DB with them. How can I do that?