✋｜help

why is the deployment with no change failing now?

YYash

9/20/2023

ERROR: failed to solve: process "/bin/bash -ol pipefail -c apt-get update && apt-get install -y --no-install-recommends ffmpeg imagemagick ghostscript gsfonts fonts-droid-fallback fonts-noto-mono fonts-urw-base35" did not complete successfully: exit code: 1

aptPkgs = [
"...",
"ffmpeg",
"imagemagick",
"ghostscript",
"gsfonts",
"fonts-droid-fallback",
"fonts-noto-mono",
"fonts-urw-base35"
]

This did not fail earlier..

issue on production, lf help.

YYash

9/20/2023

ca440142-97f8-497c-8374-bdd45e8e3749

BBrody

9/20/2023

please send your full build logs, use this https://bookmarklets.up.railway.app/log-downloader/

YYash

9/20/2023

here you go

BBrody

9/20/2023

okay ill get to thinking

YYash

9/20/2023

Thanks. Exact same code that is now working is also failing anything changed on Railway?
I mean the old active deployment

BBrody

9/20/2023

yes, new nixpacks version

YYash

9/20/2023

Not that the deployments are successful
Ok, anything I should change in nixpacks toml?

BBrody

9/20/2023

dont know yet

YYash

9/20/2023

Okay, thanks, looking forward to hearing back

BBrody

9/20/2023

ill need to tag in @jr here, glibc 2.35 is installed but version 2.36 is required

Jjr

9/20/2023

I think it is the opposite. Version 2.36 is missing

BBrody

9/20/2023

Jjr

9/20/2023

ah right. but 2.36 is required, not 3.36

BBrody

9/20/2023

oh my bad, typo

Jjr

9/20/2023

Can you please share your nixpacks.toml file

BBrody

9/20/2023

i can reproduce this with this nixpacks.toml file

[phases.setup]
    aptPkgs = [
        "...",
        "ffmpeg", 
        "imagemagick", 
        "ghostscript", 
        "gsfonts", 
        "fonts-droid-fallback", 
        "fonts-noto-mono", 
        "fonts-urw-base35"
    ]

and a main.py file

Jjr

9/20/2023

the issue is with ffmpeg and zlib
I think
It is definitely ffmpeg causing issues

BBrody

9/20/2023

same thing with ffmpeg removed

Jjr

9/20/2023

Can you try adding

nixLibs = ['zlib']

under [phases.setup]
yes mb it is with stdenv.cc.cc.lib

BBrody

9/20/2023

adding zlib worked
whys that necessary now, but wasnt before?

Jjr

9/20/2023

you are actually removing stdenv.cc.cc.lib since the default nixLibs for python is zlib and stdenv
I am not exactly sure what the full issue is now. Looks like the glibc versions are conflicting
Can look into a more permantent fix later this week, but for now the solution is to do this https://canary.discord.com/channels/713503345364697088/1153901081282224169/1153919199303975062

Jjr

9/20/2023

This isn't all Python projects either. I was monitoring and most of them are going through. I think some combination of specific apt packages that conflcit with the stdenv glibc version

BBrody

9/20/2023

gotcha, will keep this in mind if i see this issue again
@Yash can you try the proposed solution with your project?

Jjr

9/20/2023

Please feel free to tag me in any related thread too

BBrody

9/20/2023

will do

YYash

9/20/2023

i can see it didn't fail immediatley
checking if the whole deployment goes through
ImportError: libstdc++.so.6: cannot open shared object file: No such file or directory
one of the cv2 imports is now failing, which didn't fail earlier.
no issues in build
will adding "libstdc++6"

in apt help?

BBrody

9/20/2023

try it, cant hurt

YYash

9/20/2023

trying
it says it's already installed, but waiting for the whole deployment
the product is now crashing because of this 🥲

BBrody

9/20/2023

doesnt railway keep an active build live if your service crashed in the first 20 seconds?

YYash

9/20/2023

the build went through, it failed on deploy
so the old active build is now failing

BBrody

9/20/2023

i see

YYash

9/20/2023

sharing logs here

BBrody

9/20/2023

share your requirements.txt?

YYash

9/20/2023

BBrody

9/20/2023

you have uvicorn twice and nothing is pinned to a specific version, but that wouldnt cause a "cannot open shared object file" error
you are using the headless version of opencv though so that was what i was wanting to look at
@jr any ideas?

YYash

9/20/2023

i'm going to be fixing versions later on, let me clean it up
looking into this, will this help?
https://stackoverflow.com/questions/11471722/libstdc-so-6-cannot-open-shared-object-file-no-such-file-or-directory

BBrody

9/20/2023

try it?

Jjr

9/20/2023

I'm not sure atm unfortunately. Will have to check tomorrow. You can also revert to an older nixpacks version to unstick yourself in the meantime if you would like (https://docs.railway.app/deploy/config-as-code#nixpacks-version)
Actually adding build-essential as an aptPkg might work

YYash

9/20/2023

trying it

BBrody

9/20/2023

ah yeah i totally forgot you can specify a nixpacks version

YYash

9/20/2023

what was the last version of nixpacks?

BBrody

9/20/2023

just look back on the last build where everything worked and use that version

Jjr

9/20/2023

I wouldn't recommend as a long term solution since you won't get any updates (system/os/security). But in cases like this is can help

YYash

9/20/2023

just as long as i get the solution

BBrody

9/20/2023

let us know how adding build-essential works

YYash

9/20/2023

yes, waiting
didn't work

YYash

9/20/2023

is this correct way to pass the build?

YYash

9/20/2023

sorry this:

BBrody

9/20/2023

put

[build]
nixpacksVersion = "1.15.0"

above [phases.setup]

Jjr

9/20/2023

f yeah the stdenv.cc.cc.lib package is what provided the libstdc++.so header
This has to go in a railway.toml file 🙈

BBrody

9/20/2023

has to be a railway.toml?

Jjr

9/20/2023

Yes

YYash

9/20/2023

so created another file for this and deployed
removed nixlibs

Jjr

9/20/2023

Just for the nixpacksVersion. Railway looks at that to determine what Nixpacks version to use. And then Nixpacks looks at nixpacks.toml for the build config (yes a mess we know)
Can revert the nixpacks.toml file to what it was before and jus tset the version

YYash

9/20/2023

yes, doing that

BBrody

9/20/2023

"nixpacksVersion" is in the json schema for railway.json too, if thats more your thing

YYash

9/20/2023

this?

it worked just find without a json

YYash

9/20/2023

ok it worked with v15
the old version

BBrody

9/20/2023

thats not valid toml
https://docs.railway.app/deploy/config-as-code#nixpacks-version

YYash

9/20/2023

yes sent like this it went through

YYash

9/20/2023

since its working with the old version, is this something railway team will investigate?

BBrody

9/20/2023

https://discord.com/channels/713503345364697088/1153901081282224169/1153920151754915841

Can look into a more permantent fix later this week

YYash

9/20/2023

cool, thanks man!
appreciate your help.

BBrody

9/20/2023

jr did all the work

YYash

9/20/2023

https://tenor.com/view/thank-you-guys-so-much-i-love-you-kevin-hart-david-dobrik-what-the-fit-gif-16626533
appreciate all the work that was done here

Jjr

9/20/2023

Glad it is working now!

Zzlapp

9/20/2023

I'm having a similar issue:

nixpacks.toml:

[phases.setup]
nixPkgs = ['...', 'libreoffice']
aptPkgs = ['...', 'gcc', 'g++','libstdc++6','fontconfig']

0.341 apt-get: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.36' not found (required by /nix/store/xpxln7rqi3pq4m0xpnawhxb2gs0mn1s0-gcc-12.3.0-lib/lib/libstdc++.so.6)

-----

 

Dockerfile:9

-------------------

7 |     COPY .nixpacks/nixpkgs-5148520bfab61f99fd25fb9ff7bfbb50dad3c9db.nix .nixpacks/nixpkgs-5148520bfab61f99fd25fb9ff7bfbb50dad3c9db.nix

8 |     RUN nix-env -if .nixpacks/nixpkgs-5148520bfab61f99fd25fb9ff7bfbb50dad3c9db.nix && nix-collect-garbage -d

9 | >>> RUN apt-get update && apt-get install -y --no-install-recommends gcc g++ libstdc++6 fontconfig

10 |

11 |     ARG NIXPACKS_METADATA OPENAI_API_KEY PYTHONUNBUFFERED RAILWAY_ENVIRONMENT RAILWAY_ENVIRONMENT_ID RAILWAY_ENVIRONMENT_NAME RAILWAY_GIT_AUTHOR RAILWAY_GIT_BRANCH RAILWAY_GIT_COMMIT_MESSAGE RAILWAY_GIT_COMMIT_SHA RAILWAY_GIT_REPO_NAME RAILWAY_GIT_REPO_OWNER RAILWAY_PRIVATE_DOMAIN RAILWAY_PROJECT_ID RAILWAY_PROJECT_NAME RAILWAY_SERVICE_ID RAILWAY_SERVICE_NAME SENDGRID_API_KEY SERPAPI_API_KEY

-------------------

ERROR: failed to solve: process "/bin/bash -ol pipefail -c apt-get update && apt-get install -y --no-install-recommends gcc g++ libstdc++6 fontconfig" did not complete successfully: exit code: 1

 

Error: Docker build failed

Zzlapp

9/20/2023

Trying this fix

Zzlapp

9/20/2023

Looks like this fix worked

Looking for more? Join the community!

✋｜help

✋｜help

Recommended Posts

websocket: bad handshake with gorilla websocketsi have a websocket server running on railway with a custom domain, and when going to the websocket r Refund requestHello, I haven't used your service for a while and overlooked the need to unlink my card. Can I plea How can I add a json file to my mongoDB with railway?I have a json file containing all of the record my project needs, it is called `sectorA` I want to a could not receive data from client: Connection reset by peerI'm having issues with the DB connection, keep getting: `could not receive data from client: Connect java.lang.UnsupportedClassVersionErrorHow fix it? I use java 19 Add domain to webapp - how?I initially (½ year ago), added my domain under settings - setup the records as described, and it wa Error adding TCP proxy - Not AuthorizedHello I deployed a service based on a docker image, in order to connect to the service I try to set A way to increase the build timeoutI would like to know if there is a way to increase the build timeout, as I have a very large nextjs TLS handshake timeout during transition from build to deployMy sites have been failing to deploy the whole day + yesterday. I see that this was an issue multipl save file on file system not foundi've create api to save file to public files after i upload new file on railway host, 404 where i Can I create an environment from a secondary branch of a GitHub repository?Hello, I have a Node.js web app on Railway, and I'm looking for a way to create a second instance f Server becomes unresponsiveCan someone please help me figure out what occurred Saturday? Our production site was not accessible Project with cron job aways skippedWhy my project nevers run with cron Maximum of 4 volumes per project?Heya 🌞 I have several services and would need to attach another volume to one of these but it get a Any way to skip redeployment if github ci is skipped?Here's what I see on dashboard, railway is granted all accesses in my org on github. On github I ca Build Error after RedeployRecently, I've been facing a weird error whenever I redeploy my railway instance from the dashboard.Restarting database not working.My postgres database wont restart. All data is not modifiy after restaring it.Adding support for python with isolated-vm npm packageHello, I am using a project that requires the isolated-vm npm package (https://www.npmjs.com/package Listmonk; Static FilesNot sure why my post was deleted, but here it is again: Hello, I've deployed Listmonk on Railway, ConcurrencyWill concurrent requests to a single endpoint work? And where would the logs appear for each individ