Deploy logs stopped appearing after a manual redeploy

Hi, I have a project running several services. Deploy logs for one of the services randomly stopped appearing within the dashboard. The logs still appear fine in our “Development” environment but have stopped working in the “Production” environment. I noticed the deploy logs stopped appearing after manually triggering a “Redeploy” from the service menu. I’ve also tried restarting, redeploying, and pushing a code change to trigger a full rebuild.
I have experienced this with another service, however, the logs started randomly appearing after some time. Project ID: d80407b4-a520-4fc9-acec-d8bf622dc449 Service ID: eb5da072-e189-4fab-b4d1-0918eb0425d6 Service name: scheduler
P
Percy41d ago
Project ID: d80407b4-a520-4fc9-acec-d8bf622dc449,eb5da072-e189-4fab-b4d1-0918eb0425d6
B
Brody41d ago
is the app in the production environment using a different logger?
R
ryan41d ago
same configuration + logger
D
Duchess41d ago
New reply sent from Help Station thread:
Since you are business class, I will go ahead and mark this thread as private so that the team can look into this matter. locking the discord thread in favor of the help thread.
You're seeing this because this thread has been automatically linked to the Help Station thread.
B
Brody41d ago
me ^
D
Duchess41d ago
New reply sent from Help Station thread:
can you provide some extra information before I go ahead and do that, like for example, what logger you are using?
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
Yeah, it's a Django project using structlog. There is a processor that turns these logs into json format. Three of the services (platform-api, platform-worker, scheduler) use this logger with the same configuration. Prior to the that logger even being initialized, we run some echo statements in the start up script.
#!/bin/bash

set -e

# Railway recommends sleeping for 3s when using private networking due to an initial delay
# in dns resolution
echo "Sleeping..."
sleep 3

echo "Starting scheduler..."
celery -A config.celery beat --loglevel=INFO
#!/bin/bash

set -e

# Railway recommends sleeping for 3s when using private networking due to an initial delay
# in dns resolution
echo "Sleeping..."
sleep 3

echo "Starting scheduler..."
celery -A config.celery beat --loglevel=INFO
These logs have stopped appearing entirely.
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
What's also interesting is that I can see a single log entry in my deploy logs now in the production environment. But it appears to be missing the entire start up logs which includes the shell script and the structlog/json format logs of the app itself.
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
is the app running though?
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
Since you are business class, I will go ahead and mark this thread as private so that the team can look into this matter. locking the discord thread in favor of the help thread. I'm not sure that we're actually business class -- so that's why I started in Discord. We were put on the business class plan as a trial but we never ended up converting
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
is the app running though? Yes
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
I am trying to attach a screenshot but cant figure out how. But to the best of my knowledge, it's running? The scheduler service is a celery beat process which is used to schedule async tasks. The tasks are being scheduled and ran. The single log line that I referenced a few messages back indicates it's queuing up the tasks.
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
I'm not sure that we're actually business class -- so that's why I started in Discord. We were put on the business class plan as a trial but we never ended up converting maybe you'll consider converting if the team can swiftly resolve this issue :) I am trying to attach a screenshot but cant figure out how. at the moment these forums don't support uploading attachments. I think there's enough information here now, going to make this private right now! (I will lose access to this thread)
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
(hidden)
You're seeing this because this thread has been automatically linked to the Help Station thread. New reply sent from Help Station thread:
(hidden)
You're seeing this because this thread has been automatically linked to the Help Station thread.
Want results from more Discord servers?
Add your server
More Posts
ENOTFOUND redis.railway.internalFirst time using railway. I'm on team plan which says it supports private networking. I have a simplError: libuuid.so.1: cannot open shared object file: No such file or directoryGetting this error with puppeteer on Railway. ``` node:internal/modules/cjs/loader:1239 return pro"Error: connection already closed."I keep getting this error message when I attempt to update a user in my PostgreSQL database. I do noUnable to update Variables in App. (First Update after Migration)Hey Guys, my App tries to connect to the old containers of my postgres and redis. I checked the variImage Storagehello everyone, can I use Postgresql to store the images which my users upload in django-project?Setup Cloudflare Proxy1. Clicked "custom domain". 2. Railway pops up a CNAME for me to add to Cloudflare. 3. Add CNAME recDirectus: impossible to update or to run the old versionProject ID : 9be34f5b-fa35-49c1-83c5-f0fbd245db9b Template : https://github.com/kadumedim/directus-sCSV files in storage/app/data/csv not accessible?Hello, I've setup a laravel api on railway. I have a seeder that tries to load csv files from the I have not touched my project in several weeks but at midnight railway reverted to a very old versioI'm very confused it looks like my project was deployed last night, although I have not touched it iI can't add DNS from GoDaddy to RailwayThey recommend me to change the server name...Unable to connect database after payentHello, i just pay for the month, now i'm unable to connect to the database. please help1,2GB RAM usage in React APPDo you know if it's normal this size of ram in a frontend created with react and typescript?Shopify proxy and HTTP/1.0Hello, I need help from members using Railway to host a Shopify app. I ran into this problem where Is it possible to change the default config of a Mysql Container?By default the container uses up a minimum of 500mb of ram, I found a stack overflow post on how to Cannot link, login nor logout with cli>railway logout 🚨 Response not successful status=404 >railway login 🚨 Response not successful staLost 2FA code for my accountI have lost my 2FA authenticator codes and I would like to reset my accountHow does it work the HD allocationI need 360gb to use how much does it cost?how to restore postgres db from dumb?i was given my db archives because my db was deleted due to migration. I am trying to restore the dbActivate SSL on my custom domainHello, I bought the domain apocolinks.com at DreamHost.com, this domain already has an active SSL ceBest way to secure postgres?What would be the best way to secure my postgres instance from outside connections? I would just tur