Urgent Request for Assistance - Complete Service Disruption

Attn: Railway Team Dear Railway Team, I hope this message finds you well. I am reaching out to inform you that we are currently experiencing a complete disruption of all services associated with our account on Railway. We have made several attempts to address the issue from our end, but so far, we have been unsuccessful in restoring normal functionality. This situation is significantly impacting our operations, and as a result, we are seeking your assistance in resolving this matter urgently. We would greatly appreciate it if you could investigate and address this situation as soon as possible. Additionally, if it is possible to provide additional information about the underlying cause of the problem and any actions we can take to prevent future disruptions, it would be very helpful. We understand that such issues can arise from time to time, and we appreciate your prompt attention to this matter. Please let us know if you need any additional information from our side to address this issue efficiently. We look forward to a prompt resolution and appreciate your ongoing cooperation. Sincerely, Jesús Quintana Esquiliche jesquiliche@hotmail.com
23 Replies
Percy
Percy7mo ago
Please provide your project ID or reply with N/A. Thread will automatically be closed if no reply is received within 10 minutes. You can copy your project's id by pressing Ctrl/Cmd + K -> Copy Project ID.
Brody
Brody7mo ago
I understand service disruptions can be frustrating but please take the time and state what issues you are running into with as much detail as possible. please also provide a project id
jesusquintana7243
Subject: Urgent: Service Halt and Deployment Issues (Service IDs: 65976b62, cf43ceab, e1f28a80, dadfc8bb, 8ae7b0d9) Dear Railway Team, We trust this message finds you well. We are reaching out to you regarding the critical situation we have recently encountered due to the halt of services and deployment issues on your servers in Western Europe. The affected services correspond to the following IDs: 1. Service ID: 65976b62-9ffc-4936-a37b-7a6f7ec26495 2. Service ID: cf43ceab-8e20-455c-9dba-506d1ed8aa45 3. Service ID: e1f28a80-c886-4712-b4bc-84f114c6ffd9 4. Service ID: dadfc8bb-50cf-40dc-8bc0-f07811e81674 5. Service ID: 8ae7b0d9-e860-4afc-b349-ba4072a6a624 Unfortunately, the halt of these services has had a significant impact as we are unable to perform deployments, causing disruptions in our operations. We understand that technical issues may arise, but we urgently require the restoration and deployment of these services to minimize the impact on our daily operations. We appreciate your immediate attention to this matter and any additional efforts you can make to resolve these issues as soon as possible. We look forward to your prompt response and appreciate your cooperation. Sincerely, Jesús Quintana
Brody
Brody7mo ago
a lot of users have had great success with this tool in order to redeploy and restore their services after the outage https://bookmarklets.up.railway.app/service-redeploy/
jesusquintana7243
Certainly! Here's the translation: --- I understand that there's a tool to redeploy services after an outage, but the process seems a bit complicated for me. Is there any other straightforward solution or another method I can use? I appreciate any additional assistance you can provide. Thank you.
Brody
Brody7mo ago
its 3 steps, please follow the 3 steps listed on the site
jesusquintana7243
No funciona
Brody
Brody7mo ago
what are you having trouble with?
jesusquintana7243
"If you can't leave the service as it was, please let me know. If it's too complicated, inform me as well."
Brody
Brody7mo ago
please follow the 3 steps on the site
jesusquintana7243
"If you can't leave the service as it was, please let me know. If it's too complicated, provide me with images or a guide on how to do it."
Brody
Brody7mo ago
the guide is on the site, follow the 3 steps please i dont work for railway and its the weekend so the team isnt available right now, im sorry but that bookmarklet is your best bet at bringing your services back online @thomas - can you check if this user was able to get their services back online? they didnt give a project id, but gave service ids, i hope that still works?
thomas
thomas7mo ago
Hey @jesusQuintana , I noticed you still have 4 services offline. With your permission I would be happy to redeploy them with the tool Brody has mentioned here. I just need your OK on this as I can't make changes to your project without your permission. These services: 65976b62-9ffc-4936-a37b-7a6f7ec26495 (not sharing names for privacy) dadfc8bb-50cf-40dc-8bc0-f07811e81674 8ae7b0d9-e860-4afc-b349-ba4072a6a624 I would like to attempt a redeploy of the most recent version on the tracked github branch.
jesusquintana7243
"Yes, go ahead. Please proceed with the redeployment of the mentioned services. I appreciate your attention and effort in this process."
Brody
Brody7mo ago
@jesusQuintana - the bug preventing you from doing a proper redeploy yourself has since been fixed, please click the 3 dot menu of the latest deployments and then click redeploy
thomas
thomas7mo ago
I went ahead and just did that for you @jesusQuintana waiting on the results now
jesusquintana7243
"I am attempting to perform a redeployment, but after approximately 3 or 4 minutes, the process fails without generating any output or apparent error message. It seems as if the deployment is either not running or disabled. I would appreciate it if you could check if the service is disabled and, if so, provide the specific reason for the deactivation." "It appears that the Docker image your team is using is not being built, and my project is built on Laravel 10 with PHP 8.1. It was functioning correctly until December 1st when the issue was detected. I am aware that my payments are up to date. Could you please investigate why the Docker image isn't being built and help resolve this issue? Thank you."
Brody
Brody7mo ago
@fp Thomas is offline right now and they've had their services offline since the outage Dec 1st
Faraz
Faraz7mo ago
Just seeing this. Could you try redeploying by pushing a new commit to the repos?
jesusquintana7243
"I have been able to deploy one of the applications that were failing by creating an installation, that is, installing the application from scratch as if it were completely new."
thomas
thomas7mo ago
Hey @jesusQuintana Do you have any updates on how this is going for you?
jesusquintana7243
Good news! Deployments have been successfully corrected. Thank you for your attention and support during this process.
thomas
thomas6mo ago
I am glad to hear that 🙂