Railway Crash

In my main project it looks my volume migrations has crashed and is preventing from any deployments being made in my account (see screenshot with applying progress bar) In a new project (second screenshot) I try to recreate the services and deployment seems stuck with "This volume is undergoing a migration." message. Can someone fix this?
No description
No description
40 Replies
Percy
Percy5d ago
Project ID: 8d879f33-f85b-48af-9456-051141e48b4d
Charles_
Charles_5d ago
8d879f33-f85b-48af-9456-051141e48b4d
angelo
angelo5d ago
Naive question, how large is your storage on the volume? !t
Duchess
Duchess5d ago
New reply sent from Help Station thread:
This thread has been escalated to the Railway team.
You're seeing this because this thread has been automatically linked to the Help Station thread.
Charles_
Charles_5d ago
single digit Gb
Charles_
Charles_5d ago
Delayed builds (Hobby disabled) - Incident details - Railway - Status
Delayed builds (Hobby disabled) - Incident details - Railway Status
angelo
angelo5d ago
That shouldn't cause any weirdness then. That's unrelated, flagging.
Charles_
Charles_5d ago
are you sure? All my builds are freezing (tried in both Hobby and Pro workspace)
angelo
angelo5d ago
I misunderstood, thought it was purely based on the migration. How long has it been stuck in this state, 20 minutes?
Charles_
Charles_5d ago
I'd say about an hour
angelo
angelo5d ago
Understood, escalating.
Charles_
Charles_5d ago
thanks, this is the second project which is also still stuck - I suspect as a result of the migration in the first project 8d879f33-f85b-48af-9456-051141e48b4d
No description
angelo
angelo5d ago
Flagged.
Charles_
Charles_5d ago
If you're able to do any anything that resembles a "hard reset" on this project that'd be much appreciated so I get this back up asap
angelo
angelo5d ago
Can you try making a new service? We can then move the volume.
Charles_
Charles_5d ago
on it actually the volume doesn't really matter (downloaded on launch) - it can be discarded I just need to get services back up
Adam
Adam5d ago
Can you not recreate the service from a gh repo? if the volume contents don’t matter, that should be the easiest solution Not in the same project, create a new project
angelo
angelo5d ago
Oof, team is working on this, what's weird is that this project is in a weird state but not seeing much other reports. Investigating.
JustJake
JustJake5d ago
Sorry this doesn't look stuck?
JustJake
JustJake5d ago
No description
Charles_
Charles_5d ago
correct, looks like the build went through! it seems as if the volume migration was culprit...
JustJake
JustJake5d ago
? It looks fine Where's the error
Charles_
Charles_5d ago
There's two projects: 1. Original project (still bugging out) 2. Recreated project (now working)
JustJake
JustJake5d ago
Link original plz
Charles_
Charles_5d ago
this one
angelo
angelo5d ago
That one shows that it's working.
Charles_
Charles_5d ago
Not working: c5ad221b-8b00-4b24-b8c9-eac5b00a9054 Working: 8d879f33-f85b-48af-9456-051141e48b4d
angelo
angelo5d ago
Railway
Railway
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
JustJake
JustJake5d ago
I unstaged the change there for you. Can you try re-applying it?
Charles_
Charles_5d ago
done if they don't go through feel free to discard them
JustJake
JustJake5d ago
I'm reseting this, please leave it for now. I'm going to dig into why it's not working
Charles_
Charles_4d ago
let me know when project can be deleted
JustJake
JustJake4d ago
We're still working on this internally. Probably 24h from now or so
Charles_
Charles_4d ago
ok np
Charles_
Charles_4d ago
Hi team - same issue as above but on different project, volume migration is frozen... Can you please help? https://railway.app/project/f1b5f347-c845-4e49-a7a2-c861816cffd6 Thanks!
No description
angelo
angelo4d ago
Got eyes on, raising. So this will take some time as of late because of load.
Brody
Brody4d ago
oh it just went through extra context, im working with charles on the team this project is in. the service has been in Singapore long before adding a volume, its strange that adding a volume would need any kind of migration
angelo
angelo4d ago
Yea, actions will go through, they are just taking very long.
Brody
Brody4d ago
what was most odd is that the ui told us that it was being migrated to us-west
Duchess
Duchess4d ago
New reply sent from Help Station thread:
Yep, that's likely an issue with out error messaging but most everything is tied to workflow bottlenecks that we are facing with our queues, builds, settings, and migrations.We are still triaging.
You're seeing this because this thread has been automatically linked to the Help Station thread.