Github actions suddenly failing
Context
- IOC Setup where Coder templates live in a github repo in different folders and github actions validate updates to them and then push them out to our Coder instance
- Github actions that we're working a week ago are suddenly failing with endless red herrings in the logs
Example Output
Have gone back and forth a ton with my human brain and AI brains but at this point I wonder if it even has anything to do with Coder at all.
6 Replies
What are you creating this issue for?
Good lord this is frustrating. Part of our CI/CD is to create a temporary workspace to test everything and then clean up and delete that workspace once validation passes.
My next debugging step was to remove the cleanup phase so that I could terminal into the test workspace and dive into the logs.
So I remove the cleanup phase of our pipeline and viola, validationa and everything passes instead of fails.
Like I said, the validation was failing on templates that we're passing a week ago, so I don't think this has anything to do with tempaltes or scripts, and more to do with github or some external issue. I'm happy things started working again but I still have no idea why they started to fail in the first place. Just restored the cleanup portion of the validation script that I removed and all validation checks are passing again. So something external resolved itself and I have no idea what, which means I get to sit here and wait for this thing to happen again randomly after wasting a day debugging nothing apparently.
So I remove the cleanup phase of our pipeline and viola, validationa and everything passes instead of fails.
Like I said, the validation was failing on templates that we're passing a week ago, so I don't think this has anything to do with tempaltes or scripts, and more to do with github or some external issue. I'm happy things started working again but I still have no idea why they started to fail in the first place. Just restored the cleanup portion of the validation script that I removed and all validation checks are passing again. So something external resolved itself and I have no idea what, which means I get to sit here and wait for this thing to happen again randomly after wasting a day debugging nothing apparently.
After going HARD on the debug logs I think I got the the issue
Run actions/upload-artifact@v4
With the provided path, there will be 2 files uploaded
Artifact name is valid!
Root directory input is valid!
Error: Failed to CreateArtifact: Artifact storage quota has been hit. Unable to upload any new artifacts. Usage is recalculated every 6-12 hours.
More info on storage limits: https://docs.github.com/en/billing/managing-billing-for-github-actions/about-billing-for-github-actions#calculating-minute-and-storage-spending
So nevermind me
GitHub Docs
About billing for GitHub Actions - GitHub Docs
If you want to use GitHub Actions beyond the storage or minutes included in your account, you will be billed for additional usage.
hey @Ryan Wiancko apologies for the delay, has this worked after that usage recalculation?
hey @Ryan Wiancko closing for staleness, let me know if you still need help :)
@Phorcys closed the thread.