Resolved -
This incident is now resolved. If you are experiencing stuck deployments, the "Reset Deployment State" option is available on the Site overview tab in the right-side menu. For any other components stuck in a status, please reach out to our Support team.
---
A recent deployment to Laravel Forge introduced changes to pre-existing dependencies, which caused some queued tasks to fail. Due to the nature of the error, it was not surfaced through our standard monitoring, test suite, or exception reporting processes in the expected way. Following reports of timing out processes from a number of customers, our team declared an internal emergency and halted all other engineering work to focus on the issue. The affected deployment was rolled back, and no further issues have been observed since. We sincerely apologise for any disruption caused. We are using this incident to strengthen our monitoring and response processes going forward.
Mar 5, 14:37 UTC
Investigating -
We are currently investigating an issue impacting actions in the Forge Control Panel. We have detected issues with deployments, SSL certificate generation and scheduled jobs.
Mar 5, 13:23 UTC