Summary
As our investigation of the incident is complete, we would like to provide you with more detailed information about the incident that occurred on January 8, between 06:51 a.m. and 08:45 a.m. (CET), leading to errors with user actions - including updates, creation of news or posts, as well as email click and open tracking.
What happened
Our internal server messaging system experienced connectivity issues after a regular restart. This led to some sent internal server messages not being processed as intended on the German system. By adjusting the configuration responsible and implementing additional resilience measures, we were able to correct the behavior and fully restore the availability.
Impact
Between 06:51 a.m. and 08:45 a.m. (CET), our system reported issues when performing updates on the Employee App & Intranet as well as some click rate actions on Staffbase Email. Some update and publishing actions could not be performed and led to error messages.
Future improvements
We will implement additional checks for the operation of the affected service component and optimize the subsequent alerting to ensure that no more outages will occur due to lost syncs after regular restarts. Thank you for your patience and understanding while we work to improve our services and prevent future incidents. If you have any questions or concerns, please do not hesitate to reach out to our customer support team at support@staffbase.com.