Maintenance and system recovery have been fully completed. The scheduled database maintenance is now complete. The downtime was about 30 seconds in total.
Posted Dec 05, 2023 - 17:09 PST
Verifying
Verification is currently underway for the maintenance items.
Posted Dec 05, 2023 - 17:08 PST
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Dec 05, 2023 - 17:00 PST
Scheduled
On December 5, 2023, 17:00 to 18:00 PST (December 6, 2023 01:00 - 02:00 UTC), the backend databases supporting the Treasure Data system will undergo a short maintenance.
# Impact During the maintenance window, the RDS backend databases supporting the Treasure Data Platform will undergo a PostgreSQL version upgrade. During this time frame, despite the one-hour window, the databases will only become unreachable for no longer than 3 minutes in total. Customers will experience momentary failures, instabilities, or service unreachable for all services. As we approach the end of the maintenance, services will gradually return to their full throughput and operations. During the database upgrade period, customers may observe the following symptoms:
- Jobs execution delay Presto and Hive jobs that use Policy-based Column-level Access Control (https://docs.treasuredata.com/display/public/PD/Policy-based+Column-level+Access+Control+Permissions ) will be delayed and will be automatically retried until they succeed after the downtime period. - Presto JDBC / ODBC Gateway return errors during downtime The Presto JDBC / ODBC Gateway will return errors during the downtime period when Policy-based Column-level Access Control is enabled for the target resource.
- Console execution delay Data Workbench and Audience Studio will show that jobs are running longer due to underlying job execution delay during the downtime period when Policy-based Column-level Access Control is enabled for the target resource. - Policies operation in Console and CLI will not be functional Policy-related operations in the console and CLI will not be functional during the maintenance when Policy-based Column-level Access Control feature is enabled. Once the maintenance is complete, you will be able to perform Workflow related operations. - Running workflows and scheduled sessions delay and failure Running workflows and scheduled sessions whose underlying jobs use Policy-based Column-level Access Control will be delayed and automatically retried after the downtime period. However, workflows and sessions will fail if they’re running for more than a few minutes during the shutdown process. It would be greatly appreciated if you would review the failed workflow and re-execute it after the service is up, if necessary.
# Communication Beyond this notice, we will provide updates approximately one hour before the beginning of the maintenance window, at the start and completion of the operation, and once the verification is completed. At that time, all systems will have returned to full functionality and the Scheduled Maintenance will be closed. If you have any questions or concerns about this maintenance, please feel free to reach out to our Support team at support@treasuredata.com.