[US region] Workflow - [Partial Outage]
Incident Report for Treasure Data
This incident has been resolved

Incident Details

A part of the workflow backend server was unstable during the following time, and `http>` operators could not be processed normally. Workflow tasks using “http>” operators with retry experienced delays and those without retry resulted in a workflow failure.

Incident Time (UTC)
2021-03-04 05:04 - 07:18

In addition, a similar situation may have also occurred during the following time, which may have had a similar impact.

Incident Time (UTC)
2021-03-04 01:46 - 02:39

Needed Action

CDP workflows may only delay, because auto-retries are applied automatically.
If your defined workflows resulted in an error status due to such tasks using the “http>” operator with `retry: false`, you may need to re-run them manually.
Posted Mar 03, 2021 - 23:35 PST
A fix has been implemented and we are monitoring the results.
Posted Mar 03, 2021 - 23:22 PST
We’ve observed some http tasks in the workflow are experiencing failure since 04-03-2021 05:00:00, GMT.

We have identified the root cause. Now we’re working to resolve the incident.

Only tasks access resources via http affected. Other workflow tasks are working as expected
Posted Mar 03, 2021 - 22:55 PST
This incident affected: US (Workflow).