Google Cloud API outage — Northwind impact

InvestigatingP1Started 17:51 UTCT+5 · 0 h 05 mReplay · 12 Jun 2025
17:56 UTCSomething's wrong
T+5
T+10
T+20
T+60
T+110
T+130
T+190
T+220
Report
5 active claims

Claim ledger

as of 17:56

What we believe, by certainty

CONFIRMED

Stated by the provider or seen in our own systems

2
C-001Since 17:51 UTC customers can't reliably log in or use our API
1 source · Internal · since 17:52
New
C-005Google Cloud's status page shows no incident
1 source · Provider · since 17:56
New
REPORTED

Credible outside reports; not confirmed by the provider

0

None at 17:56

CONFLICTING

Credible sources disagree; both sides kept

0

None at 17:56

UNCONFIRMED

One unofficial source or speculation. Not evidence

1
C-002Google Cloud may be having problems (GCP console, us-east1)
1 source · Community · since 17:56
New
Would be settled by: Google Cloud's status page, or more independent reports
UNKNOWN

Questions nobody can answer yet

2
C-003Root cause
No sources yet
New
Would be settled by: The provider stating the cause on the record
C-004When our service will recover
No sources yet
New
Would be settled by: Our monitoring returning to baseline, or a provider estimate

OUR ACTIONS

R-4Next update

Bridge 18:10 · customers within 30 min

Incident lead · 17:56
R-3Action

Triage: recent changes, our code vs Google API calls, GCP console access. No rollback until a change is implicated

Engineering lead · 17:56

Updates

Reference data

What we'd say, every sentence cited

For leadership on the bridge. Max 120 words.

Policy (customer update)

Applies to the customer update. Internal updates always include reported items, labelled.

New · Confirmedbecause
New · Unconfirmedbecause
New · Unknown

Executive update · as of 17:56 UTC

Reference draft

SITUATION

P1 declared at 17:56 and the incident bridge is open.

IMPACT ON US

Since 17:51, customers can't reliably log in or use our API, confirmed by our own monitoring.

CONFIRMED

No cloud provider has declared an incident: Google Cloud's status page shows none.

NOT YET KNOWN

We don't yet know whether the cause is ours or a provider's.
One public post asks whether Google Cloud is having problems; that is unverified.

WHAT WE'RE DOING

Engineering is checking recent changes and whether errors come from our code or from Google API calls.
A customer holding statement is published.

NEXT UPDATE

Next update at 18:10.

Key facts used

CONFIRMED

Since 17:51 UTC customers can't reliably log in or use our API

CONFIRMED

Google Cloud's status page shows no incident

UNKNOWN

Root cause

UNCONFIRMED

Google Cloud may be having problems (GCP console, us-east1)

✓ Verified 8/891 / 120 words