Thousands of GraphQL API throttled errors from 5:30 UTC

GraphQL Admin API Troubleshooting
1

Hi there,

From approximately 5:30 UTC, thousands of throttled errors are being thrown.

No changes on our side. It seems a general issue. Please could you take a look?

1 Like
2

Hey @sinuhe :waving_hand: I checked our status page and internal monitoring and there’s nothing indicating a platform-wide throttling event this morning. GraphQL Admin API rate limits are per app+store combination, so even a broad issue would typically show up in our incident tracking if it were affecting multiple installs.

To dig into what’s happening on your end, can you share a few things?

  1. The throttleStatus object from one of the throttled responses (it’s under extensions.cost in the JSON body). The maximumAvailable, currentlyAvailable, and restoreRate fields will tell us whether your bucket is genuinely being exhausted.

  2. A couple of x-request-id values from the response headers of throttled requests, so I can look these up internally.

  3. Whether this is hitting one store or multiple.

  4. Which queries or mutations are returning the THROTTLED error.

If this is affecting multiple unrelated stores from your app, that would point to something worth investigating on the platform side.

3

Hi @Donal-Shopify ,

The problem seems to be related to only a few stores, all of them with “Development” plan. Here you are some request IDs:

aa4dae4d-90d2-4e61-ba47-80b789ceb69c-1775551677
984b44f5-5c27-4d22-9615-a359d8aca3ab-1775551676
524df76e-2fba-4150-b048-9d18aa7b5707-1775551676
f36b0dbd-5424-45f7-b8c9-4b64e4dd1190-1775551676
9248500f-2b84-4a5e-8205-150445160a7d-1775551676

6

Thanks for the request IDs and the detail about it being limited to development stores. I looked into this on our end and can see what’s causing the throttling.

I’ve raised it with the relevant team and will update this thread once I hear back.

7

@sinuhe Thanks again for the request IDs, I was able to use them to identify the cause and work with our engineers on a fix. That fix was applied as of approximately 11:30 UTC today, so the throttling on your development stores should be back to normal.

Can you confirm whether things are working as expected on your end now?

8

Hi @Donal-Shopify ,

great, confirmed, everything is back to to normal. Thanks a lot.