Intermittent “InternetEgressBandwidth Quota” errors when fetching Bulk Operation results since Nov 23

GraphQL Admin API Troubleshooting
1

Hello,

Since November 23rd, we’ve occasionally been receiving the following error when trying to fetch data from the Bulk Operation URL (the one returned by currentBulkOperation.url):

This workload is drawing too much egress bandwidth from Cloud Storage and has exceeded the InternetEgressBandwidth Quota. This quota applies at a per-project per-region level to the egress bandwidth from regional buckets to Internet. Please reduce the rate of request. Refer to https://cloud.google.com/storage/quotas#bandwidth for more information.

This issue occurs intermittently:

  • Across different stores

  • For different sizes of JSONL files

Do you have any insight into what might be causing this error in the context of Shopify Bulk Operations, and whether there is anything we should change on our side to avoid hitting this quota?

Thanks in advance!

1 Like
2

Hey @Kacper_S Thanks for flagging this - I’ve raised it with the team that owns bulk operations infrastructure internally.

To help with the investigation, could you share a few examples of affected bulk operations? Specifically:

  • The id from currentBulkOperation (e.g., gid://shopify/BulkOperation/123456)

  • The approximate timestamp when that example download failed

In the meantime, implementing retry logic with exponential backoff when fetching the result URL should help work around the intermittent failures. I’ll follow up once I have further details to share from the Bulk Operations team, thanks again!