Bulk operation fails on huge product catalog store

Hi there,

since a couple of weeks ago, we have a store where bulk operations to get product catalog fail at the last minute, when the operation is apparently almost complete (we can check the number of products processed and it fails when they are almost all processed).

It is true that the product catalog is huge: about 800K products and 1,6M variants. However, it has always worked in the past.

Here are the latest failures:

  • gid://shopify/BulkOperation/6212385079467, status FAILED, error code INTERNAL_SERVER_ERROR
  • gid://shopify/BulkOperation/6201293504683, status FAILED, error code INTERNAL_SERVER_ERROR

I can share the store in a private message so it doesn’t become public :slight_smile:

Please could you take a look?

1 Like

Hey again @sinuhe!

Let’s see if we can troubleshoot this publicly and help other developers who may run in to similar failures.

A common reason when I see this happening is when there’s a particular problem product that is causing the bulk operation to fail. When you look at the partial results, does it fail on the same product each time? If so, look in to that product and see if a non-bulk query for that product fails as well.

Another test you can do is try your query with fewer fields. This can help identify the specific field that may be troublesome.

From there, if the above tests are inconclusive, or if you’re not able to able to adjust your queries to work, then you can reach out to our support team directly. They will be able to review the logs and the specific products causing the internal error.