Missed webhooks

For the last week, I am noticing a number of webhooks are not being sent. Specifically for the orders/create topic.

It’s not all the webhooks of that topic that are missing, but maybe 10% that are not being sent.

It’s hard to rely on the logs in the dev dashboard because I know they don’t show all logs. So the webhooks not showing there doesn’t necessarily mean they weren’t sent by Shopify.

I have been running this app for 5 years and never had that issue so it seems like something is happening since last week.

Anyone else seeing this issue? Anyone on Shopify’s side can help?

Thank you

Hi @Artee

I’m not seeing any other reports of orders/create webhooks not being sent. Can you tell specifically when this started?

Hey Liam

Thanks for your reply
I took orders/create as an example because it’s the one impacting us the most, but I am seeing missed webhooks across the board since ~last Wednesday (Nov. 26)

I assumed it was due to the BFCM load, but it’s a relatively high number of webhooks that are missed (as in it’s not just 1% of webhooks but more like 5/10%)

If no other developer is seeing that it probably means that it’s on my side, but as I mentioned we haven’t had that issue in the last 5 years (including during BFCMs) so I don’t really know why that would happen now

Anyway, if you see or hear anything that is helpful, please share it. And if you can get anyone on the engineering team to have a quick look, it would be awesome

Thank you in advance!

Last week, my colleague also encountered this situation during his testing process.

DMing you for more details @Artee

@Artee @Liam-Shopify was there any conclusion to this? I’ve suspecting that for at least one of my merchants, I miss some carts/update or carts/create events. I am getting the webhook data via google pubsub, and I get millions per day - for the last few years, I have not suspected any was missing - until now.

Thanks for any info you have in this area - and let me know if further data is needed

/Peter

We believe Shopify webhooks are missing for a lot of order update events. Not seeing them in the Dev Dashboard logs and not turning up in our logs despite us having all the required scopes. Looking into our queuing and such, but feels like something could be happening similar to what was described above. Have never had this problem in the last couple years.

Any updates or news @Liam-Shopify @Artee ?

Jumping on this thread because we also noticed this issue.

We don’t see them in the dev dashboard, but we do see them in our logs. Except that a few webhooks are missing - around 35% for a given day.

We also never experienced this issue in the past.

Hi @Cedric_Vleminckx

Are the missed webhooks you’re seeing for orders too, or other event tpes?

These are also for orders. We noticed it on the orders/create topic

@Peter_Strand @Dave_W
I kept facing the issue so had to implement background jobs/tasks that check for things daily

So for example it will run daily and check if any order exists on Shopify, but not on the app (checking for missed “orders/create” webhooks)

Thanks @Artee - helpful validation, we are planning to take the same approach as we have heard that it is basically a requirement to ensure completeness due to lack of reliability on the webhooks.