What does Shopify's storefront performance testing stand look like?

Hi everyone,

Last year we’ve been working a lot towards the goal of achieving BFS. We are now making our 3rd iteration of changes :melting_face:. Every time among other required changes there was this: “App must not reduce Lighthouse storefront speed by more than 10 points.”

Until recently, indeed, it was the case — if you enabled some of the app’s features at the same time, it could have slowed a storefront down by more than 10 Lighthouse points. But last Fall we did a lot of testing and optimizations and eventually managed to reduce the impact on loading speed. In December I personally conducted a series of tests on my pretty slow 2019 Intel macbook air. Even with ALL of the app’s features enabled in the test store the worst result I could get over several measurements was 8 points performance reduction. Other tries resulted in 0-6 points reduction.

Nevertheless, when we applied for BFS again one week before Christmas, we still received the same feedback. This leaves me in confusion, because now we cannot reproduce the issue and, therefore, cannot work on it.

That’s why I’d be happy to know what Shopify’s testing environment looks like. What machine/system/browser/store settings are being used? This may help us reproduce the issue and, eventually, fix it.

Thanks.

P.S. The app I am talking about is this one Searchanise Upsell, Popup&Bars - Searchanise – Upsell & Marketing – Shopify App Store | Shopify App Store

1 Like

Hi Mikhail, the way we do storefront tests is detailed here: Storefront performance

Hi Benji,

Thank you for your reply.

I’ve studied this doc thouroughly before opening the topic. I followed the described procedure, but couldn’t reproduce results of the reviewer. That’s why I wonder, maybe the answer is hidden in some details not outlined in the document.