I’m starting to automate the testing process for my Shopify app and I’m curious how other developers are using Playwright in real-world projects.
I’m interested in testing not only the app inside the Shopify Admin, but also app extensions and the user interactions around them (clicks, form submissions, settings changes, etc.), not just visual checks.
How have you set up your Playwright tests? What workflows or scenarios are you automating, and what has worked well for you?
I’m trying to reduce manual testing as much as possible and avoid human errors before releases.
What I would do is to use playright only before a release. Because the Shopify limitations make it slow to seed a test environment.
I’d probably setup a base store using a CSV import for products, and have playwright helpers to integrate with Shopify API to run the assertions against what you create/update (products, metafields, etc…).
I’d make it so the tests can run on an existing store without having to reset it from scratch. But the feasibility depends on the nature of your app. For example if your app is just about updating given products, it’s doable, you can spin up new products just for the tests and ignore existing ones. If your app is aggregating data from the whole history of the store, it might not work well without a full reset.
Just some thoughts - haven’t had time to set this up and test yet.