Is there any way to contact someone regarding app approval.
My app has now been rejected 5 times, each time because the reviewer failed to follow my instructions. Because of this I have to wait 1 month between submissions, and there’s no way to give very simply feedback via email to say ‘you just need to do this’ and it’ll work.
The reviewer says the app is broken but the video they send me proves they aren’t using it correctly.
Shopify - please, PLEASE improve this process.
Have you considered adding in-app guide on how to use the app when they first open it?
No, because it is more complex than that. For example, my system automatically puts 10% of people in a control group who deliberately see nothing. I explain this clearly in the tester instructions and video I provided. And yet on the times when the tester sees the control group they believe the app is broken. So I created a preview mode that bypasses this, and changed the instructions and video to tell the tester to click the preview button - they didn’t. If they can’t follow the video or instructions I don’t think in in-app guide will help.
Why do you have this weird control group? So 10% of your users are also going to see nothing and think the app is broken? That makes no sense. But if you really have to, you could detect whether it’s a Shopify reviewer using the app by checking the plan or store status and always show the data then, or just do it at first until your app is approved.
“Why do you have this weird control group?”
Control groups prove causal impact. It’s standard practise in MVT/AB/data science. Also, it’s shoppers who see nothing, not the app user. But if the app user is going to their own website acting as a shopper they may see nothing if they are put in the control group.
"You could detect whether it’s a Shopify reviewer using the app by checking the plan"
I did. That’s preview mode, but the tester didn’t enable it as my instructions told them to. This is why the whole thing is so frustrating.
Remove ab testing for review purposes. They only want to review the core functionality. I feel for you man.
Web personalisation is the core functionality of my app. If I remove it I’m not sure what they’d be testing?