It seems they just made every store in Shopify have a request collaborator code by default.
I’ve just checked and all my dev stores, and the stores that I have access have one even if they didn’t set up.
So basically it became 10x harder to help users, I wonder how some apps get 100+reviews per day and are not complaining about this.