No remove purchase option button in product page

We are trying to add subscription functionality to our app, but ran into the issue that in some cases there is no X button to remove the subscription option from the product. As far as we can see from the docs, this should be Shopify’s responsibility (see below), but we are nevertheless not seeing that icon.

While trying to reverse engineer the reason for this we noticed that that button is visible when we are adding the purchase option to the product manually from the product page, however, when we are adding it from our Shopify Admin app using the sellingPlanGroupCreate mutation, the purchase option gets added, but not the X remove button (second image below).

When adding it manually from the product page:

When adding it from the app using a GraphQL mutation:

We can’t figure out why this might be the case and there is no documentation on this that we could find. Does anyone have a better insight into when that button is present and when it is not?

Thanks!