Getting Extension Registration not found error while migrating app to CLI for the first time

Now with Shopify CLI 3.85.5, you get the new error:

An error occurred while attempting to migrate the extension type from app_link to app_link.