I have a dev store with checkout extensibility preview enabled. When I install the app that has the extension (thank you and order status page targets), there is no app detected and I cannot add the block.
Thanks Kyle! It was actually a deployment issue. For some reason I had deployed but the app was not using the latest version - another redeploy resolved the issue.