Shopify - Power BI Integration

Good evening everyone,

I’m an intern in my first month of experience in the IT field, with the role of Junior Business Intelligence Technician. I’m gradually getting involved in the team’s projects and trying to orient myself as best as possible.

Recently, I was assigned the task of analyzing how to manage an integration between Shopify and Power BI, and while researching, I initially considered GraphQL as a possible solution. However, after gaining access to the store and trying to retrieve all products, I discovered there’s a limit of 250 items per call, which complicates things a bit given the volume of data expected in the project.

At this point, I’m evaluating alternatives, including:

  • using REST API or GraphQL through a Python script to overcome the limit

  • using an intermediate database to connect to Power BI

  • or adopting ready-made external connectors

I would really appreciate advice from those who have more experience and expertise than me in this field. If I’ve overlooked something or haven’t explained myself well, I’m very open to corrections!

Thanks so much in advance to anyone who wants to dedicate a few minutes to me. And of course, I’m happy to offer virtual coffee!

Unfortunately REST is deprecated so you will need to use GraphQL, you’ll simply have to paginate over the products in your store.

I’m not aware of any other way you can overcome this.

Thank you so much for your answer Luke! Can I ask you some advice to how I can do the paginate in broad terms if possible?

The docs below should guide you on how to paginate results with GraphQL.

Very kindly, thank you so much, I’m a bit new to these things, have a nice day Luke!

1 Like

@user163 : you shall use bulkOperationRunMutation to overcome this limitation.

The Shopify API query for importing products in bulk, where Shopify generates a file, is called bulkOperationRunMutation. The generated file is typically in JSONL (JSON Lines) format, accessible via the url field in the currentBulkOperation query or through the bulk_operations/finish webhook.

This will result in a file. This file then you can process via some cron script to populate your power BI system.

If there is some other challenge then do share.