Shopify & SQL Expert

About the role

You'll review real merchant conversations where Shopify’s Sidekick answered an analytics or segmentation question and the merchant was unhappy — pinpoint the failing query or filter, determine what it should have been, and categorize the error against a detailed rubric.

What you'll do

• Read multi-turn merchant ↔ agent conversations, including tool-call cards and the data they return
• Identify the query or segment filter the assistant generated, and determine the correct version
• Categorize why the response fell short (wrong metric/dimension/filter, unsupported report, etc.)
• Write concise, objective explanations of what went wrong
• Commitment: ~5–10 hours/week

Qualifications

Required:

• Strong general SQL — comfortably read, write, and critique queries: WHERE vs HAVING, GROUP BY, ORDER BY / LIMIT, joins, and aggregation. You should be able to look at a query and say what it returns and what's wrong with it.

Strongly preferred:

• Hands-on Shopify merchant experience — you've run or operated a Shopify store and know how merchants actually use analytics and segmentation.
• First-hand experience using Sidekick — you've used Shopify's Sidekick AI assistant yourself.

Preferred (nice to have — we'll help you ramp on the specifics):

• Familiarity with Shopify analytics / ShopifyQL and the Shopify data model — the schemas (sales, payments, sessions, fulfillments, customers), metric nuances (e.g. net_items_sold includes returns vs quantity_ordered; revenue vs unit counts for "best-selling"), and the segmentation model (products_purchased MATCHES, operators, AND/OR connectors).
• General e-commerce / analytics ops experience.