An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
:
As Senior Product Analyst for AI Products, you will own the measurement of that portfolio. You will run the recurring business review, maintain the metric definitions for each product, report performance against the operating plan, and analyze retention, adoption, and the unit economics of AI usage. Your work will inform the AI roadmap and will feed into quarterly and board-level reviews.
The role is hands-on. You will write SQL against ClickHouse and Snowflake, build the reporting layer in Superset, and take responsibility for whether a figure is correct before anyone acts on it. You will work directly with the VP of Product and with the product managers who own each AI product, and we will expect you to form a view on what the data means and to defend it.
Responsibilities:
- Run the recurring business review for the AI portfolio, from building the underlying analysis through to presenting the results to product leadership.
- Define and document the metrics for each AI product, including activation, adoption, the north star metric, and penetration, and keep those definitions consistent across every report.
- Build and maintain the Superset datasets, charts, and dashboards the AI team depends on, and audit the existing reporting for hardcoded filters, stale queries, and definitions that have drifted.
- Write SQL against ClickHouse and Snowflake, including against semi-structured JSON columns, to answer the questions our dashboards cannot.
- Report each product's performance against the annual operating plan and subsequent reforecasts, and explain the variances in terms of what happened in the product.
- Analyze retention, cohort behavior, and adoption funnels at the sub-account level, and establish where and why accounts stop using a product.
- Build the unit economics of AI usage, converting token consumption into cost by model and reporting cost-to-revenue ratio and margin by product.
- Report on AI product quality, covering version-over-version evaluation results, containment and escalation rates, and the sampling design behind those figures.
- Reconcile figures that disagree between sources, and decide which source should be used to answer which question.
- Specify instrumentation with product managers before a feature ships, analyze in-product behavior in Pendo once it has, and size the opportunities and experiments that go into the roadmap.
Requirements:
- At least six years of experience in product or business analytics, including time spent working directly with product teams.
- Strong SQL skills. You should be able to write multi-CTE queries, window functions, and cohort logic without assistance; query semi-structured JSON in Snowflake; and move into Python or R for the work SQL cannot do.
- Production experience with a cloud data warehouse, ideally ClickHouse and Snowflake.
- The ability to author in Superset or Tableau, including building datasets and dashboards, and to open an existing chart definition and work out what it actually measures.
- Experience with a product analytics tool such as Pendo, Amplitude, or Mixpanel, including defining events and tracking plans.
- Experience owning a recurring metrics pack or business review that other people depended on.
- Careful attention to data grain and time period. You should check whether a figure is measured at the account or sub-account level before using it and recognize what an incomplete period does to a cohort table.
- A good command of SaaS metrics, including MRR and ARR movements, expansion and contraction, churn, retention, and ARPU.
- Enough statistical grounding to size and read an experiment honestly and to say when a result is too noisy to act on.
- Clear written English. A large part of this job is explaining an analysis in a short piece of writing that a busy reader can act on.
Bonus Points For:
- Experience analyzing an AI or LLM product, particularly token consumption, model cost, and quality evaluation.
- Familiarity with usage-based or hybrid pricing models and the reporting problems they create.
- Experience with dbt or a comparable transformation layer.
- A background in CRM, agency, or SMB SaaS products.
- Experience with subscription analytics tools such as ChartMogul.
Skills
IT Product ManagementData AnalyticsSQLPythonAI Product ManagementArtificial IntelligenceLarge Language ModelProduct QualityProduct AnalystIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Similar Jobs
View allNew Product Management roles in Remote.
One email a day. Unsubscribe any time.

