Senior Product Manager, Inference

About the Role

Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads.

We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.

As inference becomes a larger part of our business, the product surface is becoming more complex. Workloads span different tenancy, capacity, performance, and modality needs; agentic applications are changing how inference is consumed; and customers increasingly expect deep infrastructure capabilities to translate into predictable, easy-to-use products.

This role owns the product layer between Together’s inference infrastructure and the developers and enterprises consuming it. You’ll help define how our portfolio of inference products fits together, where Together should differentiate, how customers move from experimentation to production, and how the developer experience evolves as workloads become more sophisticated.

This is a hands-on technical product role. You’ll use our APIs and SDKs, study real workloads, test integrations, and work closely with inference platform engineers and researchers to turn infrastructure and model capabilities into clear product decisions and customer experiences.

Responsibilities

• Shape the inference product strategy. Define how Together’s portfolio should serve different customer needs across tenancy, capacity, performance, workload patterns, and modalities.
• Own the developer experience around inference. Improve our APIs, SDKs, compatibility, and integrations across applications, coding agents, frameworks, and developer tools.
• Build for emerging workloads and modalities. Understand how agentic, voice, multimodal, batch, and other workload patterns are changing what customers need from inference infrastructure, and translate those shifts into product direction.
• Turn infrastructure and model capabilities into customer-facing products. Work closely with inference platform engineers and researchers to understand capabilities and constraints across performance, routing, caching, reliability, capacity, and model behavior, and translate them into the right abstractions, guarantees, and controls for customers.
• Connect product decisions to business outcomes. Shape pricing and packaging alongside Finance and GTM, and use adoption, inference consumption, utilization, unit economics, and customer expansion to prioritize where we invest.
• Stay close to customers and the product. Talk with developers and enterprise teams, inspect usage patterns, test workflows yourself, and use that context to form a clear point of view on what we should build and what we should not.
• Drive products from idea to production. Partner closely with engineering, research, sales, partnerships, finance, and other teams to make tradeoffs, align around priorities, launch, and iterate.

Requirements

• Strong product judgment and the ability to take an ambiguous technical problem, identify what matters, make tradeoffs, and develop a clear point of view.
• Meaningful experience building or owning APIs, developer tools, infrastructure, cloud platforms, data systems, AI products, or another technically deep product.
• Strong technical depth and curiosity. You can work credibly with engineers and researchers, reason about system behavior and constraints, and…