Senior Software Engineer, GenAI Platform

Who We Are: 
The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams.

What You’ll Do:
As a Senior Software Engineer, you will lead the development of a large-scale GenAI Platform at Reddit.

• Contribute to the design, implementation, and maintenance of the LLM Gateway, focusing on features like unified API endpoints for internal/externally hosted LLM, rate/token limit management, and intelligent failover mechanisms to boost uptime and reliability.
• Designed and developed ML and Generative AI systems in cloud-based production environments at scale.
• Build and manage enterprise-grade RAG applications using embeddings, vector search, and retrieval pipelines.
• Implement and operationalize agentic AI workflows with tool use using frameworks such as LangChain and LangGraph.
• Drive adoption of MLOps / LLMOps practices, including CI/CD automation, versioning, testing, and lifecycle management.
• Establish best practices for observability, monitoring, evaluation, and governance of GenAI pipelines in production.
• Strong ownership mindset and platform thinking.
• Ability to lead AI platform delivery from concept to production.

Who You Might Be:

• 5+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles.
• Have experience operating orchestration systems such as Kubernetes at scale
• Deep experience with cloud-based technologies for supporting an ML platform, including tools like AWS, Google Cloud Storage, infrastructure-as-code (Terraform), and more
• Proficiency with the common programming languages and frameworks of ML, such as Go, Python, etc.
• Excellent communication skills with the ability to articulate technical AI concepts to non-technical stakeholders
• Strong focus on scalability, reliability, performance, and ease of use. You are an undying advocate for platform users and have a deep intuition for the genAI product development lifecycle.
• Strong knowledge of model serving, inference pipelines, monitoring, and observability for AI systems is a plus
• Strong proficiency in Python and experience with modern AI/ML frameworks (e.g. LangChain, Vertex AI Agent Builder, TensorFlow, PyTorch is a plus

Benefits:

• Comprehensive Healthcare Benefits and Income Replacement Programs
• 401k with Employer Match
• Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support

  More roles at Reddit

  Director, Technology FP&ARemoteClient Account Executive, Mid-Market (Goods)TorontoClient Account Manager, Mid-Market Sales (Goods - Acquisitions)TorontoSenior Client Partner, Large Customer Sales (Financial Services)New York CitySenior Client Partner, Large Customer Sales, PharmaNew York CitySenior Client Partner, Large Customer Sales, PharmaChicago

  See Reddit & thousands more on the map

  Every tech & IT company hiring across India — with AI match scores — on one live map.

  Open the map →