Director of Enterprise AI

About Boomi and What Makes Us Special

Are you ready to work at a fast-growing company where you can make a difference? Boomi, the data activation company for AI, powers the agentic enterprise by bringing data to life across the business. The award-winning Boomi Enterprise Platform is the active data foundation that delivers essential agentic infrastructure enabling organizations to drive agentic transformation and harness the power of AI with secure, scalable connectivity. Trusted by over 30,000 customers and supported by a network of 800+ partners, Boomi helps organisations of all sizes achieve agility, efficiency, and innovation at scale. At Boomi, you’ll work with world-class people and industry-leading technology. We hire trailblazers with an entrepreneurial spirit who can solve challenging problems, make a real impact, and want to be part of building something big. If this sounds like a good fit for you, check out boomi.com or visit our Boomi Careers page to learn more.

Director of Enterprise AI

Location: US national remote

Reports to: Vice President, Enterprise AI

Job Summary

Boomi is becoming an AI-first enterprise, and this role leads both halves of that shift: the enterprise AI strategy and the data foundation that grounds it. As Director, Enterprise AI, you will be responsible for leading the team that agentifies the enterprise. You will also build the knowledge graph, semantic layer, retrieval, and trust layer every agent depends on. You will report directly to the VP of Enterprise AI.

Tech Stack

- Languages: Python, TypeScript, SQL
- Data platforms: Snowflake, Redshift
- Ingestion and streaming: Kafka, Kinesis
- Transformation and orchestration: Airflow
- Model access: Anthropic, OpenAI, Google, open-weight models via vLLM or Ollama
- Retrieval: Embeddings, pgvector, Pinecone, Qdrant, hybrid search
- AI frameworks: LangChain, LlamaIndex, PyTorch, Hugging Face, Lavendr
- Evaluation: Ragas, DeepEval, Promptfoo, golden datasets
- LLMOps and observability: LangSmith, Langfuse, Arize Phoenix
- Agent frameworks: LangGraph, CrewAI, OpenAI Agents SDK, Claude Agent SDK
- Tool standards: Model Context Protocol (MCP), function calling
- Agent state and durability: Temporal, Restate
- Guardrails: Open Policy Agent, PII detection, prompt injection defenses, human-in-the-loop approvals
- Infrastructure: Kubernetes, Terraform, Docker, GitHub Actions
- Cloud: AWS (primary), with Azure or GCP a plus
- Security and monitoring: OAuth/OIDC, Vault, OpenTelemetry, Grafana

Boomi is committed to fair and equitable compensation practices. The expected annual pay range for this position represents base salary or On-Target Earnings (OTE) for commission-based roles.

Final compensation will be determined by various factors including the candidate's knowledge, skills, experience, geographic location, and role type. Non-commissioned roles may also be eligible for an annual performance bonus.

Click here for an overview of our benefits at Boomi!

Compensation - United States

$222,960 - $278,700 USD

Be Bold. Be You. Be Boomi. We take pride in our culture and core values and are committed to being a place where everyone can be their true, authentic self. Our team members are our most valuable resources, and we look for and encourage diversity in backgrounds, thoughts, life experiences, knowledge, and capabilities.

Boomi strives to create an inclusive and accessible environment for candidates and employees. All employment decisions are based on business needs, job requirements, and individual qualifications.

Responsibilities

Develop and implement the AI strategy and blueprint that turns Boomi into an AI-first enterprise.; Lead AI adoption across internal business operations, aligned with the corporate vision.; Run quarterly planning with the VP of AI and business teams, and translate the AI and agent roadmap into agent, data, and platform investments.; Drive AI solutions that improve front- and back-office processes, decision-making, and customer experiences, using LLMs, RAG, machine learning, NLP, and computer vision.; Set the architecture and roadmap for autonomous and multi-agent systems: planning, tool use, memory, orchestration, and integration with enterprise APIs, and workflows.; Define guardrails for agent behavior, including least-privilege access, human-in-the-loop checkpoints, action logging, and escalation paths.; Establish evaluation and observability standards for agents: task success, safety, reliability, cost per task, and regression testing before release.; Drive interoperability standards such as MCP and open agent-to-agent protocols, and own the agent operating model: ownership, lifecycle, and decommissioning.; Own the model strategy across frontier models such as Anthropic’s Claude, OpenAI and Google Gemini, and open-weight models such as Llama, Mistral and Qwen, matching each workload to the right model on quality, cost, latency and data-residency needs.; Stand up and govern an enterprise AI gateway that centralizes model access, routing, fallback, rate limiting, cost tracking and policy enforcement across every team and agent.; Decide when to self-host open-weight models (via vLLM, Ollama or managed endpoints) and when to use hosted APIs, and run the evaluation that backs each choice.; Define and evolve the reference architecture across the knowledge graph, semantic layer, vector retrieval, and hosted trust layer that grounds every AI agent.; Own the trust layer charter: classification, masking, lineage, and policy enforcement for data that lacks native role-based access control.; Lead batch and real-time pipelines that move source data into AI-ready form for models and agents.; Set data modeling standards, canonical entities, and shared business definitions, and build versioned feature and context stores with freshness, latency, and access SLAs.; Establish SLOs for retrieval quality, data freshness, and trust-layer policy compliance, backed by data quality checks, drift monitoring, and lineage so every agent action traces to its data.; Balance performance and cost across storage, query, and compute for training, retrieval, and inference.; Mentor, and grow a team of AI and data engineering professionals as a player-coach, with a culture of exploration and excellence.; Lead async, multi-geo collaboration norms across the US and India, and defend team scope against feature-factory pressure.; Serve as "Customer Zero" for Boomi's low-code generative AI orchestration platform, and share practical lessons with customers and partners.; Stay ahead of AI trends, and work with Boomi Product & Engineering and external communities to test ideas and sharpen the AI strategy.

Requirements

10+ years across data engineering, analytics, and AI systems, including 3+ years managing senior IC engineers.; A track record leading enterprise-scale AI initiatives that turned large business transformations into measurable outcomes.; Hands-on experience building production solutions on Claude, including the Claude API, Claude Agent SDK, tool use and prompt caching, plus at least one other frontier model family.; Experience deploying, fine-tuning or serving open-weight models in production, and comparing them against hosted models on quality and total cost.; Experience designing or operating an AI gateway or LLM proxy layer (such as LiteLLM, Portkey, Kong AI Gateway, Cloudflare AI Gateway or AWS Bedrock) for multi-model routing, observability and governance.; Has personally architected at least one of: a production knowledge graph, a semantic layer, or a RAG retrieval system at enterprise scale, and stays close to the code as a player-coach.; Experience setting architecture for agentic or multi-agent AI systems, including guardrails, evaluation, and observability.; Has built a data trust or governance layer for data without native RBAC: classification, masking, lineage, and policy enforcement.; Hands-on AWS depth: IAM, S3, Glue/EMR, Lambda, Bedrock or equivalent, OpenSearch, KMS.; Model access: Anthropic Claude, OpenAI, Google Gemini, open-weight models (Llama, Mistral, Qwen, DeepSeek) via vLLM, Ollama or managed endpoints; AI gateways and routing: LiteLLM, Portkey, Kong AI Gateway, Lavendr, Cloudflare AI Gateway, Amazon Bedrock; Experience leading large transformations across strategic planning, program execution, technical delivery, communications, and change management.; Proven record building and mentoring AI and software engineering teams, including a distributed US-India team.; Strong executive communication: explains complex AI concepts to executives, customers, and diverse stakeholders.; BS or advanced degree in engineering, computer science, or another technical field.

Nice to have

Experience supporting sales or revenue agents, or CRM-grounded AI applications.; Familiarity with dbt Semantic Layer, Cube, AtScale, or comparable metric platforms.; Prior experience at an integration platform, iPaaS, or data fabric company.; Open-source contributions in data or AI infrastructure (dbt, Neo4j, a vector DB, agent frameworks).; A public voice in practical enterprise AI through talks, writing, or community work.