Techjays
← All Roles

Director of Engineering - AI

Job description

Role Overview

We're looking for a Director of Engineering to own our engineering organization and drive the execution of our enterprise-grade AI solutions. This is a pure execution and delivery role: you will bridge executive strategy with hands-on engineering execution, managing Engineering Managers and Tech Leads to ensure our AI systems ship on schedule, perform reliably, and meet rigorous quality benchmarks.

Primary Skills

Engineering Leadership (Manager of Managers), Delivery & Release Management, Distributed Systems, Cloud-Native Architecture (AWS/GCP/Azure), CI/CD, Scalable APIs, SLO/Reliability Engineering

Secondary Skills

LLMs, RAG Architectures, Vector Databases, Agentic AI Workflows, MCP (Model Context Protocol), AI Evals & Guardrails, LLMOps & Observability, Prompt Engineering, Fine-Tuning Workflows, Responsible AI

Responsibilities

– Own the release schedule: turn long-term product roadmaps into predictable sprint cycles, achieving an 85%+ on-time delivery rate across all engineering teams.

– Remove roadblocks: proactively detect and resolve cross-team dependencies, architectural bottlenecks, and resource constraints before they impact deadlines.

– Drive process discipline: oversee modern CI/CD, automated testing, and agile workflows across sub-teams, tracking delivery health with metrics such as DORA and sprint commitment completion.

– Drive responsible adoption of AI-assisted development tooling to raise team throughput without compromising quality or security.

– Establish automated evaluation pipelines (evals) that test AI outputs for hallucination rates, relevance, groundedness, and context accuracy before code reaches production - including regression suites for prompts, models, and agent workflows.

– Implement safety and guardrails: circuit breakers, validation filters, and human-in-the-loop fallbacks to maintain system integrity when underlying LLMs or agents behave unexpectedly.

– Maintain data and RAG pipeline excellence: vector stores, data ingestion feeds, and retrieval mechanisms that deliver clean, structured, and compliant context.

– Own LLMOps practices - tracing, observability, and cost and latency governance for model usage - and ensure AI solutions meet privacy, security, and responsible-AI requirements.

– Oversee application architecture to guarantee target Service Level Objectives (SLOs), including 99.9% uptime and low time-to-first-token (TTFT) latency.

– Partner with Staff and Principal Engineers to design resilient infrastructure, including fallback and failover logic when model APIs drop or hit rate limits.

– Maintain high technical standards across code review, observability, automated integration testing, and security compliance.

– Manager of managers: directly manage, mentor, and elevate Engineering Managers and Tech Leads, fostering autonomy and clear accountability.

– Attract, interview, and hire top-tier software and AI engineers to scale the organization efficiently.

– Cultivate a high-performance culture grounded in technical ownership, continuous improvement, and operational rigor.

Requirements

– 14+ years in software engineering, with 5+ years managing Engineering Managers or Tech Leads in high-growth or enterprise settings.

– AI/ML technical literacy: hands-on experience delivering AI systems - LLMs, RAG architectures, vector databases, agentic workflows, prompt engineering, or fine-tuning workflows.

– Delivery track record: proven experience leading multi-team initiatives from technical concept through launch on predictable schedules.

– Systems architecture knowledge: experience building distributed systems, cloud-native backend infrastructure (AWS/GCP/Azure), and scalable APIs.

– Leadership focus: strong ability to hold teams accountable to hard deadlines without sacrificing quality or developer morale.

– Builder mindset - you think in systems, not just tickets.

– Operational rigor and ownership - you take outcomes from roadmap to production.

– Structured thinking in ambiguous, fast-moving environments.

– Clear communication with executives, clients, and engineers alike.

– Comfort working in a fast-paced, evolving startup environment.

Apply for this role
Open application

Not quite the right fit?

Tell us what you'd like to build — we keep strong candidates in mind as new roles open.