Top AI MLOps / DevOps Engineer Jobs Openings in 2025

false

false

false

false

false

false

true

true

About Norm AiNorm Ai is the Compliance AI Platform for legal standards-based reasoning & workflow automation.We developed the first Domain Specific Language (DSL) for fully representing regulatory requirements in AI code. This DSL, deployed with our enterprise platform, enables Norm clients to transform workflows and apply compliance checks at the source of business activities.We are setting the norms for compliance processes at the largest institutions in the world. Our client base includes firms with a combined $17 Trillion in assets under management, and growing quickly.Our Software Engineers came from Palantir, Google, Meta, AWS, Harvard, Stanford, and MIT. Our Legal Engineers are from Harvard Law, Stanford Law, Yale Law, Sullivan & Cromwell, Simpson Thacher, Davis Polk, Greenberg Traurig, the SEC, and FINRA.We have raised $85 million over the past 18 months from top VCs and global institutions, including Vanguard, Blackstone, Bain Capital, Coatue, Craft Ventures, New York Life, Citi, TIAA, and Marc Benioff.This RoleAs a Cloud Infrastructure Engineer at Norm Ai, you will architect and build a reliable, scalable, and performant infrastructure for our rapidly evolving AI-driven compliance platform. You will drive key infrastructure initiatives including advancing our Infrastructure as Code practices, implementing our multi-cloud strategy, and enabling diverse enterprise deployment scenarios. You will work closely with our software engineering and product teams to deliver enterprise grade software solutions to the world's largest regulated institutions. You will contribute to strategic discussions around our infrastructure, bringing insights and recommendations to drive our technology decisions and product evolution. This role will bring dedicated expertise in Azure to support our ongoing buildout and expansion into Microsoft’s cloud ecosystem, complementing our existing AWS and GCP cloud infrastructure.In this role, you will:Lead the design and implementation of our multi-cloud strategy across AWS, GCP, and Azure with cloud-agnostic Infrastructure as CodeSupport Azure infrastructure buildout efforts in collaboration with the broader infrastructure team, including networking, identity, and resource architectureArchitect flexible deployment patterns to support on-premises, hybrid, and air-gapped customer environmentsDrive Infrastructure as Code best practices and governance across the engineering organizationImplement fault-tolerant and resilient design patterns to minimize service disruptionsBuild and maintain automation tools and CI/CD pipelines to streamline processes and improve reliabilityCreate systems to support a growing set of enterprise requirements on our platform, including robust permissioning, authentication, logging, and auditabilityImplement monitoring systems to proactively identify issues and anomalies in productionWork closely with customer engineering teams to enable rapid adoption of Norm Ai solutionsSkills & Experience - Core6+ years of hands-on infrastructure engineering experience at technology companies, with significant time spent on complex, large-scale systemsDeep expertise in Infrastructure as Code with Terraform, including advanced patterns like modules, workspaces, and state management across multiple cloud providersProven experience architecting and implementing multi-cloud strategies with practical knowledge of cross-cloud networking and identity federationExperience designing infrastructure for diverse deployment scenarios including air-gapped, on-premises, and hybrid environmentsStrong foundation in computer science fundamentals - we're looking for engineers who understand systems at a deep level, not just cloud servicesComfort navigating enterprise requirements and API integrationsProficiency in Python and experience with complex data storage architectures beyond basic CRUD operationsExperience designing and maintaining CI/CD pipelines using tools like Github ActionsSkills & Experience - PlusesExperience in AI/ML infrastructure and toolingExperience building infrastructure for highly regulated industries with complex deployment requirementsBackground in distributed systems architecture and cross-region/cross-cloud data replicationExperience with configuration management tools (Ansible, Salt) for hybrid deployment scenariosFamiliarity with serverless architecturesExperience with enterprise security and compliance standards such as SAML, SSO, SEC Rule 17a-4, etc.Microsoft Certified: Azure Solutions Architect ExpertWhat Success Looks Like30 daysNorm Ai Integration: Rapidly familiarize yourself with Norm Ai's existing infrastructure, architecture, and the unique challenges of our AI-driven compliance solutionsMulti-Cloud Infrastructure Validation: Conduct comprehensive testing and validation of our multi-cloud deployment capabilities, ensuring feature parity across providers and identifying application-level changes needed for cloud-agnostic operationsCross-Provider Compatibility: Resolve platform-specific dependencies and implement abstraction layers to enable seamless operation across different cloud environments60 daysCross-Account Infrastructure & Data Controls: Design and implement infrastructure patterns that enable secure cross-account connectivity and flexible data control models, supporting customer requirements for data residency and account separationFlexible Deployment Models: Deliver solutions for diverse customer deployment scenarios including customer account deployments and hybrid infrastructure configurationsMulti-Cloud CI/CD: Establish deployment pipelines that support consistent, reliable deployments across multiple cloud providers and customer infrastructure modelsStrategic Infrastructure Roadmap: Develop a comprehensive plan for scaling our infrastructure capabilities to meet growing enterprise requirements and deployment complexityLocationThis role is ideally located in the NYC metro area – our office is in WTC 7 downtown.We are open to remote candidates, if they are based in the U.S. and can make quarterly week-long visits to our NYC office.Comp & Benefits The base salary range for this full-time position is $175,000-$250,000 + generous early employee equity + benefits. The range displayed in this job posting reflects the minimum and maximum target for new hire salary for this position. Within the range, individual pay is determined by various factors, including job-related skills (as uncovered during the interview process), experience, and relevant education or training. Please note that the compensation details listed here reflect the base salary only, and do not include equity or benefits.Competitive salary and equity401(k) with the highest match legally allowedTop-tier health, dental, hospital, accident and vision insuranceRelocation reimbursement available if candidate decides to relocate to NYCFast-paced learning environmentIf you’re interested in the role but aren’t sure whether you’re a good fit, we’d still like to hear from you.

false

false

We're hiring our first founding infra engineer. You'll build the platform that supports everything Create does - from how our AI agent builds apps to how those apps scale in production. Create is already used by 300k+ builders (growing fast) to turn English into full stack apps. Some of those apps already serve 100k+ sessions. Soon, it'll be millions of builders and users. You'll own the systems that power those apps and give our AI agent the observability and control it needs to maintain them. Unlike most platform roles, your work won't just help one team - every innovation you ship will scale to thousands of apps and let Create's agent autonomously maintain them for millions of builders + users. Sample projects include:Architecting a one-click deploy system that scales Create-made apps from zero to millions of sessionsDesigning fault-tolerant infra with per-app isolation across data, secrets, and runtimeBuilding real-time observability so Create’s AI agent can debug, monitor, and repair production apps on its ownScaling the backbone that supports hundreds of thousands of simultaneous builders and agents Optimizing retrieval and inference to make AI code gen feel instant - even under massive concurrent loadYour background looks something like:4+ years of experience in infra or platform engineering roles, and fluent in Typescript, Go, Rust, or PythonBuilt or scaled systems with meaningful production traffic and load Production experience with AWS (or similar, GCP, Azure) and Terraform (or CDK/CDKTF/Pulumi) and modern CI/CDStrong experience with databases, caches, proxies, secrets, task queues, observability, microVMs, containers, and orchestration systems Experience with multi tenant SaaS platforms or developer facing productsExcellent problem solving skills, passion for scalable, reliable systems, and a product mindset (you understand how excellence in infra drives product wins like instant deploys, collab, hero moments for customers, etc.) Excited to work in person, 5 days/week, in San Francisco We pay extra attention if you have:Prior experience as a founder or founding engJoined somewhere early enough to experience a few orders of magnitude of scale increaseHands on work with secrets management or security best practices for cloud infra Strong experience with AI/ML workloads and infra Contributions to open source projects

true

false

false

About BasisBasis equips accountants with a team of AI agents to take on real workflows.We have hit product market fit, have more demand than we can meet, and just raised $34m to scale at a speed that meets this moment.Built in New York City. Read more about Basis here.Why joinWorld class investors: We're backed by Keith Rabois from Khosla Ventures alongside Nat Friedman, Daniel Gross, Aaron Levie, Adam D'angelo, Amjad Masad, Jack Altman, Jeff Dean, Larry Summers, Noam Brown and many leaders from the ML and fintech community. Check out our announcement for an expansive listExtremely fast growth: We’ve partnered with some of the largest accounting firms in the world, with revenue 10x-ing over the last 5 monthsBe part of building a company: We’re scaling the team fast and the business faster, meaning there will always be more responsibility than we have people. No better place to get a ton of responsibility and ownership on day 1In person & interdisciplinary: We operate on the frontier of what’s technically possible. That is why being in-person is a must. We’re bringing together the brightest minds from the top engineering, ML, and accounting teams to work together in our NYC office and build production quality agentic systemsHigh risk: We believe the world is about to change in profound ways. We are building Basis to be on the cutting-edge of that change for a decade to come, and we have an appetite for the risk that comes with that. The journey has just begunCompensation: We aim to pay competitively for cash compensation and well above market for equity compensation because the whole team is all-in, and we want you to be too📍 Location: NYC, Flatiron office. In-person team.About the roleAs the lead of our integrations teams, you'll be responsible for designing, building, and maintaining the integrations that power the Basis ecosystem. This includes integrations into accounting systems, file systems and all the tooling that accountants would do their work in. You would be responsible for recruiting others for this team, providing technical direction, helping set the roadmap etc. Working with our co-founders and head of engineering, you will also help shape our early engineering culture and build out the early scaled engineering team.What we look forExperienced: 5-10 years of designing and building data pipelines; open to exceptional candidates with fewer years and evidence of exceptional abilitySpecific experience with accounting integrations and file integrations is a plus. First principles reasoner: Able to break complex concepts down to their fundamental elements and then build from thereLeader: Knows what needs to get done and how to get thereInterdisciplinary: Willing and interested to jump across multiple disciplinesCompany-builder: Excited to lay the groundwork, technically and culturally, as we rapidly scaleEagle-eyed: Spots and recruits engineering talentCollaborative: Dedicated to mentoring others and open to being mentored in returnPassionate: Genuinely excited about our tech and its impact on accounting, finance, and the economyCurious: Loves to play with new ideas/techOffice lover: Prefers shouting across a room over a slack message, seeking full-time in-office in NYC, 5 days a weekAll-in: This is not a 9-5, we have a massive opportunity ahead of us and are looking to further accelerate our velocity. We are optimizing for the best folks and happy to compensate generouslyIn accordance with New York State regulations, the salary range for this position is $100,000–$300,000. This range represents our broad compensation philosophy and covers various responsibility and experience levels. Additionally, all employees are eligible to participate in our equity plan and benefits program. We are committed to meritocratic and competitive compensation.

false

true

false

Yutori is reimagining how people interact with the web by building AI agents that can reliably do everyday digital tasks. We are building the entire stack to be agent-first, from training our own models to generative product interfaces.Towards this goal, we are looking for a member of the AI technical staff to join the founding team. Someone technically strong, and excited about building superhuman AI agents that take actions on the web.Our founders — Devi Parikh, Abhishek Das, Dhruv Batra — have decades of experience in AI research and product spanning generative, multimodal and embodied AI at Meta. Our team combines AI experience with design-minded product thinking to build and deliver on Yutori’s mission.Yutori is backed by a stellar set of visionary investors — Elad Gil, Sarah Guo, Jeff Dean, Fei-Fei Li, Amjad Masad, Guillermo Rauch, Akshay Kothari, Soleio, Oliver Cameron, Julien Chaumond, Logan Kilpatrick, Bryan McCann, Vladlen Koltun, Jamie Cuffe, Michele Catasta, etc.Responsibilities:Scale infra for post-training of multimodal LLMs (CPT, SFT, RL, search, reward models)Scale infra for agentic inference (throughput and latency of perception-planning-action loops)Build the foundations of a superhuman generalist web-agentWork closely with product engineers to translate cutting-edge AI capabilities into reliable product experiences.What we’re looking for:Experience with ML infrastructure (GPU clusters) and supporting networking (NCCL)Experience optimizing post-training and inference performance of multimodal LLMs (data/tensor/pipeline/context/expert parallelism, optimizing MFU, throughput, latency)Low level systems experience (Triton, CUDA)High IQ, high EQ, high agency, high craftsmanship, low ego. Proactive, clear communication.Benefits and perks:Competitive salary and equityVisa sponsorship and relocation stipend to bring you to SFGenerous health, dental, vision insurance for you and your dependents20 days of paid time off per yearWork laptop and budget to set up your work officeDaily team lunchesCommuter benefitsSmall, focused team of high-potential individuals. In-person in SF.

true

true

true

true