AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 532 new AI Backend Engineer opportunities posted on The Homebase

Software Engineer, Backend

New
Top rated
Mirage
Full-time
Full-time
Posted

Design, build, and own backend systems end-to-end, including services, APIs, data pipelines, and infrastructure that power products. Solve complex technical challenges across distributed systems, scaling, concurrency, and performance. Integrate and operate large generative AI models in production, including deploying, serving, and scaling systems combining internal research and external capabilities. Instrument, experiment, and iterate in production to continuously improve system and product quality. Design and operate core platform infrastructure, including integrations with third-party providers, storage systems, security, and internal APIs.

$185,000 – $285,000
Undisclosed
YEAR

(USD)

New York, United States
Maybe global
Onsite

Senior Software Engineer, Managed AI

New
Top rated
Crusoe
Full-time
Full-time
Posted

The Senior Software Engineer will contribute to building a managed platform for the entire application development lifecycle with a focus on leveraging Machine Learning models including Large Language Models (LLMs). Responsibilities include implementing and maintaining systems for fine-tuning large foundation models such as SFT, PEFT, LoRA, and adapters, including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling. They will implement and maintain end-to-end training pipelines for Large Language Models and components for distillation and reinforcement learning pipelines like preference optimization, policy optimization, and reward modeling. They will develop and maintain core agent execution infrastructure and implement features for dataset, model, and experiment management focusing on versioning, lineage, evaluation, and reproducible fine-tuning. The role involves working closely with Senior and Principal Engineers as well as product and platform teams to implement system abstractions and APIs and contributing to technical discussions on training runtimes, scheduling, storage, and model lifecycle management. Additionally, the role requires engaging with the open-source LLM ecosystem and involves significant implementation ownership for core system components.

$166,000 – $201,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Senior Software Engineer (Backend - Scribe)

New
Top rated
Heidi Health
Full-time
Full-time
Posted

As a Senior Software Engineer working closely with the Engineering Manager for Transcription and Note Generation, you will develop AI-powered solutions that transform clinical conversations into structured medical documentation. Your responsibilities include designing and developing robust, scalable systems for real-time processing and examination of clinical conversations, collaborating with the AI/ML team to integrate and optimize medical speech transcription and note generation, designing, building, and maintaining APIs and services for transcription and note generation capabilities, implementing systems to ensure high accuracy and reliability in medical documentation generation, optimizing performance for real-time results in clinical settings, and contributing to the overall architecture and best practices for scalable and maintainable systems.

Undisclosed

()

Sydney, Australia
Maybe global
Hybrid

Safety Engineer

New
Top rated
ElevenLabs
Full-time
Full-time
Posted

The AI Safety Engineer is responsible for designing and building scalable backend infrastructure for content moderation, abuse detection, and agents guardrails by deploying AI/ML models into production systems. They will architect robust APIs, data pipelines, and service architectures to support real-time and batch moderation workflows. The role includes implementing comprehensive monitoring, alerting, and observability systems, establishing SLIs, SLOs, and performance benchmarks. The engineer will collaborate with ML engineers to translate research models into production-ready systems and integrate them across the product suite. Additionally, they will drive technical decisions and contribute to the vision for the safety roadmap to build next-generation platform guardrails for scale and precision.

Undisclosed

()

Maybe global
Remote

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems that support flexible configurations for different customers and content types. Develop infrastructure that interfaces cleanly with large language models (LLMs), enabling prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms that enable fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing, both for internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer, Data & Retrieval

New
Top rated
BenchSci
Full-time
Full-time
Posted

The Software Engineer is responsible for utilizing the Agent Development Kit (ADK) to design, develop, and deploy autonomous agents and "skills" capable of multi-step data retrieval tasks. They design and develop backend systems and APIs to expose bioinformatics data and implement advanced search and retrieval mechanisms to provide LLMs with up-to-date grounded information. Their duties include tuning storage technologies, creating high-performance query plans, designing solutions, and adapting existing approaches to solve issues within web app architecture and interfaces. They operationalize production-grade data pipelines using processing engines like Apache Beam, collaborate with other engineers to address document extraction, enrichment, and retrieval challenges, and model scientific experiments from unstructured data. The engineer also troubleshoots and resolves production issues promptly, ensures code is testable, self-documenting, and reliable, communicates decisions to impacted teams, works on client-facing projects with large pharmaceutical companies, and balances independent work with collaborative efforts for complex architectural changes.

$100,000 – $140,000
Undisclosed
YEAR

(USD)

Toronto, Canada
Maybe global
Hybrid

Engineering Manager - Engine and Platform

New
Top rated
Arcade.dev
Full-time
Full-time
Posted

The Engineering Manager for the Engine and Platform leads the team responsible for building, maintaining, and deploying the runtime for customers to run, manage, secure, and understand AI tools, enabling advanced agentic use-cases. This role involves scaling the team owning the development of the platform and services, which includes distributed systems engineers and authorization/identity experts developing features like MCP gateways, roles and permissions, and platform-as-service capabilities for tool executions. The manager ensures the team is unblocked, aligns the team's work with the product organization, and stays technically engaged through code reviews, critical contributions, and occasional hands-on coding. Responsibilities include owning deliverables, stability, and uptime, shaping product vision and architecture, owning technical direction and prioritization, hiring and mentoring engineers, defining and delivering platform features, and ensuring reliability, security, and enterprise readiness. The manager also focuses on building leverage into systems through automation and agents to improve efficiency and is expected to navigate ambiguity and evolving standards in AI tools.

$200,000 – $275,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Software Engineer II (India - Bangalore)

New
Top rated
Giga
Full-time
Full-time
Posted

Engineers at Giga work on problems like building AI agents with almost no hallucination rates, creating a voice experience that is better than talking to humans, and creating self-learning agents that optimize metrics.

₹10,000,000 – ₹11,000,000
Undisclosed
YEAR

(INR)

Bangalore or Bengaluru, India
Maybe global
Onsite

Peak Health - Software Engineer (Backend-leaning)

New
Top rated
Silver.dev
Full-time
Full-time
Posted

Ship production-grade backend and frontend features for core member and provider flows using React, TypeScript, APIs, and data layers, ensuring high polish and reliability. Own features end-to-end, including specification, building, testing, deployment, monitoring, and handling complex state, permissions, and edge cases. Build and maintain robust system hygiene, including instrumentation, dashboards and alerts, CI/CD pipelines, code reviews, and production debugging. Design, implement, and maintain AI-powered workflows comprising tool/function calling, structured outputs, Retrieval-Augmented Generation (RAG), evals, tracing, observability, prompt versioning, and guardrails. Build and operate workflow and agent flows using orchestration patterns similar to Temporal, Dagster, or Airflow, managing retries, idempotency, asynchronous job queues, and failure handling. Collaborate closely with cross-functional partners to deliver reliable, scalable, and user-centric healthcare products.

$60,000 – $84,000
Undisclosed
YEAR

(USD)

Argentina
Maybe global
Remote

Software Engineer

New
Top rated
AIFund
Full-time
Full-time
Posted

Design, develop, and maintain web applications and backend services that integrate ML-powered features. Collaborate closely with Machine Learning Engineers and Product Managers to understand ML system requirements and translate them into robust software solutions. Build reliable, scalable, and low-latency services that support ML inference, data workflows, and AI-driven user experiences. Use LLMs to build scalable and reliable AI agents. Own the full software development lifecycle: design, implementation, testing, deployment, monitoring, and maintenance. Ensure high standards for code quality, testing, observability, and operational excellence. Troubleshoot production issues and participate in on-call or support rotations when needed. Mentor junior engineers and contribute to technical best practices across teams. Act as a strong cross-functional partner between product, engineering, and ML teams.

Undisclosed

()

San Francisco Bay Area, United States
Maybe global
Hybrid

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]