AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 532 new AI Backend Engineer opportunities posted on The Homebase

Backend Software Engineer - Engine Team (Voice Agent)

New
Top rated
Deepgram
Full-time
Full-time
Posted

The Backend Software Engineer on the Engine Team (Voice Agent) at Deepgram will lead the design and implementation of the Voice Agent product, including designing and implementing secure, robust, and scalable services for speech processing. Responsibilities include building integrations to support telephony providers, RAG systems, and diverse deployment scenarios; engineering services for testability and observability within a complex chain of AI models; improving core inference services in networking, speech processing, model orchestration, and observability; developing integrations with in-house, third-party, and open-source AI models for perception and conversational dynamics; debugging complex system issues involving networking, scheduling, and highly concurrent workloads; rapidly customizing backend services to support customer needs; and partnering with Product to design and implement new services, features, and products end to end.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

United States
Maybe global
Remote

Software Engineer

New
Top rated
Hiya
Full-time
Full-time
Posted

The Software Engineer will own backend services that power core features across both Hiya mobile applications, including caller ID lookups, spam/fraud detection, call screening, real-time scam alerts, call transcription, and AI-generated summaries. Responsibilities include designing service architecture, writing production code, deploying to AWS, and operating systems at scale with high availability and low latency. The role also involves building and maintaining mobile integrations connecting backend services to iOS and Android apps, collaborating with mobile engineers to ensure seamless SDK behavior, debugging platform-specific issues, and shipping reliable features for millions of users. Additionally, the engineer will scale infrastructure to support growing user bases and new feature development, make architectural and implementation decisions balancing speed, quality, and long-term maintainability, solve ambiguous problems in call screening logic and backend structure, and collaborate across engineering, product, and design teams in a high-autonomy environment to ship impactful features.

$140,000 – $205,000
Undisclosed
YEAR

(USD)

Seattle, United States
Maybe global
Remote

Software engineer, agents (UK)

New
Top rated
Writer
Full-time
Full-time
Posted

Design, implement, and maintain scalable, secure agent-driven services and systems that autonomously accomplish tasks using modern AI frameworks. Develop and enhance robust infrastructure and high-throughput APIs focusing on core agent capabilities such as memory, communication channels, skills, intelligent decision logic, security, and workflow management. Integrate agent capabilities with backend services, data stores, vector databases, search/retrieval systems, and external APIs. Collaborate with product managers, AI researchers, data engineers, and UX teams to translate high-level agent use cases into robust, production-ready software. Ensure reliability, monitoring, and observability for all agent components including metrics, logging, CI/CD, and fault tolerance. Contribute to architectural design decisions and participate in rigorous code reviews to uphold quality and maintainability.

Undisclosed

()

New York City, United States
Maybe global
Remote

Sr. Engineer, Backend (MCP)

New
Top rated
Zapier
Full-time
Full-time
Posted

Design, implement, and evolve core APIs that enable agents to take meaningful actions across Zapier's integration ecosystem. Build systems that support scalable orchestration, robust logging, and high-availability execution. Influence and collaborate on the core performance for MCP focusing on memory, context windows, token usage, and reasoning steps. Integrate with Zapier's existing execution infrastructure and help build the interfaces between LLM clients and Zapier. Partner closely with Product, Design, Platform, and Sales teams to ensure the protocol serves both external and internal needs. Drive design decisions that prioritize scalability, performance, security, and clarity for developers and AI systems alike.

$174,200 – $261,200
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Remote

Senior Backend Engineer

New
Top rated
Clarion
Full-time
Full-time
Posted

Design, build, and own the core backend systems, including services, data models, and business logic powering Clarion’s AI agents and healthcare workflows. Build infrastructure for multi-step, asynchronous workflows with conditional logic, retries, and failure handling. Own integrations with EHRs and legacy healthcare platforms via APIs and RPA. Create internal abstractions and tooling for deploying and customizing AI assistants for new customers. Implement and maintain backend authentication, authorization, and HIPAA-compliant architecture for enterprise healthcare.

$150,000 – $225,000
Undisclosed
YEAR

(USD)

New York, United States
Maybe global
Onsite

Tech Lead, Android Core Product - Ann Arbor, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for diverse use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture to improve the performance, latency, throughput, and efficiency of deployed models. Build tools to identify bottlenecks and sources of instability and design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Ann Arbor, United States
Maybe global
Remote

Software Engineer, Agent - Healthcare

New
Top rated
Sierra
Full-time
Full-time
Posted

Design and deliver production-grade AI agents for healthcare that handle sensitive patient and member interactions while maintaining strict HIPAA compliance. Drive the Agent Development Life Cycle with ownership from pilot through deployment and iteration. Partner with healthcare leaders to understand challenges and build AI agents that address operational needs. Develop expertise in healthcare systems, workflows, and data/privacy standards to create trustworthy AI experiences. Guide and contribute to the evolution of Sierra's core platform based on customer feedback. Examples of projects include building AI agents for insurance networks, providers, primary and urgent care clinics, and healthcare financial platforms, as well as experimenting with voice models for secure interactions.

$180,000 – $390,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Backend Engineer, AI

New
Top rated
Bjak
Full-time
Full-time
Posted

Build and operate backend systems that serve AI-powered features in production; design inference pipelines, orchestration layers, and service boundaries around models; own production concerns including monitoring, logging, alerting, and incident response; optimize latency and throughput across inference, caching, batching, and streaming.

Undisclosed

()

Beijing, China
Maybe global
Remote

Backend Engineer, AI

New
Top rated
Bjak
Full-time
Full-time
Posted

Build and operate backend systems that serve AI-powered features in production. Design inference pipelines, orchestration layers, and service boundaries around models. Own production concerns including monitoring, logging, alerting, and incident response. Optimize latency and throughput across inference, caching, batching, and streaming.

Undisclosed

()

New York, United States
Maybe global
Remote

Software Engineer, AI Agent

New
Top rated
Resolve AI
Full-time
Full-time
Posted

Own customer outcomes end to end by working directly with customers, design partners, and internal stakeholders to define technical scope, success criteria, and delivery milestones, then building and shipping the solution. Design and implement features across the full stack with a focus on solving real problems observed in production environments. Integrate deeply with customer environments by working hands-on with cloud platforms, observability systems, CI/CD pipelines, and incident response workflows to ensure product fit. Diagnose and resolve complex issues across customer deployments, turning support interactions into product insights and durable fixes. Build evaluations and feedback loops to quantify customer value and ensure new capabilities are genuinely impactful. Write clean, maintainable, well-tested code, lead design discussions and code reviews, and help shape the technical direction of the product and the engineering culture of the team.

Undisclosed

()

San Francisco, United States
Maybe global
Onsite

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]