AI Backend Engineer Jobs

Discover the latest remote and onsite AI Backend Engineer roles across top active AI companies. Updated hourly.

Check out 532 new AI Backend Engineer opportunities posted on The Homebase

Speech Software Engineer

New
Top rated
ASAPP
Full-time
Full-time
Posted

Lead the design and implementation of a scalable, high-availability voice infrastructure that replaces legacy systems. Build and refine multi-threaded server frameworks capable of handling thousands of concurrent, real-time audio streams with minimal jitter and latency. Deploy robust ASR > LLM > TTS pipelines that process thousands of calls concurrently. Develop robust logic for handling media streams, ensuring seamless audio data flow between clients and machine learning models. Build advanced monitoring and load-testing tools specifically designed to simulate high-concurrency voice traffic. Partner with Speech Scientists and Research Engineers to integrate state-of-the-art models into a production-ready environment.

$215,000 – $235,000
Undisclosed
YEAR

(USD)

New York, United States
Maybe global
Hybrid

Software Engineer, Backend

New
Top rated
Mashgin
Full-time
Full-time
Posted

The backend developer will own major feature development and work directly with founders on product development from end to end. Responsibilities include working with a small interdisciplinary team across hardware, software, and design to build new products from scratch; building new features and designing new architecture to address challenging problems; building backend infrastructure to perform scalable training in the cloud; rethinking and refactoring existing codebases for scale; and continuously improving and maintaining code in production. The role involves full ownership throughout the entire product lifecycle, including idea generation, design, prototyping, execution, and shipping, contributing to multiple parts of the codebase in various programming languages.

$115,000 – $210,000
Undisclosed
YEAR

(USD)

Palo Alto, United States
Maybe global
Onsite

Software Engineer, Codex Runtime

New
Top rated
OpenAI
Full-time
Full-time
Posted

The responsibilities include shaping the evolution of Codex by identifying how teams use and break AI-powered software engineering, driving changes across product, infrastructure, and model behavior to improve reliability. Building core team and enterprise primitives to enable Codex usability at scale, such as container orchestration, virtual machine provisioning/configuration, execution sandboxes, shared block storage, RBAC, admin and audit surfaces, usage and pricing controls, managed configuration and constraints, and analytics for visibility into Codex usage. Designing and owning secure, observable, full-stack systems that power Codex across web, IDEs, CLI, and CI/CD, integrating with enterprise identity and governance systems (SSO/SAML/OIDC, SCIM, policy enforcement), and developing data-access patterns that are performant, compliant, and trustworthy. Leading real-world deployments and launches by working with customers and go-to-market teams to roll out Codex across teams, using live usage and operational signals to iterate and improve the product and platform based on real-world feedback.

$255,000 – $325,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Senior CFD Engineer

New
Top rated
PhysicsX
Full-time
Full-time
Posted

Take part in building a platform used by Data Scientists and Simulation Engineers to build, train and deploy Deep Physics Models. Work on a focused, stream-aligned and cross-functional team (back-end, front-end, design) that is empowered to make its implementation decisions towards meeting its objectives. Gather and leverage domain knowledge and experience from the Data Scientists and Simulation Engineers using your product.

Undisclosed

()

Singapore
Maybe global
Hybrid

Principal Forward Deployed Software Engineer

New
Top rated
PhysicsX
Full-time
Full-time
Posted

Take part in building a platform used by Data Scientists and Simulation Engineers to build, train and deploy Deep Physics Models. Work on a focused, stream-aligned and cross-functional team (back-end, front-end, design) that is empowered to make its implementation decisions towards meeting its objectives. Gather and leverage domain knowledge and experience from the Data Scientists and Simulation Engineers using your product.

Undisclosed

()

Shoreditch, Singapore
Maybe global
Hybrid

Software Engineer, ML Data Infrastructure

New
Top rated
Ideogram
Full-time
Full-time
Posted

The Software Engineer, ML Data Infrastructure will collaborate with engineers to build AI design experiences, tackle complex technical challenges including scaling distributed systems, build robust data infrastructure for foundation models at petabyte scale ensuring reliability and performance across multi-modal training pipelines, optimize data processing workflows for massive throughput, work with distributed systems, TPU infrastructure, and large-scale storage solutions, and partner with research scientists to translate data requirements into production-grade systems that accelerate model development cycles.

Undisclosed

()

Toronto, Canada
Maybe global
Onsite

Software Engineer, Codex for Teams

New
Top rated
OpenAI
Full-time
Full-time
Posted

As a Software Engineer on the Codex for Teams team, you will be responsible for shaping the evolution of Codex by identifying how teams actually use and sometimes break AI-powered software engineering tools, driving changes across product, infrastructure, and model behavior to make Codex a reliable teammate for organizations. You will build core team and enterprise primitives that enable Codex to scale, including role-based access control (RBAC), admin and audit surfaces, usage and rate limits, pricing controls, managed configuration and constraints, and analytics for deep visibility into Codex usage. You will design and own secure, observable, full-stack systems that power Codex across web, IDEs, CLI, and CI/CD environments, integrating with enterprise identity and governance systems (SSO/SAML/OIDC, SCIM, policy enforcement) and developing data-access patterns that are performant, compliant, and trustworthy. The role involves leading real-world deployments and launches by working directly with customers and the Go To Market team to roll out Codex, using live usage and operational feedback to rapidly iterate and improve the product and platform capabilities. This position owns systems end-to-end, from architecture and implementation to production operations, emphasizing quality and velocity.

$255,000 – $325,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Software Engineer, macOS Core Product - Palm Coast, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for diverse use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture that improve performance, latency, throughput, and efficiency of deployed models. Build tools to provide visibility into bottlenecks and sources of instability, and design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Palm Coast, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Hollywood, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to their customers for a diverse range of use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of deployed models. Build tools to provide visibility into bottlenecks and sources of instability, and then design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Hollywood, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Irvine, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for a variety of use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture to improve the performance, latency, throughput, and efficiency of deployed models. Build tools to identify bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Irvine, United States
Maybe global
Remote

Want to see more AI Backend Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Backend Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Backend Engineer do?","answer":"AI Backend Engineers develop and maintain the scalable, secure services that power AI-driven applications. They build backend systems that ensure high availability and performance while integrating AI capabilities into core products. Their work includes designing machine learning pipelines, managing data flows, transforming ML models into APIs, and exploring advanced technologies like Agent Reasoning and Agentic RAG. They regularly collaborate with frontend, product, and data science teams."},{"question":"What skills are required for AI Backend Engineer?","answer":"Strong programming skills in languages like Python, Go, Java, or Node.js are essential for this role. Proficiency with AI frameworks such as LangChain, LangGraph, TensorFlow, and PyTorch is typically required. Experience with distributed systems, microservices architecture, databases, and cloud-native technologies is important. Problem-solving abilities and practical experience with AI agents round out the technical skillset, while cross-functional collaboration skills are equally valuable."},{"question":"What qualifications are needed for AI Backend Engineer role?","answer":"Most AI Backend Engineer positions require a Bachelor's degree or higher in Computer Science, Software Engineering, or related technical fields. Companies typically seek candidates with 3-8+ years of backend development experience, with the specific requirement varying by seniority. Practical experience working with AI agents and frameworks is increasingly important, as is a demonstrated history of building scalable backend systems that support machine learning applications."},{"question":"What is the salary range for AI Backend Engineer job?","answer":"The research provided doesn't include specific salary information for AI Backend Engineer positions. Compensation likely varies based on location, experience level, company size, and specific technical expertise with AI frameworks and backend technologies. As a specialized role combining both AI and backend development skills, salaries may be higher than standard backend engineering positions due to the additional expertise required."},{"question":"How long does it take to get hired as a AI Backend Engineer?","answer":"The research doesn't provide specific hiring timeline information for AI Backend Engineer roles. The hiring process likely includes technical assessments of both backend development skills and AI knowledge, coding challenges, and multiple interview rounds with engineering teams. Given the specialized nature of the position requiring both strong backend development skills and practical AI experience, the process may be more thorough than for generalist roles."},{"question":"Are AI Backend Engineer job in demand?","answer":"AI jobs, including Backend Engineer positions focusing on AI, appear to be in demand based on active hiring from major companies like Microsoft and Zoom. These companies seek candidates with 3-8+ years of experience depending on seniority level. The specialized skillset combining backend development expertise with AI knowledge makes these professionals valuable as organizations integrate more AI capabilities into their products and services."}]