AI Systems Engineer Jobs

Discover the latest remote and onsite AI Systems Engineer roles across top active AI companies. Updated hourly.

Check out 35 new AI Systems Engineer opportunities posted on The Homebase

Software Engineer, AI Compiler

New
Top rated
Normal Computing
Full-time
Full-time
Posted

Work across the full stack with software, systems, and hardware teams to ensure correctness, performance, and deployment readiness for real workloads. Contribute to shaping the long-term compiler architecture and tooling strategy. Design and implement parts of the compiler stack targeting the novel AI accelerator, including front-end lowering, IR transformations, optimization passes, and backend code generation. Build and evolve MLIR/LLVM based infrastructure to support graph lowering, hardware-aware optimizations, and performance-centric code emission. Collaborate closely with hardware architects, microarchitects, and research teams to co-design compiler strategies that align with evolving ISA and hardware constraints. Develop profiling and analysis tools to identify performance bottlenecks, validate generated code, and ensure high throughput/low latency execution of AI workloads. Enable efficient mapping of high-level ML models to hardware by working with model frameworks and graph representations such as ONNX, JAX, and PyTorch. Drive performance tuning strategies including kernel authoring, schedule generation, and hardware-specific optimization passes.

$190,000 – $215,000
Undisclosed
YEAR

(USD)

New York City, United States
Maybe global
Onsite

Software Intern

New
Top rated
TensorWave
Intern
Full-time
Posted

As a Software Engineering Intern at TensorWave, responsibilities include collaborating with senior engineers on features for cloud control plane, orchestration layer, user-facing APIs, or internal tooling; working on automation, monitoring, and observability for GPU clusters (Slurm + Kubernetes-native environments); participating in debugging performance bottlenecks in high-throughput inference or distributed training pipelines; writing clean, well-tested code and participating in code reviews; and learning how bare-metal AI clouds operate at scale, including hardware partitioning, high-speed networking, and storage.

Undisclosed

()

Las Vegas, United States
Maybe global
Onsite

Senior Software Engineer (Fullstack)

New
Top rated
Clarion
Full-time
Full-time
Posted

Lead the deployment, performance, and reliability of AI agents operating in live, high-stakes healthcare environments. Architect and scale full-stack systems integrating with EHRs, legacy healthcare platforms, and real-time voice infrastructure. Drive technical strategy for customer-facing solutions, collaborating with product and engineering to translate client needs into scalable architecture. Mentor engineers and set standards for code quality, testing, security, and HIPAA-compliant development. Shape product roadmap by identifying systemic challenges in customer workflows and proposing high-leverage technical solutions.

$150,000 – $225,000
Undisclosed
YEAR

(USD)

New York, United States
Maybe global
Onsite

Senior Backend / Systems Engineer (AI) - San Mateo, CA

New
Top rated
Trustlab
Full-time
Full-time
Posted

Design and build extensible backend systems that support flexible configurations for different customers and content types. Develop infrastructure that interfaces cleanly with large language models (LLMs), enabling prompt engineering, context injection, and modular evaluation workflows. Build tooling and platforms that enable fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments. Prioritize ease of deployment, integration, and testing, both for internal teams and external partners. Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.

$150,000 – $220,000
Undisclosed
YEAR

(USD)

San Mateo, United States
Maybe global
Remote

Software Engineer - Sensing, Consumer Products

New
Top rated
OpenAI
Full-time
Full-time
Posted

As a Software Engineer on Consumer Products Research, the responsibilities include building and shipping production software for sensing algorithms by translating algorithm prototypes into reliable end-to-end systems, implementing and owning key parts of the Python shipping pipeline including integration surfaces, evaluation hooks, and quality/performance guardrails. The role also involves developing embedded/on-device software in an RTOS environment (such as Zephyr) and deploying models to device runtimes and hardware accelerators. Additional responsibilities include optimizing real-time on-device perception loops for stability, latency, power, and memory constraints, creating data collection and instrumentation tooling to bring up new sensing modalities and accelerate iteration from prototype to dataset to model to device, and partnering cross-functionally with algorithms, human data, firmware/hardware teams to debug, profile, and harden systems against real-world variability.

$325,000 – $325,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Hybrid

Senior Software Engineer, ML Core

New
Top rated
Zoox
Full-time
Full-time
Posted

Design, develop, and deploy custom and off-the-shelf ML libraries and toolings to improve ML development, training, deployment, and on-vehicle model inference latency. Build tooling and establish development best practices to manage and upgrade foundational libraries such as Nvidia driver, PyTorch, TensorRT, to improve ML developer experience and expedite debugging efforts. Collaborate closely with cross-functional teams including applied ML research, high-performance compute, advanced hardware engineering, and data science to define requirements and align on architectural decisions. Work across multiple ML teams within Zoox, supporting in- and off-vehicle ML use cases and coordinating to meet the needs of vehicle and ML teams to reduce the time from ideation to productionization of AI innovations.

$214,000 – $290,000
Undisclosed
YEAR

(USD)

Foster City, United States
Maybe global
Onsite

Software Engineer, Platform Systems

New
Top rated
OpenAI
Full-time
Full-time
Posted

Design and build distributed failure detection, tracing, and profiling systems for large-scale AI training jobs. Develop tooling to identify slow, faulty, or misbehaving nodes and provide actionable visibility into system behavior. Improve observability, reliability, and performance across OpenAI's training platform. Debug and resolve issues in complex, high-throughput distributed systems. Collaborate with systems, infrastructure, and research teams to evolve platform capabilities. Extend and adapt failure detection systems or tracing systems to support new training paradigms and workloads.

Undisclosed

()

London, United Kingdom
Maybe global
Onsite

Software Engineer, Platform Systems

New
Top rated
OpenAI
Full-time
Full-time
Posted

Design and build distributed failure detection, tracing, and profiling systems for large-scale AI training jobs. Develop tooling to identify slow, faulty, or misbehaving nodes and provide actionable visibility into system behavior. Improve observability, reliability, and performance across OpenAI's training platform. Debug and resolve issues in complex, high-throughput distributed systems. Collaborate with systems, infrastructure, and research teams to evolve platform capabilities. Extend and adapt failure detection systems or tracing systems to support new training paradigms and workloads.

$310,000 – $460,000
Undisclosed
YEAR

(USD)

San Francisco, United States
Maybe global
Onsite

Engineering Manager – Foundational Data Systems for AI

New
Top rated
Granica
Full-time
Full-time
Posted

Lead, mentor, and grow a team of senior engineers across multiple geographies; own hiring, onboarding, and career development in a high-bar engineering culture; set technical direction through design reviews, RFCs, and principled trade-offs; own the design and evolution of foundational systems including table maintenance and data layout, metadata, transactions, and schema evolution, distributed compute and orchestration, and reliability, observability, and operational tooling; translate strategy into execution through roadmaps and milestones; establish and uphold reliability, latency, and operational standards; lead incident response, postmortems, and continuous system improvement; partner closely with Research, Applied AI, Product, and Infrastructure teams to move ideas from research into production.

$190,000 – $290,000
Undisclosed
YEAR

(USD)

Mountain View, United States
Maybe global
Hybrid

Freelance Software Developer (Kotlin) - Quality Assurance (AI Trainer)

New
Top rated
Mindrift
Part-time
Full-time
Posted

Design and maintain automated tests to ensure the quality, performance, and reliability of Kotlin and Android applications. Collaborate with developers to identify, reproduce, and resolve functional, performance, and UI issues across multiple environments. Define and improve quality standards across build pipelines, ensuring smooth CI/CD integrations and release stability. Monitor app behavior in production and use data-driven insights to guide testing priorities and improvements. Flexibility and quick adaptation to new requirements are essential.

$80 / hour
Undisclosed
HOUR

(USD)

United States
Maybe global
Remote

Want to see more AI Systems Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for AI Systems Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a AI Systems Engineer do?","answer":"AI Systems Engineers design architectures that enable AI models to interact with various system components. They develop, test, and deploy machine learning models while integrating AI modules with existing software, hardware, and business systems. Their responsibilities include monitoring system performance, maintaining and retraining models, managing data flow, ensuring security, addressing ethical concerns, and collaborating with cross-functional teams including data scientists and stakeholders."},{"question":"What skills are required for AI Systems Engineer?","answer":"AI Systems Engineers need strong programming skills in Python, Java, or R, and proficiency with AI frameworks like TensorFlow and PyTorch. Experience with machine learning, deep learning, NLP, and computer vision is essential. They must understand MLOps, infrastructure management, and cloud computing platforms. Problem-solving abilities, communication skills, and team collaboration are equally important for successfully integrating AI systems across organizations."},{"question":"What qualifications are needed for AI Systems Engineer role?","answer":"Most employers require a degree in Computer Science, Engineering, or a related technical field for AI Systems Engineer positions. Practical experience with machine learning algorithms, AI frameworks, and systems integration is highly valued. While formal education provides a foundation, demonstrated ability in designing AI architectures, implementing ML models, and managing complex systems is often more important than specific credentials."},{"question":"What is the salary range for AI Systems Engineer job?","answer":"The research provided doesn't specify exact salary figures for AI Systems Engineers. Compensation typically reflects the specialized nature of the role, requiring both AI expertise and systems engineering knowledge. Salaries vary based on factors like location, company size, experience level, and specific technical skills. AI jobs generally command premium compensation due to high demand for professionals who can build and integrate intelligent systems."},{"question":"How long does it take to get hired as a AI Systems Engineer?","answer":"The hiring timeline for AI Systems Engineers varies significantly depending on factors not specified in the research. The process typically involves technical assessments to evaluate machine learning knowledge and systems design capabilities. Companies may conduct multiple interview rounds to assess both technical expertise and cross-functional collaboration abilities. The specialized nature of these roles can extend the hiring process as organizations seek candidates with the right combination of AI and systems engineering skills."},{"question":"Are AI Systems Engineer job in demand?","answer":"Yes, AI Systems Engineer jobs are experiencing growing demand as businesses integrate advanced AI technologies into their operations. The rise of generative AI and other innovations is driving need for specialists who can design complete AI-enabled architectures. Organizations increasingly require professionals who can bridge the gap between AI development and systems engineering, managing both the technical implementation and broader infrastructure considerations of artificial intelligence deployments."}]