ML Infrastructure Engineer Jobs

Discover the latest remote and onsite ML Infrastructure Engineer roles across top active AI companies. Updated hourly.

Check out 20 new ML Infrastructure Engineer opportunities posted on The Homebase

Principal Machine Learning Engineer

New
Top rated
PhysicsX
Full-time
Full-time
Posted

The role involves building a platform used by Data Scientists and Simulation Engineers to build, train, and deploy Deep Physics Models. The candidate will work on a focused, stream-aligned, and cross-functional team that includes back-end, front-end, and design members, empowered to make its own implementation decisions towards meeting its objectives. Responsibilities include gathering and leveraging domain knowledge and experience from the Data Scientists and Simulation Engineers using the product, taking ownership of work from implementation to production, ensuring quality, scalability, and observability at every step, which includes testing, containerization, continuous integration and delivery, authentication, authorization, telemetry, observability, and monitoring.

Undisclosed

()

Singapore
Maybe global
Hybrid

Software Engineer, macOS Core Product - Minneapolis-St. Paul, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for a diverse range of use cases; deploy and operate the core ML inference workloads for the AI Voices serving pipeline; introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of deployed models; build tools to provide visibility into bottlenecks and sources of instability and design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Minneapolis or St. Paul, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Gresham, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to deliver AI Voices to customers for various use cases. Deploy and operate the core machine learning inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture to improve performance, latency, throughput, and efficiency of deployed models. Build tools to identify bottlenecks and sources of instability and design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Gresham, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Stamford, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for diverse use cases. Deploy and operate core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture to improve performance, latency, throughput, and efficiency of deployed models. Build tools to identify bottlenecks and sources of instability and design and implement solutions to address high priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Stamford, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Glendale, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for a diverse range of use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of deployed models. Build tools to provide visibility into bottlenecks and sources of instability, then design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Glendale, United States
Maybe global
Remote

Software Engineer, macOS Core Product - Jackson, USA

New
Top rated
Speechify
Full-time
Full-time
Posted

Work alongside machine learning researchers, engineers, and product managers to bring AI Voices to customers for diverse use cases. Deploy and operate the core ML inference workloads for the AI Voices serving pipeline. Introduce new techniques, tools, and architecture to improve performance, latency, throughput, and efficiency of deployed models. Build tools to identify bottlenecks and sources of instability and design and implement solutions to address the highest priority issues.

$140,000 – $200,000
Undisclosed
YEAR

(USD)

Jackson, United States
Maybe global
Remote

Machine Learning Engineer: ML Infra and Model Optimization

New
Top rated
Genies
Intern
Full-time
Posted

Develop and deploy LLM agent systems within the AI-powered avatar framework. Design and implement scalable and efficient backend systems to support AI applications. Collaborate with AI and NLP experts to integrate LLM and LLM-based systems and algorithms into the avatar ecosystem. Work with Docker, Kubernetes, and AWS for AI model deployment and scalability. Contribute to code reviews, debugging, and testing to ensure high-quality deliverables. Document work for future reference and improvement.

$40 – $50 / hour
Undisclosed
HOUR

(USD)

Los Angeles, United States
Maybe global
Hybrid

Machine Learning Engineer (AI detection, Toronto)

New
Top rated
GPTZero
Full-time
Full-time
Posted

Design, train, and fine-tune state-of-the-art language models; develop AI agents combined with retrieval-augmented language models; build efficient and scalable machine learning training and inference systems; stay up-to-date with the latest literature and emerging technologies to solve novel problems; work closely with product and design teams to develop intuitive applications that create societal impact.

CA$140,000 – CA$260,000
Undisclosed
YEAR

(CAD)

Toronto, Canada
Maybe global
Hybrid

VP of Engineering – AI

New
Top rated
Bjak
Full-time
Full-time
Posted

Build, scale, and uphold the technical backbone of a global AI product. Personally build critical AI systems while shaping engineering culture, hiring strategy, and long-term technical direction. Set the technical and cultural foundation of the AI organization. Own AI quality, reliability, and scalability end-to-end. Balance research ambition with real product delivery. Act as the final technical decision-maker. Personally build and maintain core AI infrastructure. Design model training, evaluation, and deployment pipelines. Debug and resolve production AI failures. Review and merge critical PRs. Define standards for model lifecycle and experimentation. Design org structure and hiring strategy. Align AI roadmap with business goals.

Undisclosed

()

London, United Kingdom
Maybe global
Remote

Lead Engineer – AI

New
Top rated
Bjak
Full-time
Full-time
Posted

Design and implement end-to-end AI systems, build training, inference, and evaluation pipelines, write production orchestration and feedback code, optimize latency, cost, and model quality, review PRs (pull requests), and mentor engineers. Act as the principal builder of A1's AI systems by writing production code, designing ML pipelines, setting engineering standards, and directly shaping how the AI works in the real world.

Undisclosed

()

London, United Kingdom
Maybe global
Remote

Want to see more ML Infrastructure Engineer jobs?

View all jobs

Access all 4,256 remote & onsite AI jobs.

Join our private AI community to unlock full job access, and connect with founders, hiring managers, and top AI professionals.
(Yes, it’s still free—your best contributions are the price of admission.)

Frequently Asked Questions

Have questions about roles, locations, or requirements for ML Infrastructure Engineer jobs?

Question text goes here

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.

[{"question":"What does a ML Infrastructure Engineer do?","answer":"ML Infrastructure Engineers design, build, and maintain systems that support machine learning workflows from development to production. They create scalable platforms for model training and serving, implement distributed training systems, and develop monitoring solutions to track model performance. These engineers also build data pipelines, optimize ML systems for performance, and implement automated testing and deployment processes while collaborating with data scientists and researchers to productionize ML models."},{"question":"What skills are required for ML Infrastructure Engineer?","answer":"ML Infrastructure Engineers need strong programming skills in Python and sometimes Go, Rust, or C++. Proficiency with ML frameworks like PyTorch and TensorFlow is essential, alongside expertise in cloud platforms (AWS, GCP), containers (Docker), and orchestration (Kubernetes). They should understand distributed systems, data engineering concepts, and model serving techniques. Experience with infrastructure-as-code tools and monitoring systems rounds out the technical requirements, complemented by problem-solving abilities and collaboration skills."},{"question":"What qualifications are needed for ML Infrastructure Engineer role?","answer":"Most ML Infrastructure Engineer positions require a Bachelor's or Master's degree in Computer Science or related field, plus 4-5+ years of experience building production ML systems. Employers typically expect demonstrable experience with cloud platforms, containerization tools, and ML frameworks. Strong understanding of system-level software, machine learning concepts, and resource utilization is necessary. Experience with distributed systems and high-throughput workloads is highly valued, especially for senior positions."},{"question":"What is the salary range for ML Infrastructure Engineer job?","answer":"The research provided doesn't specify salary ranges for ML Infrastructure Engineer jobs. Compensation typically varies based on factors like location, company size, experience level, and specific technical expertise. Organizations like Anthropic, Scale AI, Apple, and other technology companies actively hiring for these positions likely offer competitive compensation packages reflecting the specialized nature of ML infrastructure skills and the current market demand."},{"question":"How long does it take to get hired as a ML Infrastructure Engineer?","answer":"The hiring timeline for ML Infrastructure Engineer positions isn't specified in the provided research. The process typically includes technical interviews focused on systems design, ML fundamentals, and programming skills. Given the specialized nature of the role, companies often conduct thorough evaluations of candidates' experience with production ML systems, distributed computing, and relevant technologies. The specialized requirements may extend the hiring process compared to more general engineering roles."},{"question":"Are ML Infrastructure Engineer job in demand?","answer":"Yes, ML Infrastructure Engineer jobs show strong demand based on active openings at major companies like DataXight, Scale AI, Anthropic, Apple, and Character.AI. The field is growing particularly in specialized areas such as LLM serving infrastructure, on-device ML optimization, and safety-critical ML systems. These positions are distributed across major tech hubs with opportunities ranging from mid-level to senior roles, reflecting industry's increasing need for engineers who can build reliable ML systems at scale."}]