Location
Heidelberg Germany
Germany
Heidelberg Germany
Germany
Salary
(Yearly)
(Yearly)
(Yearly)
(Yearly)
(Yearly)
Salary information is not provided for this position.
Undisclosed
-
Category
Machine Learning Engineer
Date posted
July 4, 2025
Job type
Full-time
Experience level
Mid level

Overview:

You will join our product team in a position that sits at the intersection of artificial intelligence research and real-world solutions. We foster a highly collaborative work culture where you can expect to work closely with your teammates and have a high level of communication between teams through methodologies such as pair or mob programming. 

Your responsibilities:

  • Model Inference: Focus on inference optimization to ensure rapid response times and efficient resource utilization during real-time model interactions.  

  • Hardware Optimization: Run models on various hardware platforms, from high-performance GPUs to edge devices, ensuring optimal compatibility and performance.  

  • Experimentation and Testing: Regularly run experiments, analyze outcomes, and refine the strategies to achieve peak performance in varying deployment scenarios.  

  • Staying up to date with the current literature on MLSys  

Your profile:

  • You care about making something people want. You want to ship something that will bring value to our users. You want to deliver AI solutions end-to-end and not finish building a prototype.  

  • Bachelor's degree or higher in computer science or a related field. 

  • You understand how multimodal transformers work. 

  • You understand the characteristics of LLM inference (KV caching, flash attention, and model parallelization). 

  • You have hands-on experience with large language models or other complex AI architectures. 

  • You have experience in system design and optimization, particularly within AI or deep learning contexts. 

  • You are proficient in Python and have deep understanding of deep learning frameworks such as PyTorch. 

  • A deep understanding of the challenges associated with scaling AI models for large user bases. 
     

Nice if you have:  

  • Previous experience in a high-growth tech environment or a role focused on scaling AI solutions. 

  • Expertise with CUDA and Triton programming and GPU optimization for neural network inference. 

  • Experience with Rust.  

  • Experience in adapting AI models to suit a range of hardware, including different accelerators. 

  • Experience in model quantization, pruning, and other neural network optimization methodologies. 

  • A track record of contributions to open-source projects (please provide links). 

  • Some Twitter presence discussing ML Sys topics. 

What you can expect from us:

  • Become part of an AI revolution!

  • 30 days of paid vacation

  • Access to a variety of fitness & wellness offerings via Wellhub

  • Mental health support through nilo.health

  • Substantially subsidized company pension plan for your future security

  • Subsidized Germany-wide transportation ticket

  • Budget for additional technical equipment

  • Flexible working hours for better work-life balance and hybrid working model

  • Virtual Stock Option Plan

  • JobRad® Bike Lease

Companies size
201-500
employees
Founded in
2019
Headquaters
Heidelberg, Germany
Country
Germany
Industry
Software Development
Social media
Visit website

Similar AI jobs

Here are other jobs you might want to apply for.

US.svg
United States

Research Engineer, Focused Bets

Full-time
Machine Learning Engineer
CA.svg
Canada

Machine Learning Intern/Co-op (Fall 2025)

Intern
Machine Learning Engineer
GE.svg
Germany

Senior AI Inference Engineer - Large Language Models (f/m/d)

Full-time
Machine Learning Engineer
AR.svg
Argentina

LegalTech Startup - AI Engineer

Full-time
Machine Learning Engineer
GE.svg
Germany

Junior AI Solutions Engineer (f/m/d)

Full-time
Machine Learning Engineer
GE.svg
Germany

Senior AI Engineer | TypeScript / NodeJS

Full-time
Machine Learning Engineer