Location
San Francisco United States
San Francisco United States
Salary
(Yearly)
(Yearly)
(Yearly)
(Yearly)
(Yearly)
Salary information is not provided for this position.
Undisclosed
USD
160000
-
230000
Category
MLOps / DevOps Engineer
Date posted
June 18, 2025
Job type
Full-time
Experience level
Mid level

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

As the Research Systems Engineer, you will partner with research professionals to design, implement, and maintain high-performance computing (HPC) clusters and cloud environments to support research and development activities. You will collaborate with research professionals to ensure seamless operation of research environments, including job scheduling, resource allocation, and data management.

Responsibilities:

  • Lead the installation and upgrades of system hardware and software, including computational systems, clusters, standalone machines, storage systems and a variety of network fabrics including Ethernet, InfiniBand, and Fibre Channel.
  • Provide expertise and guidance in HPC infrastructure, design, implementation, and optimization.
  • Serve as the primary technical point of contact for our Research team. Troubleshoot and resolve any system related problems to ensure the Research team’s success in using the environments
  • Coordinate across multi-vendor resources, manage escalations effectively, handle complex issues, and ensure timely and satisfactory resolutions.
  • Maintain detailed documentation of system configurations, procedures, and troubleshooting guides to facilitate knowledge sharing within the Research team.
  • Contribute to the creation of training materials to enable the Research team’s success and platform adoption.
  • Research new and emerging technologies, evaluate workflows and plans, and make recommendations for future improvements to the HPC environment

Qualifications:

  • 5+ years of Linux system administration experience
  • Strong understanding of HPC architectures with GPU management
  • Experience with job schedulers and resource managers (e.g. Slurm)
  • Knowledge of Linux operating systems (e.g., Ubuntu, Red Hat, CentOS)
  • Working experience with programming languages (e.g., Go, Python, Bash)
  • Experience with network protocols (e.g., TCP/IP, InfiniBand)
  • Experience with containerization and virtualization technologies (e.g., Docker, Kubernetes)
  • Knowledge of cloud computing platforms (e.g., AWS, Azure, Google Cloud)
  • Familiarity with machine learning and artificial intelligence frameworks (e.g., TensorFlow, PyTorch)
  • Experience with data analytics, visualization and observability tools (e.g., Grafana, Tableau, Power BI)
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration skills

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Companies size
201-500
employees
Founded in
2022
Headquaters
San Francisco, CA, United States
Country
United States
Industry
Software Development
Social media
Visit website

Similar AI jobs

Here are other jobs you might want to apply for.

PH.svg
Philippines

Professional Services Engineer

Full-time
MLOps / DevOps Engineer
US.svg
United States

Senior IT Engineer

Full-time
MLOps / DevOps Engineer
US.svg
United States

Senior Site Reliability Engineer (Observability & Resilience)

Full-time
MLOps / DevOps Engineer
US.svg
United States

Senior Security Engineer (Application & Cloud Security)

Full-time
MLOps / DevOps Engineer
US.svg
United States

Sr Automation and IT Engineer

Full-time
MLOps / DevOps Engineer
US.svg
United States

Senior Cloud Solutions Engineer

Full-time
MLOps / DevOps Engineer