About this role
Introducing Moonlake, AI for creating world simulations.
OVERVIEW
Moonlake is building the frontier of interactive world models: systems that generate, simulate, and reason over 3D environments for embodied AI, robotics and gaming. We develop the simulation infrastructure to build worlds (e.g., assets, scenes, digital twins) at scale.
Our team sits at the intersection of:
- Embodied AI
- Robotics simulation
- Interactive 3D worlds
- World models
- Real-time generation
- AI infrastructure
Moonlake is building the next generation of AI infrastructure for interactive digital worlds. Our mission is to enable anyone to create, simulate, and interact with rich environments using natural language and multimodal inputs, turning simple ideas into worlds with structure, logic, and agents that can perceive and act.
Our team has raised $28M in seed funding from NVIDIA Ventures, Threshold Ventures, AIX ventures and notable angels including Naval Ravikant and Jeff Dean to build the foundational layer for the future of AI - powering everything from creative tools and games to robotics training, simulations, and digital twins. Our goal is to make building and experimenting with these environments as accessible and scalable as publishing video on the internet.
We are looking for exceptional research engineers and applied researchers to help push the frontier of interactive AI.
THE ROLE
We’re looking for a Member of Technical Staff — Data & ML Infrastructure Engineer to help build and optimize the systems that power Moonlake’s model training and inference infrastructure.
This role sits at the core of Moonlake’s platform and focuses on one mission:
Improve throughput, latency, and cost — deploying models 2–10× faster and cheaper without quality regressions.
You’ll work across GPU kernels, inference systems, distributed training, serving infrastructure, observability, and large-scale orchestration systems.
This is a highly technical systems role intended for engineers who enjoy operating at the intersection of:
- ML systems
- Distributed infrastructure
- GPU optimization
- Production AI deployment
- Performance engineering
This role emerged directly from Moonlake’s need to better support large-scale world-model training and deployment infrastructure.
WHAT YOU’LL DO
- Optimize large-scale model training and inference systems
- Improve GPU utilization, latency, throughput, and deployment efficiency
- Build infrastructure that supports real-time world-model and multimodal workloads
- Develop and optimize serving pipelines for frontier AI systems
- Work closely with research teams to productionize high-performance models
- Build scalable orchestration and observability systems for distributed AI infrastructure
- Improve reliability, rollout safety, autoscaling, and production monitoring
- Design systems that support fast experimentation without sacrificing stability
SCOPE OF WORK
GPU Performance Optimization
- CUDA / Triton kernels
- FlashAttention family
- Paged attention
- CUDA Graphs
- Memory optimization
- Kernel-level performance tuning
Model Serving & Inference
- TensorRT-LLM
- Triton Inference Server
- vLLM / TGI
- Continuous batching
- On-GPU KV cache reuse
- Speculative decoding / Medusa
- Mixture-of-agents routing
Distributed Training & Parallelism
- FSDP / ZeRO
- Tensor parallelism
- Pipeline parallelism
- Expert parallelism
- NCCL tuning
- Multi-node GPU orchestration
Quantization & Efficient Fine-Tuning
- AWQ / GPTQ / FP8
- LoRA / DoRA serving
- Efficient deployment pipelines
Infrastructure & Systems
- Ray
- Kubernetes
- Argo
- Autoscaling systems
- Canary deployments & rollback infrastructure
- A/B experimentation systems
- Observability stack:
- Prometheus
- Grafana
- OpenTelemetry
WHY THIS ROLE MATTERS
Moonlake’s products require real-time, highly efficient AI infrastructure capable of powering interactive worlds and embodied intelligence systems at scale.
The difference between:
- 200ms and 2s latency
- 40% and 90% GPU utilization
- Stable rollout and catastrophic regression
…directly impacts the company’s ability to train, deploy, and scale world-model systems.
You’ll help define the infrastructure foundation behind the next generation of interactive AI systems.
We are committed to being an on-site, in-person team currently based in San Francisco.
OVERVIEW
Moonlake is building the frontier of interactive world models: systems that generate, simulate, and reason over 3D environments for embodied AI, robotics and gaming. We develop the simulation infrastructure to build worlds (e.g., assets, scenes, digital twins) at scale.
Our team sits at the intersection of:
- Embodied AI
- Robotics simulation
- Interactive 3D worlds
- World models
- Real-time generation
- AI infrastructure
Moonlake is building the next generation of AI infrastructure for interactive digital worlds. Our mission is to enable anyone to create, simulate, and interact with rich environments using natural language and multimodal inputs, turning simple ideas into worlds with structure, logic, and agents that can perceive and act.
Our team has raised $28M in seed funding from NVIDIA Ventures, Threshold Ventures, AIX ventures and notable angels including Naval Ravikant and Jeff Dean to build the foundational layer for the future of AI - powering everything from creative tools and games to robotics training, simulations, and digital twins. Our goal is to make building and experimenting with these environments as accessible and scalable as publishing video on the internet.
We are looking for exceptional research engineers and applied researchers to help push the frontier of interactive AI.
THE ROLE
We’re looking for a Member of Technical Staff — Data & ML Infrastructure Engineer to help build and optimize the systems that power Moonlake’s model training and inference infrastructure.
This role sits at the core of Moonlake’s platform and focuses on one mission:
Improve throughput, latency, and cost — deploying models 2–10× faster and cheaper without quality regressions.
You’ll work across GPU kernels, inference systems, distributed training, serving infrastructure, observability, and large-scale orchestration systems.
This is a highly technical systems role intended for engineers who enjoy operating at the intersection of:
- ML systems
- Distributed infrastructure
- GPU optimization
- Production AI deployment
- Performance engineering
This role emerged directly from Moonlake’s need to better support large-scale world-model training and deployment infrastructure.
WHAT YOU’LL DO
- Optimize large-scale model training and inference systems
- Improve GPU utilization, latency, throughput, and deployment efficiency
- Build infrastructure that supports real-time world-model and multimodal workloads
- Develop and optimize serving pipelines for frontier AI systems
- Work closely with research teams to productionize high-performance models
- Build scalable orchestration and observability systems for distributed AI infrastructure
- Improve reliability, rollout safety, autoscaling, and production monitoring
- Design systems that support fast experimentation without sacrificing stability
SCOPE OF WORK
GPU Performance Optimization
- CUDA / Triton kernels
- FlashAttention family
- Paged attention
- CUDA Graphs
- Memory optimization
- Kernel-level performance tuning
Model Serving & Inference
- TensorRT-LLM
- Triton Inference Server
- vLLM / TGI
- Continuous batching
- On-GPU KV cache reuse
- Speculative decoding / Medusa
- Mixture-of-agents routing
Distributed Training & Parallelism
- FSDP / ZeRO
- Tensor parallelism
- Pipeline parallelism
- Expert parallelism
- NCCL tuning
- Multi-node GPU orchestration
Quantization & Efficient Fine-Tuning
- AWQ / GPTQ / FP8
- LoRA / DoRA serving
- Efficient deployment pipelines
Infrastructure & Systems
- Ray
- Kubernetes
- Argo
- Autoscaling systems
- Canary deployments & rollback infrastructure
- A/B experimentation systems
- Observability stack:
- Prometheus
- Grafana
- OpenTelemetry
WHY THIS ROLE MATTERS
Moonlake’s products require real-time, highly efficient AI infrastructure capable of powering interactive worlds and embodied intelligence systems at scale.
The difference between:
- 200ms and 2s latency
- 40% and 90% GPU utilization
- Stable rollout and catastrophic regression
…directly impacts the company’s ability to train, deploy, and scale world-model systems.
You’ll help define the infrastructure foundation behind the next generation of interactive AI systems.
We are committed to being an on-site, in-person team currently based in San Francisco.
Tech stack
LLMKubernetes
About Moonlake AI
Moonlake AI is hiring for the member of technical staff - data & ml infra engineer role. NewJob aggregates active openings directly from Moonlake AI's applicant tracking system, so this listing is current.
More jobs at Moonlake AI →