hiringremote.Get free job alerts

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

$90–120/hr · AI expert network · remote, 40 hrs/week

Open to people living in the United States, Canada, the United Kingdom and any EU country.

Check history

CheckedStatusSlots leftChangeHow
27 Oct 2026Open500Script, platform’s board
26 Oct 2026Open500Script, platform’s board
25 Oct 2026Open500Script, platform’s board
24 Oct 2026Open50–Script, platform’s board

The script reads the platform’s own job board every night. A job not confirmed for 10 days comes off the list.

What the work is

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is especially valuable. This role involves AI model training and evaluation work, including writing and assessing ML systems tasks and solutions to generate high-quality training data for frontier AI systems.

Key Responsibilities

  • Design challenging tasks across kernels, profiling, debugging and inference serving, including adversarial problems that expose where frontier models fail on accelerator code (for example Pallas kernels on TPU), and write accurate, well-structured solutions to them.
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers and training infrastructure topics.
  • Evaluate ML systems tasks and solutions, and provide clear written technical feedback that stands up to expert review.
  • Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Collaborate with other subject matter experts to keep training data consistent and accurate.

Who gets hired

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
  • Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS); performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching).
  • Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, torch.compile, MLIR).
  • Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency and memory trade-offs.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

The platform posted this on 22 Oct 2026.

More jobs like this

Open the full list
  1. –Generalist Expert$40–70/hrAI expert networkno degreeUS, CA, UK +1US, CA, UK +1Checked auto, 27 Oct
  2. Posted 24 OctRadiologist$350/hrAI expert network4 slots leftUS, CA, UK +1US, CA, UK +1Checked auto, 27 Oct
  3. Posted 24 OctOrthopedic Surgeon$350/hrAI expert network1 slot leftUS, CA, UK +1US, CA, UK +1Checked auto, 27 Oct
  4. Posted 24 OctObstetrician-Gynecologist (OB/GYN)$200/hrAI expert network2 slots leftUS, CA, UK +1US, CA, UK +1Checked auto, 27 Oct
  5. Posted 24 OctCritical Care Physician$200/hrAI expert network1 slot leftUS, CA, UK +1US, CA, UK +1Checked auto, 27 Oct