Vacancy description

MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) in Australia

Mercor

  • RemoteWork from anywhere
  • Full-timeStandard weekly hours
  • ContractFixed-term or freelance

$90 - $120 per hour

Australia

Pay: $90 – $120/hour
Commitment: Hourly, ~40 h/week
Field: Software Engineering

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

1\. Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is especially valuable. This role involves AI model training and evaluation work, including writing and assessing ML systems tasks and solutions to generate high-quality training data for frontier AI systems.

This is a fully remote role open to candidates worldwide. Depending on where you are based, your engagement will be arranged through Cincinnatus LLC or one of its trusted employer-of-record partners in your country, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements.

2\. Key Responsibilities

  • Design challenging tasks across kernels, profiling, debugging and inference serving, including adversarial problems that expose where frontier models fail on accelerator code (for example Pallas kernels on TPU), and write accurate, well-structured solutions to them.
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers and training infrastructure topics.
  • Evaluate ML systems tasks and solutions, and provide clear written technical feedback that stands up to expert review.
  • Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Collaborate with other subject matter experts to keep training data consistent and accurate.

3\. Core Qualifications

  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
  • Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS); performance profiling and trace analysis (JAX/XLA profiler, Kineto, https://jobeax.com/link/RC1kona64DdQ8XKy, Nsight); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching).
  • Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, https://jobeax.com/link/9JdZk1KKklJ04dJu, MLIR).
  • Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency and memory trade-offs.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

About Cincinnatus LLC:

Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and engage highly skilled professionals for contingent and contract-based opportunities. Working directly or through local employer-of-record partners, Cincinnatus handles the employment or contracting relationship, payroll, benefits where applicable, and compliance in each country, while placing professionals directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity:

Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

Similar vacancies

More like this role

  • Remote
  • Full-time
  • Contract

$90 - $120 per hour

... seeking MLOps and ML systems engineers with hands-on experience in large language model infrastructure across any of four areas: accelerator kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. Experience with JAX, XLA or TPUs is ...

Australia

Base Compute

ML Engineer

... low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies under strict thermal and memory constraints - Performance profiling: Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving What We’re Looking For - ...

Greater Melbourne, Australia

Mane Consulting

MLOps Engineer

  • Full-time
... rapid iteration, versioning and safe deployment of ML assets. - Manage cloud and on‑prem environments for ML workloads, including compute, storage and model‑serving infrastructure. - Implement monitoring, logging and alerting to track model performance, detect drift and ensure high availability. - Partner with engineering, ...

Greater Melbourne, Australia

  • Remote
  • Hybrid
  • Full-time
  • IT
... high-performance GPU and CPU applications with strong focus on latency and throughput - Hands-on experience with third-party libraries and designing custom CUDA kernels - Proficient with profiling and performance analysis tools (Nsight Systems, Nsight Compute, nvprof) - Solid understanding of data structures, algorithms, and ...

Australia

  • On-site
  • Full-time
  • Contract
... reviews, mentoring engineering teams, ensuring security and compliance of AI systems, and continuously optimizing performance, reliability, and cost of production LLM, VLM services. Qualifications - Strong architecture skills in designing scalable, secure, and reliable AI/ML and LLM-based systems, including cloud-native microservices ...

Greater Melbourne, Australia

  • Full-time
  • AI / ML
... meeting great people in tech. Join the G2i Talent Pool and let us get to know you. G2i works with top AI labs and fast-growing companies. Our community of engineers works on real projects, from evals and RL environments to training data for frontier models. Who we’re looking for Software, data, AI/ML, infrastructure, security, ...

Australia

Professional Search Group

Principal Data Engineer

  • Remote
  • Hybrid
  • Full-time
  • Contract
  • DevOps

$180,000 - $210,000

... AI & Data Platform Engineer to spearhead the evolution of our next-generation data architecture. In this role, you will bridge the gap between advanced Data Engineering and production-grade MLOps, designing resilient, petabyte-scale systems within a highly regulated Financial Services environment. You will be our internal ...

Docklands, Australia

  • QA
... the performance, scalability, reliability, and stability of critical banking applications, batch processes, and data warehouse workloads through end-to-end performance engineering and testing activities. Responsibilities Develop and maintain performance test strategies, plans, and execution schedules. Design performance ...

Brisbane, Australia

  • Full-time
  • Contract
... building services, property operations, asset management, facilities engineering or a related environment. You’ll also have: - Relevant tertiary qualification in engineering, such as mechanical, electrical, building services, mechatronic or another discipline relevant to the operation and performance of commercial property assets. ...

Syd, Australia

Vivid Techno Solutions Pty Ltd

Senior Performance/NFT Engineer

  • Contract

10k

... projects like Commsee 2.0, Netbank 2.0, and Commbiz. These APIs are pivotal for the Bank's digital transformation, with a specific focus on ensuring high performance, scalability, and reliability. The Senior Performance Engineer will play a key role in driving the performance engineering efforts, working towards achieving ...

Syd, Australia