Back to list

Vacancy description

ML Engineer in Greater Melbourne, Australia

Base Compute

Greater Melbourne, Australia

Base Compute is an AI inference lab. Our mission is to bring AGI on device. We believe in a world where everyone has access to intelligence: fast, private and always available on your device.

We’re building the infrastructure for the next generation of on-device AI, from silicon-level optimizations to distributed inference systems.

We’re working on hard problems at the intersection of inference efficiency, model intelligence and autonomous research.

The Role

We’re looking for an ML Engineer to work at the frontier of on-device AI. This role is for someone who lives at the intersection of systems engineering and machine learning, turning state-of-the-art research into hyper-optimized, production-ready infrastructure.

You’ll have significant ownership over our entire inference stack and direct influence on the technical bets the company makes.

What You’ll Work On

  • Inference engine development: Building and scaling our custom inference engine, handling everything from weight loading and KV-cache management to efficient request scheduling
  • Cross-platform silicon optimization: Writing and tuning custom kernels and leveraging hardware-specific instructions to squeeze maximum performance out of diverse architectures, including Apple Silicon, NVIDIA, AMD, Snapdragon, and other edge platforms
  • Systems architecture: Developing robust, low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies under strict thermal and memory constraints
  • Performance profiling: Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving

What We’re Looking For

  • 3+ years of experience in ML engineering or systems programming (Rust, C/C++), with a strong track record of building performance-critical software
  • Expertise in GPU programming and hardware optimization across various platforms (CUDA, ROCm, Metal, Triton, or similar)
  • Solid understanding of modern LLM architectures, including parsing formats and implementing optimization techniques (quantization, speculative decoding, etc.)
  • A strong sense of ownership and autonomy: the ability to take ambiguous architectural challenges and drive them from research translation directly into production-ready infrastructure
  • Good communication: the ability to explain complex architectural decisions simply, give honest feedback and document systems cleanly
  • Nice-to-haves:
    • Familiarity with ML compilers (https://jobeax.com/link/9JdZk1KKklJ04dJu, custom operators)
    • Experience with low-precision inference (INT8/FP8/FP4)
    • Knowledge of Edge LLMOps

What we offer

  • Equity and strong base salary
  • Direct influence on technical direction: your ideas will shape the roadmap
  • Work on genuinely hard problems that haven't been solved yet
  • Small team, fast iteration, low bureaucracy

Location

The team is based in Melbourne and Berlin and works in-person from the office most days. We require strong written and spoken English, since the team collaborates across time zones.

Similar vacancies

More like this role

Redhorse Corporation

Senior Ai/ML Engineer

  • Full-time
  • Contract

$180,000 - $200,000

... knowledge graph capabilities to support semantic reasoning, data integration, and AI-enabled decision support. - Provide technical leadership to multi-functional engineering teams, mentoring junior engineers and guiding best practices for model development, MLOps, testing, documentation, and secure deployment. - Collaborate with ...

Australia

  • Full-time
... it with the help of our most strategic asset: our people. To support our customer, we are looking for a: AI/ML ENGINEER - Senior TASKS: - Develop and deploy AI/ML solutions, including machine learning models, Generative AI, LLMs, NLP systems, APIs, and RAG architectures. - Manage the full ML lifecycle, from data preparation ...

Australia

  • Remote
  • Full-time
... expected, but our ideal colleague shares our passion for building impactful solutions that make it all the way into production. As one of our most experienced engineers, you will mentor others, help shape our AI technical strategy, and work with product and business stakeholders to turn open questions into clear recommendations. ...

Australia

  • Hybrid
  • Full-time
  • Contract
  • AI / ML
... workloads within AWS - Develop scalable data and inference pipelines - Evaluate model performance and improve accuracy, reliability and efficiency - Work with engineering and business stakeholders to translate real-world problems into practical ML solutions - Contribute to MLOps, automated deployment, monitoring and model ...

Greater Melbourne, Australia

  • Remote
  • Full-time
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior ML Engineer - Malware Detection based remotely in Australia. The Senior ML Engineer will develop and deploy advanced machine learning solutions to detect web-based malware across large-scale ...

Australia

  • Part-time
Required Qualifications A master’s degree or PhD in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics, Statistics, Engineering, or a closely related quantitative discipline. Strong professional or research experience in machine learning. Practical proficiency with Python and coding agents. ...

Australia

ASG Technologies

AI/ML Software Engineer

  • Full-time
  • IT

$200,000 - $250,000

... This role is a hands-on builder for ASG’s portfolio companies, focused on developing AI/ML systems and data platforms that unlock new value from data. The AI/ML Engineer will lead and contribute directly to projects such as internal LLM applications, data pipelines, ML-powered product capabilities, and scalable data infrastructure. ...

Australia

  • Full-time
  • AI / ML
  • Consulting
Job Requisition ID: 42048 Senior Consultant - GCP AI/ML Engineer - Design, develop and deploy AI/ ML, and intelligent agent solutions on Google Cloud Platform (GCP). - Build production-ready solutions using Google Cloud Gemini Enterprise Agent Platform (Vertex AI), Python / R and cloud-native data and application services. ...

Brisbane, Australia

Job Description TikTok is offering an internship in the Trust & Safety team in Australia. You will contribute to building safety systems and ML-powered classifiers that scale to a global audience, with exposure to data mining techniques and cutting-edge AI research. Ideal candidates are pursuing CS degrees with strong foundations ...

Syd, Australia

  • AI / ML
Job Description As a Machine Learning Engineer, you will play a pivotal role in building systems that drive the training and deployment of large-scale ML models across our global operations. You'll collaborate with leading researchers, hardware experts, and software engineers to build robust solutions that maximize the ...

Syd, Australia