Vacancy description

Senior Software Engineer — Task Ideation in Australia

Vetto

  • RemoteWork from anywhere
  • Part-timeFewer hours each week

Australia

About the Project

We build hard, verifiable command-line tasks used to evaluate frontier AI agents.

AI agents are good at the textbook. They still fail where experience matters: a default nobody questions, a rule nobody wrote down, a fix that looks right and isn't. Much of the work starts from real episodes from your own experience, such as a production incident, a performance problem, or a result that looked right but was wrong. These are captured through an AI-guided interview and turned into tasks.

Some engineers also pair with domain specialists (scientists, operations professionals, hardware engineers) and turn their expertise into working tasks.

Who we're looking for

  • Core Task Engineer: senior generalist (backend, data or SRE), 5+ years at a real company, has handled production incidents and writes tests. Production Python plus Go, Rust, TypeScript or C++; Docker, pytest, advanced Linux. No specific domain needed.
  • Systems & Storage Specialist: 6+ years working inside engines like Postgres, RocksDB, Kafka, Spark or the Linux kernel, not just using them. Production C, C++, Rust, Go or Scala; expert Linux (concurrency, I/O, ptrace).
  • ML Systems & Research Specialist: ML infrastructure (GPUs, distributed training, serving), not notebook data science. MSc/PhD or 3–5 years in ML infra; PyTorch or JAX, CUDA or Triton.
  • Security Researcher: AppSec, cryptography, forensics or firmware; 3+ years of CTF or 4+ years in industry. Python and C, Ghidra, QEMU. Published CTF challenges or credited CVEs are a strong signal.
  • Red-Team / QA Reviewer: attacker mindset (CTF player, pentester, bug hunter); 4+ years in SWE, SRE or security, or 3+ years of CTF. Reviews tasks in every category and tries to pass the tests without solving the problem.
  • Benchmark Infra Engineer: DevOps, SRE or platform, 5+ years; Docker/BuildKit, CI pipelines, cloud GPUs. Builds the environments tasks run on; does not write tasks.
  • Calibration Lead: 7+ years; has led code review, QA or evaluation of technical work. Sets the quality bar and writes the guidelines. Excellent written English. Very few positions.

Responsibilities

Depending on your profile:

  • Share real episodes from your work through AI-guided interviews, with concrete detail (tools, versions, files, error messages, numbers)
  • Design and build tasks: Docker environment, instruction, reference solution and tests
  • Pair with domain specialists to turn their expertise into working tasks
  • Review tasks and try to break them: pass the tests without solving the problem

Project Details

Remote, task-based work in Vetto Arena. Compensation is paid per approved task.

This role is not about writing more code. It is about the hard problems you have solved, and turning them into tasks a program can check.

Similar vacancies

More like this role

  • Remote
  • Part-time
  • Contract
  • IT

$80 - $120 per hour

... data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity. Job Title: Senior Software Engineer Job Type: Contractor (~15 hrs a week) Location: Remote (Globally) Job Summary: In this role, you'll apply your expertise to help train next-generation ...

Australia

Insignia Financial

Senior Software Engineer

  • Full-time
  • IT
... supports better financial advice experiences - Work across the full software development lifecycle in an Agile environment - Join a senior role focused on modern engineering, automation and continuous improvement The opportunity to join our team Join Insignia Financial as a Senior Software Engineer full-stack Java, within our ...

Perth, Australia

  • Hybrid
  • Full-time
  • IT

A$137.6 AUD

... both to enhance our existing MongoDB cloud storage architecture and to power more of our customers' use cases more efficiently. We are looking for talented Senior Engineers to join the team and be founding members of the team, where you will play a crucial role in our multi-year roadmap. Our team champions a strong culture ...

Syd, Australia

Topcon Positioning

Senior Software Engineer

  • Full-time
  • IT
... agriculture solutions that help farmers increase productivity, improve sustainability, and make data-driven decisions every day. We're looking for an experienced Senior Software Engineer to join our Adelaide-based engineering team and help shape the next generation of innovative agricultural technology used around the world. ...

Adelaide, Australia

  • Hybrid
  • Full-time
  • IT
  • Legal
... streamline their workflow, boost productivity, and provide more efficient client service. Our team of AI experts and engineers collaborate to develop intelligent software tailored to the unique needs of lawyers, paralegals, and legal assistants. Our innovative AI solutions automate routine tasks, simplify document management, ...

Syd, Australia

  • Remote
  • Hybrid
  • On-site
  • IT
... Communications System (DHFCS), a critical capability connecting Australian Defence Force command centres with deployed aircraft, ships and land forces. As a Senior Software Engineer, you will lead and deliver software maintenance activities and engineering changes, developing and maintaining software components and associated ...

Keswick, Australia

  • Hybrid
  • Full-time
  • IT
  • Legal
... streamline their workflow, boost productivity, and provide more efficient client service. Our team of AI experts and engineers collaborate to develop intelligent software tailored to the unique needs of lawyers, paralegals, and legal assistants. Our innovative AI solutions automate routine tasks, simplify document management, ...

Syd, Australia

  • Full-time
  • IT
About the Role Our Senior Software Engineers work closely with other members of the engineering team to scope, design, document, develop, integrate and test software to address end-user needs for a large web-based application. Responsibilities - Designing, implementing and testing software components in Java - Design and ...

Adelaide, Australia

  • Remote
  • Hybrid
  • Full-time
  • IT
... lifecycle. - Contribute to Jira Coding Agent and Autodev. - Help drive increased agent invocations across the AI SDLC. - Work as a backend-leaning full-stack engineer with a strong product mindset. Requirements - Senior-level full-stack software engineering experience with a backend focus. - Strong technical proficiency. ...

Australia

Ecommerce Equation

Senior Software Engineer

  • Full-time
  • Contract
  • IT
... here to help brands grow profitably, sustainably, and smart. Our thing? Blending world-class strategy with real-world implementation. Reporting to our Head of Engineering, you’ll work alongside our Sydney-based Product and Engineering team to build and scale our growing platform. As our Senior Software Engineer, you’ll take ...

Syd, Australia