We are seeking a high-caliber Lead AI & Data Platform Engineer to spearhead the evolution of our next-generation data architecture. In this role, you will bridge the gap between advanced Data Engineering and production-grade MLOps, designing resilient, petabyte-scale systems within a highly regulated Financial Services environment.
You will be our internal Databricks Expert , driving the strategy and deployment of AI Agentic workloads, advanced analytics pipelines, and secure cloud infrastructure.
Key Responsibilities
1. Databricks Platform Excellence
Architect and maintain our enterprise Lakehouse infrastructure utilising Delta Lake and Medallion topology (Bronze/Silver/Gold layers).
Enforce robust data governance and secure discovery across the enterprise using Unity Catalog .
Build, monitor, and scale production pipelines via Delta Live Tables .
2. Production AI & MLOps Infrastructure
Deploy, monitor, and scale production-grade ML and AI Agentic workloads.
Operationalise LLM and Generative AI pipelines utilizing Databricks Mosaic AI , MLflow , Langchain , and Vector Databases .
Manage corporate feature stores and optimize model serving endpoints.
3. AWS Cloud Architecture & Infrastructure as Code (IaC)
Design secure, high-performance cloud environments using Terraform.
Manage intricate AWS configurations including S3 optimization, VPC peering, AWS PrivateLink, and granular IAM roles.
Integrate cloud-native AI services like AWS Bedrock seamlessly into our data ecosystem.
4. Performance Tuning & Streaming
Conduct advanced Spark optimization to handle high-concurrency, petabyte-scale data pipelines.
Tune GPU clusters specifically optimized for heavy AI/ML training and inference workloads.
Architect real-time streaming pipelines leveraging Kinesis or Kafka.
Your Profile
To be successful in this role, you will bring a blend of elite engineering skills and a deep understanding of modern data-ops.
Technical Requirements:
Core Languages: Mastery of PySpark , Python , SQL , and Scala .
AI Frameworks: Strong familiarity with PyTorch , TensorFlow , or Hugging Face .
DataOps & CI/CD: Proven experience embedding automated testing and CI/CD pipelines into data deployments.
Industry Experience: Prior experience within Financial Services or a similarly regulated environment is highly desirable (understanding of data privacy, compliance, and risk frameworks).
What’s on Offer
Competitive Compensation: $180K – $210K base salary, depending on experience.
Hybrid Flexibility: A healthy balance of remote work and collaborative time in our modern Melbourne CBD office.
Cutting-Edge Tech Stack: Total backing to utilize the absolute latest in Generative AI, Mosaic AI, and cloud-native tools.
Principal Data Engineer & Designer Are you ready to architect the future of data in a high-performance, mission-critical environment? Come and join this established enterprise data team and lead and own the design and development of scalable, secure data solutions on AWS. In this 50/50 hands on role you’ll architect and ...
... all about As Principal Engineer – Data Mesh , you’ll be a pivotal technical leader for the Data Intelligence tribe and a key contributor to REA’s enterprise data strategy. You’ll define and drive the technical direction for REA’s Data Mesh implementation across multiple squads, domains and engineering teams. You’ll connect ...
... loops and measurable quality signals rather than opinion alone - Embed fitness functions, architecture measures and technical feedback loops into how product engineering works - Partner closely with the Data Engineering function on the data and AI reference architecture - Ensure tenancy, security and compliance are designed ...
A tremendous opportunity awaits a Financial Crime Principal level Engineer to collaborate a highly respected team. You will join a high‑impact engineering group responsible for building and evolving the bank’s risk and fraud detection engines. As the organisation scales rapidly, this team is central to protecting customers, ...
... continuous improvement across the business. Here's what you'll need - Significant experience within consulting engineering, with a strong background in electrical engineering and building services. - Recognised technical expertise within one or more sectors such as healthcare, mission critical facilities, data centres, defence, ...
... who is based in Perth and is one of our AI Apps & Data Practice Leads. He champions a culture of ownership, innovation, and client-first delivery, empowering engineers to drive real business outcomes while maintaining the highest standards of technical excellence and commercial discipline. As a Forward Deployed Engineer Principal ...
... and ensure efficiency. - Familiarity with Linux security controls, SSH, sudo, SELinux, certificate management, vulnerability remediation, and system hardening. Datacentre and Hardware Support - Visit datacentres as required for installations, maintenance, troubleshooting, and incident resolution. Maintain accurate hardware ...
... validate that the design and configuration of our products and services meet security requirements. Engineering owns the design; you make sure it holds up. As a principal individual contributor, you’ll also share your expertise with the team, mentoring other engineers, including senior engineers, and helping lift security capability ...
... and build a life in one of the world's most livable countries, ADG could be your next move. Your role Our Brisbane office is currently seeking to appoint a Principal Engineer - Civil with significant engineering design experience, strong communication skills and the desire to lead and mentor both local and nationally. This ...
... and build a life in one of the world's most livable countries, ADG could be your next move. Your role Our Brisbane office is currently seeking to appoint a Principal Engineer - Civil with significant engineering design experience, strong communication skills and the desire to lead and mentor both local and nationally. This ...