Back to list

Vacancy description

Senior Data Engineer in Brisbane, Australia

CareCone Group

  • Full-timeStandard weekly hours

Brisbane, Australia

Job Title : Senior Databricks Engineer

Location : Brisbane

Mode: Permanent

We are looking for a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks . The ideal candidate should have a solid background in designing, developing, and supporting enterprise data integration solutions, along with experience working in AWS cloud environments.

This role requires someone who will balance core platform engineering with high-stakes Data Business As Usual (BAU) operations. This engineer will have strong expertise in managing, optimizing, and supporting enterprise data pipelines hosted on AWS (S3) and Databricks . A strong background in ITIL and ITSM frameworks is critical, as you will play a key role in ensuring SLA compliance, platform stability, incident resolution, and continuous improvement for production data ecosystems.

Technical Competency & Requirements

Data BAU, ITIL & ITSM (Critical)

  • Strong hands-on experience in Data BAU operational support , managing production data pipelines, data freshness, and data quality alerts.
  • In-depth understanding of ITIL frameworks and ITSM practices (Incident, Problem, Change, and Release management).
  • Experience using ITSM ticketing tools (e.g., ServiceNow, Jira Service Management) to track SLAs, manage high priority/impact incidents, and document RCAs.

AWS & Databricks Ecosystem

  • Hands-on experience with AWS services such as S3.
  • Advanced proficiency in Databricks Development work using pyspark and including contemporary features: Unity Catalog , Delta Live Tables (DLT) i.e. lakeflow pipelines , Serverless compute , SQL Warehouse, Dashboarding, Alerting etc
  • Good experience working with performance tuning using Liquid Clustering , Z-Ordering, and Spark query optimization.
  • Practical experience of managing workloads with Databricks Asset Bundles (DABs) .

Data Ecosystem & Infrastructure

  • Advanced experience with dbt (dbt Core or Cloud) for version-controlled data transformations.
  • Kafka-based streaming data pipelines to support real-time and near real-time data integration requirements.
  • Proven track record using Terraform for Infrastructure as Code (IaC) to provision AWS and Databricks resources.
  • Production-grade experience with GitLab for source control and automated GitLab CI/CD pipelines.
  • Good experience with unix/linux environment.

Preferred

  • Experience in the Airline/Aviation domain is highly preferred.
  • Databricks certifications will be an added advantage.

Interested candidates can send their updated resume to ***email_hidden*** orreach me @ M: 61283195529

Similar vacancies

More like this role

  • Hybrid
  • Contract
... intelligence and enterprise reporting solutions . - Strong technical experience in data engineering, data integration, ETL processes, data transformation and data modelling . - Demonstrated experience with Microsoft data and analytics technologies, including Power BI. - Strong understanding of data governance, data quality, ...

Canberra, Australia

AustralianSuper

Senior Data Engineer

  • Hybrid
  • Full-time
... members. Your New Role Are you a Data Engineer excited by AI, modern data platforms and the opportunity to work with genuinely large-scale enterprise data? As Senior Data Engineer , you'll join a stable, high-performing team building the next generation of AustralianSuper's data capabilities. You'll design and engineer high-quality ...

Greater Melbourne, Australia

  • Hybrid
  • Part-time
... Senior Data Engineer at Nine, you will work within the Enterprise Data business unit to build high-performing data products and reduce complexity across our data systems and models. You will partner closely with our Product function to enable innovative solutions, specifically focusing on the Data Publishing space. Your ...

North Sydney, Australia

  • Full-time
  • DevOps
... data engineers, who are dedicated to managing Atlassian's customer-facing data platform. Responsibilities - Design, develop and own delivery of high quality big data and software solutions aiming to solve business needs. - Collaborate with cross-functional teams, senior engineers and architects across multiple disciplines ...

Syd, Australia

  • Hybrid
  • Full-time
  • Consulting

A$8.25 AUD

... Flavel, based in Sydney. He fosters a collaborative, delivery-focused environment where technical excellence and client success go hand-in-hand. Requirements As a Senior Consultant - Data Engineer , you will be a trusted advisor to our clients, designing and delivering modern enterprise data platforms that drive analytics, AI ...

Greater Melbourne, Australia

  • Full-time
  • Consulting
... high-performing teams and delivering cutting-edge data and AI solutions? Join us as a Senior Databricks Consultant to lead projects and mentor consultants as a Databricks specialist, and help shape the future of data, analytics and AI for our clients. About the Role As our Senior Databricks Consultant, you will lead Databricks ...

Greater Melbourne, Australia

  • Full-time
  • Part-time
  • DevOps
  • Operations

A$130046 AUD - A$134956 AUD

... policies, standards and guidelines for use of patient data Undertaking the Data and Analytics platform maintenance and enhancement, provisioning of enterprise data assets and enabling technologies, with operations support under the direction of the Program Director. The Senior Data Platform Engineer has responsibility for ...

Adelaide, Australia

  • Contract
Purpose: provide data engineering and analysis skills to data heavy deliverables. Seniority: Mid to senior. Reports to: Data Architect. Responsibilities • Build version controlled pipelines for profiling, cleansing, transformation and migration. • Automate reconciliation between legacy and target (counts, control totals, ...

Traralgon, Australia

  • Hybrid
  • Full-time
  • Contract
  • AI / ML
... data engineering, machine learning, analytics, or data science. You'll design and scale enterprise-level, fully automated Agentic AI solutions, and speed up data platform migrations. Location: Melbourne, Sydney, Brisbane, Perth As a Senior Data&AI Engineer you will - Work on complex data solutions that meet and exceed ...

Greater Melbourne, Australia

  • Hybrid
  • Full-time
... as a Senior Data Integration Engineer (Informatica Cloud) What’s the role? Data is at the heart of every great customer experience, and we're looking for a Senior Data Integration Engineer to join our Data Engineering Hub within Consumer & UNITE Technology. In this role, you'll help design and deliver modern data integration ...

Surfers Paradise, Australia