We are looking for a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks . The ideal candidate should have a solid background in designing, developing, and supporting enterprise data integration solutions, along with experience working in AWS cloud environments.
This role requires someone who will balance core platform engineering with high-stakes Data Business As Usual (BAU) operations. This engineer will have strong expertise in managing, optimizing, and supporting enterprise data pipelines hosted on AWS (S3) and Databricks . A strong background in ITIL and ITSM frameworks is critical, as you will play a key role in ensuring SLA compliance, platform stability, incident resolution, and continuous improvement for production data ecosystems.
Technical Competency & Requirements
Data BAU, ITIL & ITSM (Critical)
Strong hands-on experience in Data BAU operational support , managing production data pipelines, data freshness, and data quality alerts.
In-depth understanding of ITIL frameworks and ITSM practices (Incident, Problem, Change, and Release management).
Experience using ITSM ticketing tools (e.g., ServiceNow, Jira Service Management) to track SLAs, manage high priority/impact incidents, and document RCAs.
AWS & Databricks Ecosystem
Hands-on experience with AWS services such as S3.
Advanced proficiency in Databricks Development work using pyspark and including contemporary features: Unity Catalog , Delta Live Tables (DLT) i.e. lakeflow pipelines , Serverless compute , SQL Warehouse, Dashboarding, Alerting etc
Good experience working with performance tuning using Liquid Clustering , Z-Ordering, and Spark query optimization.
Practical experience of managing workloads with Databricks Asset Bundles (DABs) .
Data Ecosystem & Infrastructure
Advanced experience with dbt (dbt Core or Cloud) for version-controlled data transformations.
Kafka-based streaming data pipelines to support real-time and near real-time data integration requirements.
Proven track record using Terraform for Infrastructure as Code (IaC) to provision AWS and Databricks resources.
Production-grade experience with GitLab for source control and automated GitLab CI/CD pipelines.
Good experience with unix/linux environment.
Preferred
Experience in the Airline/Aviation domain is highly preferred.
Databricks certifications will be an added advantage.
Interested candidates can send their updated resume to ***email_hidden*** or
... with Databricks (Workflows, Unity Catalog, Delta Live Tables) and modern cloud ecosystems (AWS/GCP/Azure). - Previously worked on medium to large scale data engineering projects in enterprise environments - Experience delivering engagements for clients and the ability to engage with senior level stakeholders - Previous commercial ...
We are seeking a Senior Azure Databricks Platform Engineer (5+ years) to augment our platform team and accelerate the enablement of new AI capabilities within Azure Databricks. Key focus areas: - Azure Databricks platform administration and operations - Enabling AI features such as Model Serving, Vector Search, Lakebase, ...
Job Title : Senior Databricks Engineer Location : Brisbane Mode: Permanent We are looking for a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks . The ideal candidate should have a solid background in designing, developing, and supporting enterprise data integration solutions, ...
... experience in mentoring engineers, defining best practices, and driving technical excellence across teams and client engagements. - Industry certifications in Databricks (Databricks Certified Data Engineer / Databricks Certified Professional) and cloud platforms (AWS, Azure, or GCP) are highly desirable and strongly preferred. ...
... improving how they are consumed. What you’ll be doing Working in an open, collaborative and innovative platform engineering - Shape secure, scalable platform engineering that enables data, analytics and AI solutions across Rio Tinto - Work at the leading edge of DevOps, Databricks and AI enablement, improving automation, ...
... projects: Contribute to initiatives using Generative AI to solve complex client challenges. · Engineering process: Follow and champion repeatable, scalable engineering processes. Feed customer insights back into our product roadmap. · Quality: Own the quality of your own work. You are a senior line of defence before it ...
... Flavel, based in Sydney. He fosters a collaborative, delivery-focused environment where technical excellence and client success go hand-in-hand. Requirements As a Senior Consultant - Data Engineer , you will be a trusted advisor to our clients, designing and delivering modern enterprise data platforms that drive analytics, AI ...
Purpose: provide data engineering and analysis skills to data heavy deliverables. Seniority: Mid to senior. Reports to: Data Architect. Responsibilities • Build version controlled pipelines for profiling, cleansing, transformation and migration. • Automate reconciliation between legacy and target (counts, control totals, ...
... frameworks and AI-assisted tooling that make analytics more efficient, consistent and scalable. What we're looking for - 3–5 years of experience in analytics engineering, data engineering or a similar data-focused role in a fast-paced or high-growth environment. - Strong proficiency in SQL and experience transforming data ...
... members. Your New Role Are you a Data Engineer excited by AI, modern data platforms and the opportunity to work with genuinely large-scale enterprise data? As Senior Data Engineer , you'll join a stable, high-performing team building the next generation of AustralianSuper's data capabilities. You'll design and engineer high-quality ...