Back to list

Vacancy description

Lead Data Engineer in Syd, Australia

Endava

  • HybridMix of office and remote
  • Full-timeStandard weekly hours

Syd, Australia

Company Description

Technology is our how, and people are our why. For 20-plus years we have paired world-class engineering with deep industry insight, helping global brands create intelligent digital experiences that drive meaningful change. Join us as we expand our Australian Data & AI capability and help clients unlock the full value of their data assets.

Job Description

We’re looking for a Lead Data Engineer to help our clients design, build and operate reliable data platforms that turn complex data into useful business insights.

You’ll work across the data lifecycle, from architecture and source integration through to data pipelines, semantic models, visualisation and reporting. You’ll bring strong engineering skills in Python and SQL, alongside hands-on experience with at least one of Databricks, Snowflake or Microsoft Fabric.

Working closely with clients, analysts, data scientists and fellow engineers, you’ll translate business requirements into secure, maintainable and scalable data solutions. You’ll also provide technical guidance, contribute to design decisions and help the team strengthen its engineering practices.

What you’ll do

  • Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
  • Develop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.
  • Contribute to data architecture and solution design, including data storage, integration and modelling.
  • Develop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.
  • Implement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.
  • Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.
  • Apply data quality controls, automated testing and validation throughout the data lifecycle.
  • Implement role-based access control and follow security best practices for data platforms and integrations.
  • Apply DevOps practices to data engineering, including version control, repository management, CI/CD and automated deployment.
  • Build data visualisations and reports that make information clear and useful to business users.
  • Document solutions, review code and share knowledge to support maintainable delivery and continuous improvement.

Qualifications

What you’ll bring

  • Hands-on experience delivering production data solutions using one or more of Databricks, Snowflake or Microsoft Fabric.
  • Strong programming skills in Python and SQL.
  • Experience designing, developing and operating data pipelines, including ETL/ELT processes, orchestration and monitoring.
  • A sound understanding of data architecture and modelling techniques, including analytical and dimensional modelling.
  • An understanding of ontologies and semantic modelling, and how they connect data structures to business concepts.
  • Practical experience optimising data processing and troubleshooting pipeline, query and platform performance.
  • Experience integrating data through APIs, including authentication, error handling and reliable data exchange.
  • Experience applying role-based access control (RBAC) and data security best practices.
  • Experience using Git, maintaining repositories, writing automated tests and building CI/CD workflows for data solutions.
  • Experience developing data visualisations and reports.
  • The ability to explain technical choices clearly, work collaboratively with business and technical stakeholders, and guide other engineers.

Useful additional experience

  • PostgreSQL, SQL Server, Google BigQuery or Amazon Redshift.
  • R or other programming languages.
  • Relevant cloud services across Microsoft Azure, AWS or Google Cloud.
  • Relevant certifications in Databricks, Snowflake or Microsoft Fabric.

Additional Information

  • Flexible, hybrid working – 20 “work from anywhere” days per year on top of our hybrid policy.
  • Global career pathways and non-linear progression; move between domains, disciplines or geographies.
  • Continuous learning via certifications, internal academies, tech communities and funded conferences.
  • Well-being & lifestyle allowance , loyalty leave, inclusive parental leave and employee assistance programmes.
  • A vibrant, inclusive culture where diverse perspectives power innovation.

Ready to drive AI-powered transformation?

Apply today with your CV and a short cover note outlining a data-led solution you are proud to have shaped. We look forward to exploring how your expertise can help our clients turn bold ideas into real-world impact.

Endava is an equal-opportunity employer. We value the differences that make us stronger and commit to transparent, merit-based hiring.

Additional Local Benefits 

  • Monthly Lifestyle Allowance:  Contribution towards health and wellbeing activities like gym memberships.  
  • Novated Leasing:  Pre-tax car leasing benefit for new and used cars. 
  • Loyalty Leave: Receive an additional day of leave on your 3rd, 4th, and 5th work anniversaries, accumulating up to a maximum of 3 extra days of leave per year.
  • Inclusive Parental Leave Policy: 12 weeks of primary carer’s leave and 4 weeks of secondary carer’s leave. 
  • Work From Anywhere:  In addition to our hybrid working policy, we also offer 20 days of working from anywhere per year. Ideal for an extended trip to get away from the city or visiting loved ones.

At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Similar vacancies

More like this role

Commonwealth Bank of Australia

Crew Lead - Engineering Data

  • Full-time
... service health, security automation and developer experience. As Crew Lead, Engineering Data, you’ll lead the people, delivery and technology outcomes of the Engineering Data Crew within Engineering Platform. You’ll translate strategy into a clear, outcome-based roadmap and create an inclusive, high-performing engineering ...

Inner West, Australia

  • Full-time
  • Cybersecurity
Job Description Lead Security Engineer - Endpoint, Identity & Data Protection - Become a part of our Qantas Group Cyber Defence Team - Join an amazing team that values and prioritises cyber security, in a hands-on engineering role across the core security platforms that defend the Group! - Permanent role based in Sydney ...

Syd, Australia

  • Full-time
... future-ready data products. You'll also have an opportunity to implement SageMaker! Key responsibilities - Lead end-to-end data platform architecture - Design scalable data lake and data mesh solutions - Build reusable data engineering frameworks and tools - Partner with stakeholders to deliver effective data solutions - Drive DataOps, ...

Syd, Australia

Rio Tinto

Data Engineer

  • Remote
  • Hybrid
  • Full-time
... value generated Reporting to the Delivery or Technical Lead you will - Understand and champion Foundry platform and tools - Understand how the business uses data in existing tools and map business data into the Foundry Ontology (data asset) - Identify relevant datasets through deep engagement with user workflows - Liaise ...

Perth, Australia

  • Hybrid
  • Networking
Lead Network Engineer Location: Sydney Experience: 7–10 years Saltus Group is seeking an experienced Network Engineer to design, implement and support enterprise networks across LAN, WAN, data centre and hybrid cloud environments. This role suits someone with strong routing and switching expertise, hands-on network security ...

Syd, Australia

Aurecon Australasia Pty Ltd - Philippines Branch Office

Lead CFD Engineer for Building Performance & Data Centres

Job Description Aurecon is seeking a Senior CFD Engineer to advance our building performance and data centre CFD capability. You will lead challenging CFD studies, combining advanced modelling with consulting judgement to provide practical client recommendations. You will work on projects across Australia and potentially ...

Greater Melbourne, Australia

CareCone Group

Lead Network Engineer

  • Hybrid
  • Full-time
  • Networking
Role- Lead Network Engineer Type- Permanent Location- Sydney Years of Experience- 7 to 10 Years Job Summary Manage Infrastructure: Design, deploy, and configure complex enterprise environments across LAN, WAN, and Data Centres. Core Administration: Architect and maintain routing and switching architectures using protocols ...

Syd, Australia

  • Hybrid
  • Full-time
  • Contract
... delivery, production support & data engineering initiatives - Must have Commercial or General Insurance industry experience - Lead BAU operations, reporting cycles & data transformation projects - Global company - Sydney-based role - Hybrid role About the Role: Our client is seeking a Data Engineering Manager/Senior Data Engineer ...

Syd, Australia

  • Full-time

€40 EUR

... Looking For - Bachelor's or Master's Degree in Electrical Engineering, Power Systems Engineering, or a related engineering discipline. - 7+ years' experience leading technical scopes, engineering work packages, or major customer projects. - Experience delivering projects within data centres, cloud and service providers, ...

Syd, Australia

WEHI (Walter and Eliza Hall Institute of Medical Research)

Lead HPC Engineer

  • Hybrid
  • On-site
  • Full-time

$141,910 - $153,610

The opportunity At WEHI, computing power turns data into discoveries. Our researchers use Milton, our high performance computing environment, to analyse genomic, imaging and other large-scale data that is changing how we understand and treat cancer, infection and immune disease. We're looking for a Lead HPC Engineer to ...

Greater Melbourne, Australia