Back to list

Vacancy description

Data Engineer-Unified data platform in Syd, Australia

XPT Software Australia Pty Ltd

  • ContractFixed-term or freelance

Syd, Australia

Demonstrate a sound understanding of:

 

Ingestion and transformation of data from multiple source domains (e.g. CRM feeds, third-party data, digital signals) into the platform following approved design principles and data governance standards.

Building and maintaining batch and streaming transform pipelines and workflow orchestration.

Data dictionary documentation and cloud object storage design for data offload scenarios.

Collaboration with extended team like DevOps, Data Architects, and operations teams to ensure end-to-end pipeline reliability and observability.

Decisioning Platform (Pega or equivalent)

 

Demonstrate a sound understanding of how real-time decisioning platforms (such as Pega) consume and depend on data engineering outputs.

Work with decisioning and analytics teams to ensure accurate and timely data availability for personalisation and customer engagement use cases.

Participate in cross-team planning and technical reviews as they relate to data dependencies for decisioning workflows.

Cross-Platform & Delivery

 

Deliver across multiple use cases simultaneously in an Agile squad model, managing dependencies across platforms and teams.

Author and maintain technical documentation, including solution design notes, implementation plans, and deployment runbooks.

Actively participate in sprint ceremonies, backlog refinement, and cross-team dependency management.

Provide SIT, UAT, and data validation support across environments; work with QA and operations teams to validate data integrity pre- and post-release.

 

Skills & Experience

Familiarity with cloud-native data engineering patterns and object storage-based data offload architectures (e.g. AWS S3, Azure Data Lake).

Understanding of real-time decisioning platforms such as Pega, and how they integrate with data engineering layers.

Exposure to MarTech or Transformation data programs in a large enterprise or telco context.

Experience with workflow orchestration tools such as Apache Airflow or equivalent.

Understanding of data governance frameworks, data lineage, and data quality processes.

Knowledge of Agile or SAFe delivery methodology and working in cross-functional squads

Similar vacancies

More like this role

  • Contract
  • DevOps
... seeking a Data Platform Engineer with strong quality engineering and automation expertise to support the development, validation, and reliability of large-scale data platforms. This role will focus on Databricks Lakehouse, PySpark, SQL, distributed data pipelines, event-driven architectures, and cloud-based data ecosystems, ...

Brisbane, Australia

  • Full-time
  • DevOps
... a Data Platform Engineer to report to the Engineering Manager for the Internal Data Platform team. This role suits candidates with experience building data platforms at scale and a passion for solving complex analytical problems with modern technologies. The successful candidate will have experience with big data systems ...

Syd, Australia

  • Full-time
  • Part-time
  • DevOps
  • Operations

A$130046 AUD - A$134956 AUD

- Department for Health and Wellbeing – Digital Health SA – Data and Analytics Platform Operations - Salary: $130,046 to $134,956 – ASO8 – Full Time / Ongoing – Permanent Overview: The Senior Data Platform Engineer – Data and Analytics Platform (DAP) Operations is accountable to the Specialist Operations Manager and is ...

Adelaide, Australia

  • Remote
  • Hybrid
  • Full-time
We are seeking a highly skilled Data Engineer / Databricks Platform Administrator to join our Data & AI team. This hybrid role combines Databricks platform engineering and administration with hands-on data engineering delivery responsibilities. You will play a key role in establishing and operating a secure, scalable, enterprise-grade ...

Canberra, Australia

  • Full-time

$100,000

... data engineering, data warehousing, ETL/ELT development, cloud data platforms, and technical delivery leadership. - Microsoft Certified: DP-900 Microsoft Azure Data Fundamentals. - Microsoft Certified: AZ-900 Azure Fundamentals. - Databricks Data Engineer Associate Certification. - Led modern data platform development using ...

Australia

  • Remote
  • Contract
  • DevOps
  • Consulting
... clearance About the Opportunity Powerdata Group is seeking an experienced Senior Azure Data Platform Engineer / Architect to support a major enterprise data platform uplift for a leading Australian financial services organisation. The engagement involves working within an established Azure data platform and aligned data ...

Syd, Australia

  • Hybrid
  • On-site
  • Full-time
  • Contract
... interoperability and maintainability. Data Engineering - Design, develop and maintain scalable data pipelines and data engineering solutions. - Build secure data ingestion, extraction, transformation and loading (ETL/ELT) processes. - Integrate data from multiple sources, systems and platforms across complex enterprise ...

Canberra, Australia

  • Hybrid
  • Full-time
... recommendations. - Coach test leads and engineers, promote engineering best practices, and build a high-performing quality culture. Required Technical Expertise: - ETL and data testing: Strong experience validating batch and incremental pipelines, complex transformations, dimensional models, data warehouses, and analytics datasets. - ...

Syd, Australia

XPT Software Australia Pty Ltd

Data Engineer

  • Contract
... stakeholders to convert requirements into reliable data products. • Provide technical leadership, code reviews, engineering standards, and mentoring to other data engineers. Key Skills and Experience •8+ years of experience in data engineering, data integration, ETL/ELT, or large-scale data platform delivery. • Strong hands-on ...

Syd, Australia

Insurance Australia Group (IAG)

Data Engineer

  • Full-time
  • Part-time
... across the product lifecycle from discovery and experimentation through deployment and continuous improvement. Requirements - Experience building and maintaining data pipelines using Python, SQL, and cloud platforms. - Curiosity about AI and machine learning and their application to business problems. - Ability to translate ...

Syd, Australia