Back to list

Vacancy description

Data Engineer in Mile End, Australia

ACH Group

  • Full-timeStandard weekly hours

Mile End, Australia

Data Engineer

We are looking for a Data Engineer with hands-on experience in Azure Data Factory to develop, build and maintain data pipelines and analytics infrastructure that support operational efficiencies and informed business decisions. This is a full-time role is based at our Head Office in Mile End.

The role:

  • Develop and maintain data architecture and infrastructure that support reliable analytics and reporting
  • Build, maintain and monitor Azure Data Factory pipelines to integrate and transform data across systems
  • Develop and troubleshoot Apache Spark data processing workloads and support their operation in Kubernetes environments
  • Design, develop and optimise Power BI semantic models, including dimensional modelling, data relationships, DAX measures, row-level security and performance tuning
  • Develop and support advanced analytics platforms, collaborating with analytics teams to prepare, validate and transform data for reproducible machine learning (ML) workflows
  • Design scalable database schemas and administer, maintain and optimise databases and queries to support dependable data access and use
  • Apply data governance standards through metadata and lineage management, access controls, and data validation, reconciliation and quality monitoring to safeguard data integrity
  • Partner with stakeholders to deliver practical data solutions that meet business needs
  • Contribute to other data engineering activities as required

About you:

You translate business needs into reliable, well-governed data solutions and communicate clearly with non-technical stakeholders. The requirements below are essential unless marked desirable:

  • A degree or postgraduate qualification in computing or a related technical discipline, or equivalent experience
  • Experience delivering and supporting reliable production data pipelines integrating complex sources in a large-scale organisation
  • Essential: Azure Data Factory expertise in ETL/ELT orchestration, incremental loads, monitoring, error handling and performance troubleshooting
  • Experience with Apache Spark (PySpark or Spark SQL) for distributed data processing, and familiarity with Kubernetes-based deployments, monitoring and troubleshooting
  • Desirable: Microsoft Fabric experience with lakehouses, warehouses, data pipelines or notebooks
  • Strong coding and technical skills to develop efficient, maintainable solutions for data transformation, automation and analytics
  • Hands-on experience with modern data engineering tools for data integration, transformation, orchestration and monitoring
  • Power BI semantic model development, including dimensional modelling, relationships, DAX, row-level security and performance tuning
  • Understanding of ML concepts and practical data preparation, validation and transformation for reproducible workflows with analytics teams
  • Database architecture and data modelling experience, including scalable schemas and database and query optimisation
  • Practical data governance experience covering metadata, lineage, access controls and data integrity through validation, reconciliation and quality issue resolution
  • Strong analytical and root-cause investigation skills to evaluate solutions and resolve complex data issues using sound architecture and governance principles
  • Strong stakeholder engagement to clarify requirements, explain trade-offs and collaborate across business and technical teams
  • Ability to prioritise competing demands, meet deadlines and own solutions from development to operational support
  • Commitment to clear documentation and continuous improvement in data reliability, performance and maintainability

A satisfactory National Criminal History check less than 12 months old at commencement is required for the successful candidate.

How to Apply:  To apply online press ‘Apply’ now.

ACH Group celebrates and encourages workforce diversity and does not discriminate on the basis of gender, age, race, sexual orientation, gender identity, religious beliefs, disability or any other basis.

About ACH Group: At ACH Group we believe that older people should feel valued, respected, connected in their communities and supported to live a good life.

We love what we do, aren’t afraid to take action, constantly put our hands up for challenges and celebrate the uniqueness of our community. Most importantly, we bring our best.

If you share our belief, join our team of 1800 employees and hundreds of volunteers and take delight in knowing that you're making a contribution to the lives of older people. You'll do so while enjoying a rewarding career pathway, ongoing training, competitive salary options and a passionate, flexible workplace.

Similar vacancies

More like this role

XPT Software Australia Pty Ltd

Data Engineer

  • Contract
... Data Analysts, Product Owners, and business stakeholders to convert requirements into reliable data products. • Provide technical leadership, code reviews, engineering standards, and mentoring to other data engineers. Key Skills and Experience •8+ years of experience in data engineering, data integration, ETL/ELT, or large-scale ...

Syd, Australia

Insurance Australia Group (IAG)

Data Engineer

  • Full-time
  • Part-time
Responsibilities - Partner with business stakeholders to understand challenges, identify opportunities, and deliver measurable data solutions. - Design, build, and maintain scalable data pipelines using Python, SQL, and cloud technologies. - Develop reusable datasets, data models, and features for analytics, reporting, ...

Syd, Australia

Rio Tinto

Data Engineer

  • Remote
  • Hybrid
  • Full-time
... Leads What You Will Bring - A commitment to uphold and promote our values of Care, Courage, and Curiosity - SQL / Python proficiency - Experience with piping and data engineering is a must - Experience with large columnar datasets that require transformation (Proficiency in PySpark is a plus) - Proficiency with JavaScript/TypeScript ...

Perth, Australia

  • On-site
  • Contract
... technical stakeholders. - Mentor team members and promote engineering best practices. Skills & Experience - Strong experience in Data Engineering, Solution Design or Data Warehousing. - Advanced SQL and data transformation expertise. - Hands-on experience with Snowflake, Python, Spark, Azure Data Factory and Databricks. - Experience ...

Syd, Australia

  • Hybrid
  • Full-time
  • Contract
  • DevOps

$130,000 - $155,000

... Snowflake Location: Sydney/Hybrid Contract: 12-month fixed-term Salary: $130,000 - $155,000 + Super An established Australian organisation is looking for a hands-on Data Platform Engineer to support a significant uplift of its data engineering capabilities. The opportunity centres on improving how enterprise data is ingested, ...

Syd, Australia

  • Hybrid
  • On-site
  • Full-time
  • Contract
... architecture designs. - Strong stakeholder engagement skills and experience working across business and technical teams. Data Engineer - Demonstrated experience in a Data Engineer, Senior Data Engineer or similar hands-on engineering role. - Strong experience designing, building and maintaining data pipelines and data integration ...

Canberra, Australia

  • Full-time
... future-ready data products. You'll also have an opportunity to implement SageMaker! Key responsibilities - Lead end-to-end data platform architecture - Design scalable data lake and data mesh solutions - Build reusable data engineering frameworks and tools - Partner with stakeholders to deliver effective data solutions - Drive DataOps, ...

Syd, Australia

Zone IT Solutions

AWS Data Engineer

  • Full-time
We are seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and curated datasets on AWS. The ideal candidate will have strong expertise in SQL, Python, AWS data services, and modern data engineering practices, with experience delivering data solutions for enterprise analytics and ...

Syd, Australia

  • Hybrid
  • Contract
... intelligence and enterprise reporting solutions . - Strong technical experience in data engineering, data integration, ETL processes, data transformation and data modelling . - Demonstrated experience with Microsoft data and analytics technologies, including Power BI. - Strong understanding of data governance, data quality, ...

Canberra, Australia

  • On-site
  • Full-time
  • Data Analytics
  • Business Intelligence
Data Analyst / BI Developer - Brisbane (5 days onsite) We are seeking an experienced Data Analyst / BI Developer to build reporting and analytics capabilities. Key responsibilities: - Develop Power BI dashboards, DAX measures and executive reports. - Build and maintain Databricks data pipelines integrating Salesforce and ...

Brisbane, Australia