Data Engineer
PERFECTION FRESH AUSTRALIA · Homebush, NSW, AU
Apply directly on PERFECTION FRESH AUSTRALIA’s careers site — no account needed.
About the role
Introduction:
Our mission is to make fresh fruits and vegetables a more loved and essential part of everyone's life.
Perfection Fresh is one of Australia’s largest privately owned fresh produce companies that’s been on an exciting journey of innovation and growth since 1978.
We’re an Australian-based business that grows, packs, and markets fresh produce both domestically and internationally. You’ll recognize our produce – Qukes®, Broccolini®, Calypso® mangoes, and more.
Our history 45-year history is one of continuous progress. We’re the market leader in our field and we’ve been listed on the Australian Financial Review’s top 100 private companies in Australia.
We employ more than 2,000 people across a portfolio of farming sites, high-tech production facilities, research, corporate offices, and national logistics operations.
Learn more about us and discover other exciting opportunities at www.perfection.com.au.
Description:
Key Responsibilites
Lead the development and continuous improvement of the data engineering framework, standards, practices, and procedures
Act as the design authority for all data engineering solutions
Plan, prioritise and execute data engineering related activities to support the data management and data analytics teams
Perform an ongoing maturity assessment of data engineering practices and identification of any people, process & technology needs to close any gaps
Lead the design, deployment of management of the data lake and data warehouse capabilities, and the orchestration of data acquisition/ingestion and integration activities
Develop and implement best practices in metadata management, data modelling and devops
Engage and communicate with key business stakeholders such as product owners, data analysts etc and drive sprint planning to ensure the continuous delivery of business value
Grow and mentor a team of data engineering specialists
Skills and Experiences:
Essential Requirements
A tertiary qualification in information technology is highly regarded
A minimum of 5 years’ experience in similar role with demonstrated experience leading data engineering related initiatives
Highly proficient and extensive experience in the use of data engineering technologies such as azure data factory, databricks etc
Highly proficient and extensive experience acquiring/ingesting data from structured/un-unstructured, api’s and iot related data sources
Experience working with a lambda data architecture and data modelling methodologies such as kimball, inmon and data vault
Experience working with, and knowledge of, data governance, data quality, reference and master data management, and business glossary technologies
Highly proficient and extensive experience in the use of programming languages such as t-sql, javascript, python, powershell etc
Highly proficient and extensive experience in the use of data storage formats such as parquet, delta, orc, json etc
Excellent interpersonal and both oral and written communication skills
Ability to build relationships with a variety of stakeholders
Experience managing/leading a team
Capacity to align strategic and operational needs with organisational development initiatives
Solid project management and agile development experience
Ability to travel
Our mission is to make fresh fruits and vegetables a more loved and essential part of everyone's life.
Perfection Fresh is one of Australia’s largest privately owned fresh produce companies that’s been on an exciting journey of innovation and growth since 1978.
We’re an Australian-based business that grows, packs, and markets fresh produce both domestically and internationally. You’ll recognize our produce – Qukes®, Broccolini®, Calypso® mangoes, and more.
Our history 45-year history is one of continuous progress. We’re the market leader in our field and we’ve been listed on the Australian Financial Review’s top 100 private companies in Australia.
We employ more than 2,000 people across a portfolio of farming sites, high-tech production facilities, research, corporate offices, and national logistics operations.
Learn more about us and discover other exciting opportunities at www.perfection.com.au.
Description:
Key Responsibilites
Lead the development and continuous improvement of the data engineering framework, standards, practices, and procedures
Act as the design authority for all data engineering solutions
Plan, prioritise and execute data engineering related activities to support the data management and data analytics teams
Perform an ongoing maturity assessment of data engineering practices and identification of any people, process & technology needs to close any gaps
Lead the design, deployment of management of the data lake and data warehouse capabilities, and the orchestration of data acquisition/ingestion and integration activities
Develop and implement best practices in metadata management, data modelling and devops
Engage and communicate with key business stakeholders such as product owners, data analysts etc and drive sprint planning to ensure the continuous delivery of business value
Grow and mentor a team of data engineering specialists
Skills and Experiences:
Essential Requirements
A tertiary qualification in information technology is highly regarded
A minimum of 5 years’ experience in similar role with demonstrated experience leading data engineering related initiatives
Highly proficient and extensive experience in the use of data engineering technologies such as azure data factory, databricks etc
Highly proficient and extensive experience acquiring/ingesting data from structured/un-unstructured, api’s and iot related data sources
Experience working with a lambda data architecture and data modelling methodologies such as kimball, inmon and data vault
Experience working with, and knowledge of, data governance, data quality, reference and master data management, and business glossary technologies
Highly proficient and extensive experience in the use of programming languages such as t-sql, javascript, python, powershell etc
Highly proficient and extensive experience in the use of data storage formats such as parquet, delta, orc, json etc
Excellent interpersonal and both oral and written communication skills
Ability to build relationships with a variety of stakeholders
Experience managing/leading a team
Capacity to align strategic and operational needs with organisational development initiatives
Solid project management and agile development experience
Ability to travel
Description sourced from the public Indeed listing — this role isn't indexed from the company's career page yet.
Skills
- Python
- JavaScript
- Databricks
- Agile
Never be applicant #200 again
Every job here is indexed straight from company career pages — often hours after it opens, before it reaches the big boards. Create a free account and get your best matches in a twice-daily digest.
- Your best matches, twice a day
- No duplicates, no ghost jobs, no recruiter spam
- Every job free to browse — pay only when you apply
Get my matched jobs
Free account — no card required
93 119 live jobs · 17 642 companies tracked · 136 added today