Data Engineer

About us:

We are proudly owned by Auto & General Insurance Company. The A&G group is made up of trusted and well-known brands such as iSelect, Compare the Market and Budget Direct. In late 2024, iSelect and Compare the Market formed a new Aggregation business within the A&G group and now support millions of Australians to compare and buy their personal finance and household products such as insurance, energy, and loans.

iSelect

At iSelect, we’re passionate about making Australians’ lives easier by saving them time, money, and effort. With over 20 years’ experience, we are a one-stop destination for comparison and purchasing across insurance, utilities, and personal finance products. We compare a wide range of brands and our trained comparison experts help customers to compare, select and save more, putting them in control.

Compare the Market

At CTM, our Noble Purpose is to make a difference in the lives of Australians by simplifying the process of making sound financial decisions. This Noble Purpose is our cultural ‘north star’ guiding our direction, prioritisation and decision making. 

How you fit:

As a Data Engineer working on the data platform, and in collaboration across CTM’s business and technology stakeholders you will use your experience to build data pipelines, enhance frameworks and build utilities on the Cloud Data Platform in a manner that aligns to metadata driven, automation-based frameworks and highly scalable systems.

What you do:

• Align build of data engineering solutions in accordance with data architecture and component designs.
• Development of robust end to end data pipelines 
• Develop, test, and deploy code to a high standard.
• Release planning, implementation, and code reviews.
• Managing delivery risks & meeting deadlines.
• Work with Architect to support planned data architecture, data governance, data quality, master data and metadata management.
• Work with BI developers and reporting team to optimise the DWH for reporting and analysis.
• Monitor data quality and build jobs to log and report on issues.
• Develop data integration between production systems
• Gain domain knowledge of Compare the Market’s business and data.

What you need:

Qualifications:  

• Minimum Bachelor’s Degree qualified in Computer Science, IT or a relevant discipline

Experience & Skills: 

• Experience with Cloud EDWs (AWS and/or GCP), Data Lakes, Information Governance Suites (Lineage, Glossary, Reference Data).
• Proven development experience in Python, and ETL tools in addition to data modelling skills.
• Experience with deployment of data workloads using CI/CD tooling.
• Experience building metadata driven highly automated solutions very well regarded.
• Experience with Databricks well regarded.
• Additional experience in traditional on prem EDW / ETL environments well regarded.
• Minimum 3 years’ experience in a similar role, a minimum of 5 years’ experience in IT/data
• Understanding of end-to-end Data & Insights life cycle is a must
• Good communication and business engagement
• Previous experience working in an Agile environment using tools such as Jira and Confluence.

What's in it for you:

•  Career Opportunities
• A competitive salary plus generous uncapped commission scheme
• The opportunity to work with a well-known, household brand and public listed company
• Work with a team of highly energised, motivated and driven professionals
• 3 'recharge' days per year (yes, in addition to your annual leave!)
• A free coffee each day, a funky café and a state of the artwork space
• An impressive Employee Benefits Programs

If you are someone who fosters team spirit, has resilience and aspires to continue learning and developing their skills to drive commercial outcomes, you will have tremendous success in helping us achieve our progressive growth agendas. High energy levels and a love of having fun are also important to working in this energetic business.