Principal Data Engineer - Azure

Workday Solutions Architect

24 Month Fixed-Term Contract | Possible Permanent Conversion

About the Role

The Principal Cloud Data Engineer will play a pivotal role in leading the transformation of Kinetic's data architecture, with a focus on designing and delivering a modern Data Mesh architecture on Microsoft Fabric. This role will lead the migration from Azure Synapse to Microsoft Fabric, enabling advanced analytics, real-time insights, and scalable enterprise-grade data solutions across the organisation.

As a senior technical expert, you’ll guide architectural decisions, uplift engineering capabilities, and help expand Kinetic’s cloud-based analytics ecosystem to support data science, IoT, and real-time streaming use cases.

What You Will Do

• Data Mesh Architecture Design: Lead the design and implementation of a federated Data Mesh framework within Microsoft Fabric, ensuring scalability, security, and alignment to enterprise data strategy.
• Platform Migration: Drive the end-to-end migration of existing data assets, pipelines, and analytics workloads from such as Azure Synapse, Azure Databases, Snowflake, Databricks to Microsoft Fabric.
• Advanced Analytics Enablement: Expand the organisation's data capabilities by enabling support for ML/AI workloads, and IoT data flows within Microsoft Fabric.
• Streaming and Real-Time Data: Architect and implement robust streaming data ingestion and transformation pipelines, leveraging technologies such as PySpark and Azure Event Hubs.
• Technical Leadership: Mentor engineers, establish best practices, and ensure delivery of high-quality, production-ready data pipelines.
• Stakeholder Engagement: Collaborate with business units, product owners, and data domain leads to translate complex business needs into scalable data solutions.
• Governance & Security: Support the integration of data governance, lineage, and privacy frameworks within the Data Mesh model.

What You Will Need

Essential:

• Proven expertise in designing and implementing Data Mesh architecture in enterprise environments.
• Demonstrated experience leading platform migrations, particularly from Azure Synapse or similar platforms.
• Hands-on experience with streaming data ingestion, real-time processing, and event-driven architecture using tools such as Azure Event Hubs, Azure Stream Analytics, and PySpark.
• Advanced knowledge of data transformation pipelines, metadata management, and structured/unstructured data handling.
• Extensive experience in cloud data engineering, with a strong focus on Microsoft Azure and Microsoft Fabric (OneLake, Lakehouse, Data Activator, etc.)
• Experience working with domain teams and enabling ML/AI capabilities via cloud platforms.
• Strong understanding of data security, governance, and compliance in cloud-based environments.

Desirable:

• Familiarity with DevOps practices in a data context (CI/CD pipelines, IaC, etc.)
• Experience in enabling IoT analytics via Azure services such as MQTT, Message Queue
• Experience with domain-driven design in a data environment

About us:

At Kinetic, we don't just move people - we're creating the positive change our planet needs. As a leader in sustainable transport, we're committed to creating cleaner, safer, and greener environments for generations to come.

Our size and scale give our people real opportunities to learn, grow, and progress in their careers. Calm, positive and respectful team players thrive here. Our people embrace change and are encouraged to stretch their comfort zone while making a difference. We challenge each other to be our best.

We're driven by respect, diversity and genuine connection. From networking groups to community partnerships and volunteering, our camaraderie naturally brings people together. Our energy and dedication keep communities moving and our people growing.

How to apply:

Kinetic is proud to be an Equal Opportunity Employer and our people represent the community which we service. We invite all suitably qualified applicants to apply, including First Nations People, and people from diverse social, cultural and gender backgrounds.

If you're interested in this rewarding role with Kinetic then click the 'Apply' button now!