Job no: QYRQP
- Office locations in Sydney and Melbourne CBD.
We’re looking for a senior Software Engineer with deep expertise in Python, AWS, and PySpark to help build production-grade data processing and platform services for financial services use cases. If you love solving complex problems, automating everything, and owning high-impact features end-to-end, this role is for you.
You’ll be part of a collaborative engineering squad that champions a shift-left quality culture, strong automation, and resilient design — all while working with a modern AWS-native stack (Glue, EMR, S3, Airflow, Spark) and robust CI/CD practices.
What You’ll Do
- Build scalable, reliable services and data pipelines using Python, PySpark, and AWS (Glue, EMR, S3).
- Embed automation across testing, security, and deployment, including unit, integration, and contract tests.
- Design and operate workflows using Airflow and AWS Glue, optimising for performance, reliability, and cost.
- Collaborate across product, platform, and QA teams to deliver systems that are testable, observable, and resilient.
- Own features end-to-end — design, implementation, code review, performance tuning, deployment, and production support.
- Contribute to engineering standards, DevSecOps practices, and continuous delivery improvements.
- Mentor engineers and uplift team capability, tooling, and engineering best practice.
Mandatory skills & experience:
- 8+ years software engineering experience with strong Python development skills.
- Expertise in AWS Glue, PySpark, SQL, and large-scale data processing on AWS.
- Hands-on experience designing automation frameworks and working in microservices environments.
- Strong familiarity with observability tools (CloudWatch, Splunk, metrics, logging, tracing).
Technical strengths we value:
- Python and shell scripting in Linux environments
- Airflow orchestration (DAG design, retries, SLAs)
- SQL for data transformation and analysis (Teradata/Oracle exposure a plus)
- CI/CD pipelines and shift-left testing (TeamCity, GitHub Actions, Jenkins, Octopus)
- Cloud-native engineering principles (scalability, security, cost optimisation)
- Effective use of AI development tools (e.g., GitHub Copilot, Roo Code)
Nice to Have
- Experience with Ab Initio or SAS for legacy ETL migrations
- Knowledge of Redshift, Athena, EMR, or Iceberg
- API/microservices integration and testing
- Contract testing and modern test automation frameworks (Playwright, Appium, DevTest, Sahi)
- Dashboarding and reporting for engineering or operational insights
- Team leadership or mentoring experience
Why Join Us?
- Work with a modern, cloud-native, high-scale AWS ecosystem
- Solve meaningful technical problems in a highly skilled engineering squad
- Drive best practices, automation, and engineering standards
- Opportunity to influence architecture, tooling, and the developer experience
- Published on 14 Dec 2025, 9:56 PM
