Find your next role

Discover amazing opportunities across our network of companies committed to gender equality in the workplace.

Search 
jobs
Explore 
companies
Join talent network
Talent
My job alerts

Data Engineer-Data Platforms-Azure - Sydney - 6 months FTH

IBM

IBM

Software Engineering, Data Science
Sydney, NSW, Australia
Posted on Apr 8, 2026
Introduction

IBM is the largest technology and consulting employer in the world, serving clients in 170 countries. In this new era of Cognitive Business, IBM is helping to reshape industries by bringing together our expertise in Cloud, Analytics, Security, Mobile, and the Internet of Things. We are changing how we create. How we collaborate. How we analyse. How we engage. IBM is a leader in this global transformation so there is no better place to launch your career.

IBM Global Business Services (GBS) is a team of business, strategy and technology consultants enabling enterprises to make smarter decisions and providing unparalleled client and consumer experiences in cognitive, data analytics, cloud technology and mobile app development. With global reach, outcome-focused methodologies and deep industry expertise, IBM GBS empowers clients to digitally reinvent their business and get the competitive edge. We outthink ordinary. Discover what you can do at IBM. We are hiring.

We are currently recruiting a Senior Streaming Engineer – PySpark, Kafka & DynamoDB (AWS Preferred) for a 6-months fixed term contract, based in Sydney.

Your role and responsibilities

The Data & Streaming Engineering team is responsible for designing and supporting enterprise‑scale real‑time data platforms. As a Senior Streaming Engineer, your responsibilities include:

  • Design, develop, and support near real‑time streaming data pipelines for enterprise banking and payments platforms
  • Build and optimise data solutions supporting payments processing, transaction monitoring, customer activity, and regulatory reporting
  • Apply industry best practices, architectural patterns, and innovative technical solutions across streaming and batch data platforms
  • Ensure data pipelines meet strict performance SLAs, scalability, high availability, and fault‑tolerance requirements
  • Collaborate with business, payments, risk, compliance, and platform teams to deliver secure and governed data solutions
Required education
Bachelor's Degree
Preferred education
Bachelor's Degree
Required technical and professional expertise

To ensure success in the role, you will possess the following skills:

  • 10+ years of experience in solution design, development, testing, or support roles within IT consulting or enterprise technology environments
  • 8+ years of hands‑on experience with Big Data / Data Lake platforms across cloud and on‑premise environments
  • Strong experience implementing near real‑time and distributed streaming pipelines using PySpark, Kafka, and DynamoDB (AWS preferred)
  • Proficient development skills in Python, Scala, SQL, and shell scripting, with experience in traditional ETL and data warehousing
  • Strong understanding of banking and payments domains, including high‑volume transaction data, risk, compliance, and governance (Westpac experience preferred)

If you tick these boxes, and are ready to start your next challenge with a career at IBM – click “Apply” today. To find out more, head to www.ibm.com.au/careers

ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

For additional information about location requirements, please discuss with the recruiter following submission of your application.

See more open positions at IBM
Privacy policyCookie policy