Senior Data Engineer (AWS Cloud and AI)

Commonwealth Bank of Australia

Senior Data Engineer (AWS Cloud and AI)

  • You are passionate to stay ahead of the latest AWS Cloud, Gen AI, Data Lake and Data Mesh technologies.
  • We're one of the largest and most advanced Data Engineering teams in the country.
  • Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.

Do work that matters:

As a Senior Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of AWS Cloud, Data Mesh and AI technologies.

Which is why we’re the perfect fit for you. Here, you’ll be part of a team of engineers going above and beyond to improve the standard of digital banking. Using the latest AI and Data tech to solve our customers’ most complex data-centric problems.

See yourself in our team:

Business Banking Technology team plays a crucial role in supporting and advancing the Digital and Gen AI tools, platforms and systems used by Business Bank customers of CBA. This is driven by critical data assets which is supported by the Data Engineering teams within the BB Tech who are responsible for ingesting data, creating ESDM aligned Data Products and creating reports which will help business come up with strategies. The team will be responsible for creating reliable, secure and actionable data to better serve customers, make right decisions and manage risk.

We are seeking people who are:

  • Passionate about building next generation data platforms and data pipeline solution across the bank in an AI centric approach.
  • Have a great learning mindset and thinking of AI first for any problem.
  • Enthusiastic, be able to contribute and learn from wider engineering talent in the team.
  • Ready to design solution, build execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.
  • Ready for E2E solution delivery and work closely with stakeholders and providing them with the right data solutions which should be AI centric for the problem.
  • Capable to create both technology blueprints and engineering roadmaps, for a multi-year data transformational journey.
  • Can take the lead and drive a culture where quality, excellence and openness are championed.
  • Constantly thinking creatively and breaking boundaries to solve complex data problems.

We are also interested in hearing from people who:

  • Design and implement robust data solutions that ingest and integrate data from diverse enterprise platforms into centralized data lakes. Leverage technologies such as Python, PySpark, and Scala, they transform and process raw source data into high-quality, consumable data products. These products are then efficiently egressed to downstream systems including relational databases like SQL Server, Oracle, and Teradata, as well as modern cloud platforms, enabling scalable analytics and business intelligence.
  • Are reliable in building group data products or data assets from scratch, by integrating large sets of data derived from hundreds of internal and external sources.
  • Can collaborate, co-create and contribute to existing Data Engineering practices in the team.
  • Have experience and responsible for data security and data management.
  • Have a natural drive to educate, communicate and coordinate with different internal stakeholders.

Key Skills & Experience:

  • AWS Certified Data Engineer Associate with 7-10 years of Experience in Data Engineering.
  • Experience in AWS data platforms (Glue, Lambda, Redshift, Athena, Kinesis, EMR).
  • Experience in using AI Powered coding Assistants like Cline, Roo and Aider.
  • Data Processing: Strong expertise in Python, PySpark, SQL, Spark, Scala and distributed data processing.
  • Data Governance & Security: Experience with AWS DataZone, Lake Formation, IAM, encryption.
  • Marketplace & APIs: Exposure to AWS Marketplace, API Gateway, and data monetization strategies.
  • Automation & CI/CD: Experience with Terraform, CloudFormation, GitOps, and serverless frameworks.
  • Performance Optimization: Ability to fine-tune ETL jobs, query performance, and cost efficiencies.

Nice to Have:

  • Experience with Snowflake, or Apache Iceberg.
  • Knowledge of data product thinking and data mesh principles.

Working with us:

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with an ultimate flexibility to work from any of our engineering hubs within Australia. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 23/07/2025

Read Full Description
Confirmed 16 hours ago. Posted 16 hours ago.

Discover Similar Jobs

Suggested Articles