Telstra

Employment Type

Permanent

Closing Date

30 Dec 2024 11:59pm

Job Title

Data Engineering Senior Technical Specialist - Azure Data Engineering Senior Specialist

Job Summary

As Data Solution Engineering - Senior Specialist, you lead aspects of the development and delivery of best practice solutions that empower teams across Telstra to leverage our digital assets. As a trusted partner and advisor, you collaborate with Data Sourcing Engineers and Data Scientists to source and translate quality data into operational solutions. You understand the business problems, ensure architecture aligns with, and systems meet the business requirements in the delivery and integration of complex data platforms

Job Description

At Telstra, we have a clear purpose: to build a connected future so everyone can thrive. We believe it’s people who give purpose to our technology. So we are committed to staying close to our customers and providing them the best experience. And delivering the best technology.

This is where YOU come in, by playing your part in helping our customers connect: faster, better and smarter.

Who we are:

Telstra is Australia's leading telecommunications and technology company with a rich heritage that’s been built over 100 years. From our humble beginnings in the Postmaster General’s Office to the global business we are today our people have been at the forefront of technology innovation. More recently, we have the largest Internet of Things network in Australia and are leading the way in 5G. And this is just the beginning of what we’re hoping to achieve together.

The Role:

Senior Data Engineer role is to coordinate, and execute all activities related to the requirements interpretation, design and implementation of Data Analytics applications. This individual will apply proven industry and technology experience as well as communication skills, problem-solving skills, and knowledge of best practices to issues related to design, development, and deployment of mission-critical systems with a focus on quality application development and delivery.

This role is key to the success of the Data Engineering capability at Telstra and will be responsible and accountable for the following:

• Lead the design, development, and maintenance of data pipelines using Spark, Python, Scala, and related technologies.
• Work with high volume data and ensure data quality and accuracy
• Implement data security and privacy best practices to protect sensitive data
• Collaborate with data scientists and business stakeholders to understand data needs and requirements
• Develop and maintain documentation on data pipeline architecture, data models, and data workflows
• Mentor and provide technical guidance to junior team members
• Monitor and troubleshoot data pipelines to ensure they are performing optimally
• Stay up-to-date with the latest developments in Azure, AWS, Spark, Python, Scala, and related technologies and apply them to solve business problems
• Optimize data pipelines for cost and performance
• Automate data processing tasks and workflows to reduce manual intervention.
• Ability to work in Agile Feature teams
• Provide training and educate other team members around core capabilities and helps them deliver high quality solutions and deliverables/documentation
• Self-Motivator to perform Design / Develop user requirements, test and deploy the changes into production

Technical Skills

• Hands-on experience in the following on Spark Core, Spark SQL, SQL/Hive/Impala
• Exposure on Hadoop Ecosystem(HDP/Cloudera/MapR/EMR etc) 
• Experience of working on File formats (Parquet/ORC/AVRO/Delta/Hudi etc.) 
• Experience with high volume data processing and data streaming technologies
• Experience of using Orchestration tools like Control-m,Azure Data Factory,Airflow,Luigi to schedule jobs.
• Demonstrated experience leading data engineering projects and mentoring junior team members.
• Data engineer with expertise of working on Azure Cloud using Databricks, Kinesis/ Azure Event hub Flume/Kafka/Spark streaming, Azure Data Factory.
• Strong experience in data modeling, schema design, and ETL development using SQL and related technologies
• Familiarity with data security and privacy best practices
• Good exposure on TDD
• Exposure on using CI tools like Git, Bitbucket, Github, Gitlab, Azure DevOps
• Exposure on using CD tools like Jenkins, Bamboo, Azure DevOps
• Exposure on Observability tools like Azure Monitor, Graphana etc
• Prior experience in building or working in team building reusable frameworks
• Good understanding of Data Achitecture and design principles. (Delta/Kappa/Lambda architecture) 
• Exposure to Code Quality - Static and Dynamic code scans 
• Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.
• Should be able to provided scalable and robust solution architecture depending on the business needs.
• Propose best practices/standards
• Programming & Databases - Java /Python/Scala/ SQL Procedure. Multi tenanted databases / Spark

What we offer

Dynamic, innovative and knowledgeable, our people are the brains behind amazing achievements such as keeping on top of the latest technology or masterminding the store of the future. And because they share the same vision, they take the time to pass on their knowledge, mentor you, and guide you in your career path.

Here you’ll have the opportunity to work with some of the best minds in the industry, people who are passionate about Telstra and technology, and who work together to achieve great things.

Not only will you be rewarded with a competitive salary package, but there are a range of lifestyle products and services that you can access, including options to purchase additional leave, volunteer leave and the list goes on.

Sound like you?

A career with us will give you a platform to shape tomorrow through technology. For you, that means helping us to push the boundaries of what’s possible today, and in the future. It also gives you the opportunity to empower millions helping businesses grow, evolve and reach their potential.

At Telstra, you can thrive, your way. We foster new ideas, we embrace different ways of working and thinking, and we believe an inclusive and diverse team will lead us to innovate for the future.

We’re committed to building a diverse and inclusive workforce. To enable everyone to participate, we’ve developed an ‘All Roles Flex’ policy to consider flexible ways of working for every role. To learn more, visit our Telstra Careers Website: http://tel.st/allrolesflex