Senior Data Engineer

Endava

Benefits
Skills

What's this role about?

  • Take part in all application development lifecycle phases;
  • Your main responsibilities will be to develop software systems;
  • You will participate in the logical and physical design of the product and understand the business requirements;
  • You will solve complex technical problems that other team members may encounter, be an integral part of a Scrum team, review and enforce the quality of code written within your team, tutor junior developers;
  • You will be involved in a broad range of complex technical or professional work activities, in a variety of contexts;
  • You will work under general direction within a clear framework of accountability.
  • Substantial personal responsibility and autonomy is required;

What skills and experience do you need?

  • Develop and maintain data pipelines using Python within our AWS-based platform, ensuring efficient data processing and management.
  • Configure and optimize AWS services (S3, Lambda, Glue, Step Functions, DynamoDB, Kinesis, Athena, EventBridge, SNS) for seamless data integration and event-driven workflows.
  • Implement Infrastructure as Code (IaC) using AWS CDK to manage and automate cloud resources effectively.
  • Utilize Apache Iceberg to enhance data storage and organization for improved scalability and performance.
  • Manage version control and CI/CD workflows using GitHub, leveraging GitHub Actions for continuous integration and deployment.
  • Enhance monitoring and observability of data pipelines using Datadog, optimizing performance and reliability.
  • Good client-facing skills;
  • Good English language skills;
  • Experience in an Agile delivery framework.
Read Full Description
Confirmed 12 hours ago. Posted 15 days ago.

Discover Similar Jobs

Suggested Articles