We are seeking a Data Engineer (Azure) to build and run scalable data pipelines and platforms on Microsoft Azure. You will work hands-on with Azure Data Factory, Azure Databricks and Azure SQL, plus streaming, automation and governance, to deliver reliable data products teams can trust.
Responsibilities
- Design and build batch and streaming data pipelines using Azure Data Factory and Azure Databricks
- Develop and optimize data models and workloads in Azure SQL and cloud data stores
- Implement event-driven data processing with Azure Event Hubs and Kafka
- Automate deployments using Azure DevOps pipelines and Infrastructure as Code
- Containerize services with Docker and run workloads on Azure Kubernetes Service (AKS)
- Implement data governance and lineage with Microsoft Purview
- Monitor platform health, costs and performance using Azure Monitor and logging
- Partner with engineering and product teams to deliver end-to-end data solutions
Requirements
- Proven experience building data pipelines with Azure Data Factory
- Hands-on experience with Azure Databricks for data processing and orchestration
- Strong skills in Azure SQL plus Python and SQL for transformation and automation
- Knowledge of streaming patterns using Azure Event Hubs and/or Kafka
- Experience with Azure Data Lake Storage and Azure Cosmos DB in modern data platforms
- Familiarity with Azure DevOps and Infrastructure as Code (Bicep, Terraform or Azure Resource Manager templates)
- Ability to apply governance and monitoring using Microsoft Purview and Azure Monitor
- Clear communication and collaborative problem-solving in cross-functional teams
Nice to have
- Azure certifications related to data engineering or solution architecture
- Experience with big data architectures and advanced analytics
- Comfort working in agile delivery models and enterprise environments
We offer/Benefits
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
How We Hire
- Here, we summarize the typical journey to finding a job within EPAM.
- Apply and tell us about yourself!
- Go through some standard interviews:
- General interview with a recruiter
- Technical interview with our technology experts
- Manager interview or Offer interview with a hiring manager
- Get ready to join the team!
- Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!
- It takes 1 min of application to start the journey with us. Apply now!
Life at EPAM
- EPAM Systems Inc. (EPAM) is a leading digital transformation services and product engineering company.
- We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to various innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously.
Read Full Description