We are seeking a skilled Senior Data Engineer with deep expertise in Azure Data Factory to design, build and optimize robust data pipelines across analytical workloads. In this role, you will author and deploy ADF pipelines, implement incremental load patterns and tune database performance to support enterprise-grade BI solutions.
Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.
Responsibilities
- Author ADF pipelines using Copy Activity, Script Activity, ForEach, Execute Pipeline as well as parameterized datasets and linked services
- Debug failed runs in the ADF monitoring view using Azure IR
- Connect ADF instances to a Git repository such as Azure Repos or GitHub, working with the collaboration branch and feature branch model
- Publish ADF artifacts from the Git branch and deploy them to staging and production instances through a CI/CD pipeline
- Implement SQL Server Change Tracking with CHANGETABLE queries, version-based watermarking and the standard incremental load pattern documented by Microsoft
- Design star schemas with fact/dimension modeling for analytical workloads, including choosing grain, identifying dimensions and handling slowly changing dimensions
- Build merge functions and bulk loading processes into delta tables using COPY protocol and PL/pgSQL
- Optimize PostgreSQL performance through checkpoint config, WAL tuning and query optimization
- Configure PgBouncer session and transaction mode while understanding the I/O constraint chain across VM ceiling, disk throughput and connection limits
- Define indexing strategies for analytical queries and debug performance with EXPLAIN ANALYZE
Requirements
- 3+ years of experience in data engineering with proven hands-on ADF pipeline authoring and deployment
- Expertise in ADF's Git-connected authoring model, export parameterization and deployment of artifacts through a CI/CD pipeline to multiple environments
- Proficiency in SQL Server Change Tracking, CHANGETABLE queries and version-based watermarking
- Skills in PostgreSQL fundamentals including COPY protocol, PL/pgSQL and indexing strategies for analytical queries
- Competency in PostgreSQL performance tuning covering checkpoint config, WAL tuning and PgBouncer session vs. transaction mode
- Background in star schema design with fact/dimension modeling and slowly changing dimensions
- Understanding of how BI tools generate SQL against star schemas
- Familiarity with EXPLAIN ANALYZE for query performance debugging
- English proficiency at B2 level or higher
Nice to have
- Showcase of ThoughtSpot-specific experience
- Familiarity with live-query BI tools such as Looker, Tableau live connections or Power BI DirectQuery
We offer/Benefits
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to LinkedIn Learning and Udemy
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow.
Why Choose Us
2024Best Place to Work 20242024Sitecore’s Partner Experience Awards
Read Full Description