We are seeking a skilled Senior Data Software Engineer with strong expertise in PySpark, SQL, and unit testing to join our data engineering team. The ideal candidate will have hands-on experience with Apache Spark, preferably within the Databricks environment, and will be responsible for building scalable data pipelines, optimizing data workflows, and ensuring code quality through rigorous testing practices.
Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Apache Spark (Databricks preferred)
- Write efficient and optimized PySpark code for data transformation and processing
- Develop and execute complex SQL queries for data extraction, validation, and reporting
- Implement unit tests using pytest to ensure code reliability and maintainability
- Collaborate with data scientists, analysts, and other engineers to deliver high-quality data solutions
- Monitor and troubleshoot data workflows and performance issues
- Document technical designs, processes, and best practices
Requirements
- 3+ years of experience in Data Software Engineering
- Proven experience with Apache Spark, ideally in a Databricks environment
- Proficiency in PySpark and SQL
- Background in unit testing frameworks, especially pytest
- Understanding of data engineering principles and ETL processes
- Familiarity with version control systems (e.g., Git)
- Ability to work independently and in a collaborative team setting
- Excellent problem-solving and communication skills
- Proficiency in English at an Upper-Intermediate level (B2) or higher
Nice to have
- Experience with cloud platforms (e.g., Azure, AWS, GCP)
- Knowledge of CI/CD pipelines and DevOps practices
- Familiarity with Delta Lake, MLflow, or other Databricks-native tools
We offer/Benefits
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)
EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.
Why Choose Us
2024Best Place to Work 20242024Sitecore’s Partner Experience Awards
Read Full Description