Birlasoft

Area(s) of responsibility

About the Role

We are seeking a Senior Data Platform Engineer with extensive hands-on experience to build and scale enterprise-grade data pipelines on Azure and Databricks. This role requires deep technical expertise, strong ownership, and the ability to independently deliver complex, production-ready data solutions while setting engineering best practices.

What You'll Do

• Build scalable pipelines using Databricks (DLT, Autoloader, Workflows) and Azure services
• Extend metadata-driven ingestion frameworks (declarative, reusable)
• Develop modular PySpark code and libraries (WHL packaging)
• Implement Delta Lake patterns (CDC, SCD Type 2, merges)
• Optimize SQL workloads for performance and cost
• Orchestrate pipelines via Synapse or UC4
• Apply data modeling (Kimball, 3NF, lakehouse)
• Implement CI/CD with Azure DevOps
• Enforce governance via Unity Catalog
• Mentor engineers and contribute to engineering standards

Required Technical Skills & Proficiency Category Technology / Skill Required Proficiency

Cloud Platform Azure (ADLS Gen2, Key Vault, Azure SQL, Entra ID) Advanced (Deep hands-on, production-scale design & troubleshooting)