We’re seeking a Sr. Software Engineer – Data & BI to design, develop, and optimize scalable cloud-based data pipelines and analytics solutions using Azure Data Factory, Databricks, and Lakehouse architecture. This role partners closely with business teams to translate data needs into high-quality, secure, and scalable solutions while supporting Power BI reporting initiatives.
Key Responsibilities:
- Design, build, and maintain ETL/ELT pipelines with ADF and Databricks, including complex transformations using PySpark.
- Integrate data from cloud and on-prem systems, APIs, CRM, and telematics sources.
- Develop robust data models, schemas, and curated datasets optimized for analytics and BI.
- Maintain data governance, security, and lineage using Unity Catalog.
- Collaborate with business partners to gather requirements and translate into scalable solutions.
- Build and maintain Power BI dashboards; optimize datasets for reporting and KPI tracking.
- Contribute to version control, CI/CD, and deployment best practices.
- Mentor junior engineers and troubleshoot pipeline or infrastructure issues.
Required Skills:
- Expertise in Azure Data Factory, Databricks, PySpark, Azure Data Lake, and Lakehouse architecture.
- Strong Python and SQL skills; experience with diverse data source integration.
- Understanding of BI concepts and Power BI fundamentals.
- Excellent collaboration, communication, and problem-solving skills.
Preferred Skills:
- Power BI dashboard creation and DAX/Power Query experience.
- Familiarity with Azure Synapse, Microsoft Fabric, and IaC tools (ARM, Terraform).
Qualifications:
- Bachelor’s in Computer Science, Information Systems, Engineering, or related field.
- 6–8 years of experience in data engineering, analytics engineering, or cloud data roles.
Compensation: $110,000 to $125,000 annually
Compensation is based on a range of factors that include relevant experience, knowledge, skills, other job-related qualifications.
Read Full Description