US Tech Solutions

Location :Toronto,ON — Hybrid (4 Days Onsite, 1 Day WFH)

Duration: 1 Year (ASAP Start) | Extension & Conversion Possible

Schedule: Monday–Friday, Core Business Hours

Employment Type: Contract — Long-term with extension/conversion potential

Job Description

• Client is seeking a Senior Data Engineer to join a 50-person enterprise data platform team supporting a high-visibility Vendor Integration project. In this role, you will design, build, operationalize, and support reliable, secure, and high-performing enterprise-grade data solutions that scale to process multi-millions of records daily.
• You will leverage deep expertise in Azure Databricks, Python notebooks, SQL, API service layers, and cloud data platforms (ADLS, ADF, Azure SQL, Airflow, Unity Catalog, Lakeflow) to drive modern data engineering practices, reusable frameworks, and platform standards.
• This is a long-term contract with clear pathways for extension and conversion.
• You will partner with operations, technology, and vendor teams to automate data ingestion, transformation, notebook execution, job scheduling, and deployment activities. If you are an innovator who thrives in complex, regulated environments and wants to work at the forefront of cloud data engineering and AI-assisted development, we want to hear from you.

Responsibilities

Customer & Technical Delivery

• Deliver deep technical expertise in Azure Databricks, Python, SQL, and cloud data platforms to ensure all technology areas have the necessary tools, processes, and documentation
• Execute engineering strategy for introducing tools and automating data ingestion, transformation, notebook execution, job scheduling, and deployment across Azure Databricks, ADF, Airflow, and API services
• Partner with Operations to integrate automated/self-serve data pipelines, notebook jobs, and API service releases
• Apply in-depth understanding of business data needs to identify synergies across technology and functional areas
• Act as an expert innovator and agent of change, driving modern data engineering practices, reusable frameworks, and platform standards
• Implement best practices for enterprise-grade software development, reusable engineering frameworks, and AI integration into the SDLC
• Shareholder & Governance
• Apply best practices and knowledge of internal/external business issues to improve products and services
• Monitor and control costs within own work
• Interact with governance and control groups (regulatory/operational risk, compliance, audit) to provide SME consultation on engineering technology and tools
• Contribute to negotiations of third-party contracts/agreements with vendor platform providers
• Maintain knowledge of external development, engineering, and emerging solutions with focus on cloud data engineering, Databricks capabilities, API enablement, and scalable data processing
• Proactively identify emerging technologies for building robust platform domains handling multi-millions of records daily with strong reliability, governance, and performance
• Team & Continuous Improvement
• Continuously enhance expertise in Azure Databricks, ADLS, ADF, Azure SQL, Airflow, SQL, API services, and modern data engineering tooling
• Prioritize and manage workload to deliver quality results and meet timelines
• Support a positive work environment promoting service, quality, innovation, and teamwork
• Participate in knowledge transfer with senior management, the team, other technical areas, and business units
• Identify opportunities to enhance productivity, effectiveness, and operational efficiency through reusable components, automated orchestration, and AI-assisted SDLC practices
• Required Skillsets
• Azure Databricks: Deep hands-on expertise developing, optimizing, and managing Databricks workspaces, clusters, and notebooks in enterprise production environments
• Python Notebooks: Expert-level development of PySpark and Python notebooks for data transformation, ETL/ELT, and analytics workloads
• Job Orchestration: Proven experience designing and implementing job orchestration patterns across Databricks Jobs, ADF pipelines, and Airflow DAGs
• SQL Development: Advanced SQL skills for data modeling, stored procedures, performance tuning, and complex query optimization across Azure SQL and data lake environments
• API Service Layer: Hands-on experience designing, building, and supporting API service layers that enable data platform interoperability
• ADLS & ADF: Deep experience with Azure Data Lake Storage Gen2, Azure Data Factory (data flows, pipelines, triggers, integration runtimes)
• Azure SQL: Strong proficiency in Azure SQL Database / SQL Managed Instance development and administration
• Airflow: Practical experience with Apache Airflow for workflow orchestration and pipeline dependency management
• Unity Catalog & Lakeflow: Experience with Databricks Unity Catalog for unified data governance, and Lakeflow for data engineering workflows
• Communication & Stakeholder Management: Strong facilitation, presentation, and cross-functional collaboration skills across business and technology stakeholders

Preferred Skillsets

• AI-Assisted SDLC: Integrating AI into the software development lifecycle using reusable prompts, skills, instructions, and agents
• Enterprise Frameworks: Building enterprise-grade software, reusable data engineering frameworks, and platform standards
• Scalable Architecture: Designing solutions capable of reliably handling multi-millions of records daily with strong performance and governance
• Governance & Risk: Experience consulting with regulatory, operational risk, compliance, and audit groups on data engineering technology
• Vendor Management: Experience contributing to third-party vendor contract negotiations and platform provider relationship management
• emerging Tech: Proactive identification of emerging cloud data engineering technologies and innovative scalable processing patterns

Education: University Degree — Computer Science, Engineering, or Math preferred

Certifications: None required; Azure/Databricks certifications are a plus

Licenses: N/A

About US Tech Solutions

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com

Equal Opportunity Employer: All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement: By applying, you acknowledge that AI-assisted tools may be used during the recruitment process.