Commence

Job Type

Full-time

Description

At Commence, we’re the start of a new age of data-centric transformation, elevating health outcomes and powering better, more efficient process to program and patient health. We combine quality data-driven solutions that fuel answers, technology that advances performance, and clinical expertise that builds trust to create a more efficient path to quality care.

With human-centered, healthcare-relevant, and value-based solutions, we create new possibilities with data. We provide proof beyond the concept and performance beyond the scope with a focus on efficiencies that transform the lives of those we serve. With a culture driven by purpose, straightforward communication and clinical domain expertise, Commence cuts straight to better care.

Requirements

The Lead Data Platform Engineer is responsible for the design, build, and operation of Commence’s enterprise data platform. This role will establish the standards, pipelines, and controls required to enable analytics, AI/ML, and compliance use cases at scale across commercial and Federal environments with a focus on Healthcare data. The individual in this position must possess strong data engineering expertise, cloud platform administration skills, and the ability to balance technical execution with security and compliance requirements.

• Administer and manage Databricks workspaces, clusters, and security configuration.
• Design and implement scalable ingestion pipelines (batch and streaming) into Delta Lake.
• Establish CI/CD practices for data pipelines and implement cost monitoring/optimization.
• Ensure alignment with FedRAMP, HIPAA, and FISMA security and compliance requirements.
• Partner with DevOps to implement infrastructure-as-code and automation practices.
• Collaborate with stakeholders (engineering, backend, DevOps, product) to identify platform gaps and design scalable, long-term solutions that unlock product innovation.
• Provide technical leadership and management of data engineers, fostering technical growth, improving team practices, and elevating the quality of engineering across the board.
• Collaborate with Analytics and Data Science leads to deliver trusted, reusable data assets.
• Ensure operational excellence by automating infrastructure, monitoring key systems, and leading incident response and root cause analysis for platform-related issues.
• Evaluate and introduce new technologies and practices (e.g., container orchestration, data lake solutions, workflow orchestration tools) based on evolving business needs.
• Define and enforce platform best practices for coding standards, testing, monitoring, and documentation.
• Perform other duties as assigned.

Qualifications

• 7+ years of experience in data engineering, platform architecture, or related roles.
• Hands-on expertise with using and administering Databricks, Spark, Delta Lake, and orchestration tools (Airflow, Databricks Workflows, etc.).
• Demonstrated experience in implementing Data Lakes/ Lakehouse architecture using Databricks and AWS technologies.
• Familiarity with modern data frameworks like Data Fabric/ Mesh is a plus.
• Strong knowledge of AWS services (incl. GovCloud), IAM, VPC, and network security.
• Experience with Unity Catalog or equivalent governance/cataloging tools.
• Familiarity with regulated environments (HIPAA, FedRAMP, FISMA).
• Demonstrated ability to design secure, cost-effective, and scalable data platforms.
• Strong problem-solving skills, attention to detail, and a passion for continuous learning.
• Experience working in a healthcare or regulated environment.

Commence.AI is committed to providing equal employment opportunities to all applicants, including individuals with disabilities. If you require a reasonable accommodation to participate in the application process due to a disability, please contact Human Resources at (757) 306-4920 or hr@commence.ai.

Please note that unless you are requesting an accommodation, all applications must be submitted through our online application system.