Wex has flagged the Principal Infrastructure Engineer job as unavailable. Let’s keep looking.

The IT Data Engineering team at IDEXX is seeking a Principal Data Engineer to lead the development and optimization of one of our operational data pipelines. In this role, you will be pivotal in shaping our approach to near real-time data processing and streaming, utilizing state-of-the-art technologies in a cloud-native environment. Your expertise will drive the evolution of IDEXX's data capabilities, focusing on agility, scalability, and near real-time data processing.

Your Impact: As a Principal Data Engineer, your role is vital in shaping the future of near real-time data processing at IDEXX. You will drive innovation, streamline operational processes, and support strategic business decisions through advanced data solutions. Your expertise will not only shape our data architecture but also influence the growth and success of the organization.

Technical Environment:

  • Priority Technologies: Apache Spark, Python, Scala, AWS Glue, Terraform, MongoDB/DocumentDB, Git, Snowflake, AWS EMR, REST API
  • Streaming Technology: AWS Kinesis
  • Cloud Platforms: AWS (S3, Lambda, DynamoDB, OpenSearch)
  • Infrastructure as Code: Terraform
  • Version Control: Git

In this role:

  • You will lead the design and implementation of operational data pipelines, with a focus on AWS Kinesis for streaming data.
  • You will utilize AWS serverless technologies, such as Glue and Lambda, to enhance our data processing capabilities.
  • You will collaborate with cross-functional teams to understand and meet the data needs for near real-time processing.
  • You will develop and maintain scalable and reliable data solutions that support IDEXX's operational and business requirements.
  • You will ensure high standards of data accuracy and accessibility in a fast-paced, dynamic environment.
  • You will lead the planning and architecture of technical activities related to data pipeline design, system performance tuning, and troubleshooting.
  • You will mentor team members in best practices for streaming data architecture and serverless data processing.
  • You will proactively manage technical challenges, ensuring optimum performance of data systems.
  • You will maintain thorough documentation of data structures, pipelines, and metadata.
  • You will design and implement fault-tolerant systems, ensuring high availability and resilience in our data processing pipelines.
  • You will develop and maintain cloud-based disaster recovery (DR) architectures, planning for data redundancy, failover processes, and rapid recovery in case of system failures.
  • You will actively participate in testing and quality engineering (QE) processes, collaborating closely with the QE team to ensure the reliability and accuracy of data solutions.

What you will need to succeed:

  • Proven experience in building and maintaining operational data pipelines, particularly with streaming technologies like AWS Kinesis.
  • Strong proficiency in Apache Spark, Python, and Scala.
  • Strong background in AWS cloud services, with a focus on serverless architectures for data processing (Glue, Lambda, etc.).
  • Familiarity with a broad range of technologies, including:
  • Cloud-native data processing and analytics
  • SQL and NoSQL databases (Oracle, PostgreSQL, MySQL, DynamoDB, MongoDB)
  • Scripting and programming with Python and Scala, or similar languages
  • In-depth knowledge of real-time data processing and streaming data architectures.
  • Experience working in collaborative team environments, effectively managing projects using agile frameworks such as Scrum and Kanban, and contributing to continuous improvement of team practices.
  • Ability to translate complex business requirements into scalable and efficient data solutions.
  • Strong multitasking skills and the ability to prioritize effectively in a fast-paced environment.

Why IDEXX?

We’re proud of the work we do, because our work matters. An innovation leader in every industry we serve, we follow our Purpose and Guiding Principles to help pet owners worldwide keep their companion animals healthy and happy, to ensure safe drinking water for billions, and to help farmers protect livestock and poultry from diseases. We have customers in over 175 countries and a global workforce of over 10,000 talented people.

So, what does that mean for you? We enrich the livelihoods of our employees with a positive and respectful work culture that embraces challenges and encourages learning and discovery. At IDEXX, you will be supported by competitive compensation, incentives, and benefits while enjoying purposeful work that drives improvement. 

Let’s pursue what matters together.

IDEXX values a diverse workforce and workplace and strongly encourages women, people of color, LGBTQ+ individuals, people with disabilities, members of ethnic minorities, foreign-born residents, and veterans to apply.

IDEXX is an equal opportunity employer. Applicants will not be discriminated against because of race, color, creed, sex, sexual orientation, gender identity or expression, age, religion, national origin, citizenship status, disability, ancestry, marital status, veteran status, medical condition, or any protected category prohibited by local, state, or federal laws.

What you can expect from us:

  • Base annual salary target: $150,000 - $170,000 (yes, we do have flexibility if needed)
  • Opportunity for annual cash bonus
  • Health / Dental / Vision Benefits Day-One
  • 5% matching 401k
  • Additional benefits including but not limited to financial support, pet insurance, mental health resources, volunteer paid days off, employee stock program, foundation donation matching, and much more!

#LI-REMOTE

Read Full Description
Confirmed 4 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles