Senior Big Data Engineer
Who are we?
- Human Data Science company that accelerates innovation for healthier world
- Global organization operating in over 100 countries hiring over 79k specialists
- One of the most admired companies according to FORTUNE magazine
- Constantly growing Engineering Team with Tech Hub in Warsaw
What will you be doing?
- Designing and developing ETL solutions to process big amount of medical data
- Ensuring high quality by creating comprehensive and automated tests
- Continuously improving our data platform and reducing technical debt
- Supporting introduction of new tools and migration to Azure cloud
- Providing technical guidance to less experienced team members
- Contributing to standards definition and promoting best practices
What is required to get the job done?
- 6+ years of experience in data engineering, ETL design and implementation
- Experience with batch processing (3+ years)
- Experience in data analysis, profiling, integration and reporting (2+ years)
- Excellent knowledge about SQL and Scala (4+ years)
- Experience with Apache Spark, Kafka, Flink and HDFS
- Being a great team player
How to stand out from the crowd?
- Present extensive knowledge about database design and modeling
- Demonstrate commercial experience with Databricks and Azure cloud
- Show us that you are master in Scala and Java
- Impress us with your great analytical and troubleshooting skills
What are we building?
- Data platform to integrate, manage and curate complex medical data sets
- ETL solutions to process data from multiple disparate sources (spanning different countries, languages and compliance requirements)
- Master data management tool specialized on the governance of electronic medical records (EMR) reference dimensions (diagnosis, posology, laboratory & test values, doctors, products)
- Privacy Hub that ensures patient data anonymization according to EU regulations
- Business Intelligence solutions at the top of data we managed
What technology are we using?
- Data Engineering: Cloudera Data Platform, Databricks, Hadoop, Hive, Kudu, Spark, Kafka, Camunda, Scala, Java
- Web application development: Java, C#, Angular, Oracle, Elasticsearch, Kafka
- Testing: Python, Robot Framework
- Cloud: Microsoft Azure
- Containerization: Docker, Kubernetes
#LI-ARZO
#LI-REMOTE
IQVIA is a leading global provider of advanced analytics, technology solutions and clinical research services to the life sciences industry. We believe in pushing the boundaries of human science and data science to make the biggest impact possible – to help our customers create a healthier world. Learn more at https://jobs.iqvia.com
Read Full Description