Senior Big Data Engineer
The Role
We are looking for experienced, innovative and highly motivated engineer who is capable of working independently to design, develop and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization, develop a better understanding of our data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions. In daily work you will be responsible for creation and delivery of a platform loading and processing millions of electronic medical records.
The Team
The Systems Engineering team is part of the Global Technology Organisation (GTO) and remains one of the most dynamic and fast-growing groups in the organisation. We are passionate about Agile software development and are among the strongest advocates for DevOps and Test-Driven Development (TDD). Our culture promotes autonomy and collaboration, empowering individuals to thrive within self-organising teams. Our work involves processing and analysing a wide range of patient-level healthcare data, which supports solving complex healthcare challenges — from retrospective clinical studies to disease progression modelling.
In your daily activities, you will collaborate with a team of Architects who design effective solutions, and with the Quality Assurance team, which ensures the highest standards of software quality.
The Data
We process over a billion records at a time, our engineers are responsible for the data analysis and construction and optimization of data flow processes. You will build data pipeline using ETL solutions for acquiring, processing and loading medical data into the Databricks using pyspark technologies.
Core Responsibilities
Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth.
Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team.
Build pipelines for processing big amount of medical data
Participate in analysis, system design, development, deployment and maintenance
Conduct peer code reviews
Contribute to the definition and adoption of technical standards
Create comprehensive automated unit and integration tests
QUALIFICATIONS & SKILLS
Qualifications
Bachelor’s Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or other related field
Technical skills and knowledge
6+ years of the following language: SQL, Python
6+ years of experience in data engineering
Strong understanding of Databricks platform
Experience with Big Data Batch processing and Azure Cloud Services
Hands-on expierience with Oracle databases
Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats
Experience with complex ETL design and implementation
Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting
Experience with CI/CD automation processes and tools such as Jenkins/GitLab
Additional/nice to have:
Familiarity with AI-powered productivity tools such as Copilot or Cursor, and their practical use in day-to-day software development workflows (e.g. code generation, documentation, task automation, or debugging support).
Experience working in an Agile Prince environment
Experience with database design and modelling (data models concepts like: Kimball, Inmon, Data Vault)
Previous experience with healthcare or pharmaceutical data would be an advantage
Knowledge of algorithms & design patterns and how to apply them effectively
Experience with large data volume (TBs’) processing
Personal skills and behaviours :
Excellent analytical & troubleshooting skills.
Strong collaboration, written and verbal skills.
Familiarity with project management concepts, specifically Agile/Scrum
Ability to present complex results in a clear language for both technical and non- technical audience.
A great team player mindset.
IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com
Read Full Description