Big Data DevOps Engineer - (CREQ235077)
We are seeking an experienced Big Data DevOps Engineer with 8Plus years of expertise in designing, building, and supporting large-scale data processing systems. The ideal candidate will have strong handson experience with HDFS, Hive, Spark, and Linux environments, and will be responsible for developing robust ETL pipelines and providing endtoend production support.
Design, implement, and optimize scalable Big Data ETL pipelines using Hive and Spark.
Manage and maintain HDFSbased data storage systems.
Collaborate with Data Engineers, DevOps, and Application teams for data flow orchestration and optimization.Perform root cause analysis and provide L2/L3 production support for data infrastructure issues.Monitor system performance and automate processes in a Linux-based environment.
Ensure high availability and disaster recovery setup for big data platforms.
Follow DevOps best practices for CI/CD pipelines, version control, and deployment.
Document systems architecture, processes, and runbooks.
Mandatory Skills
Technical Skills Strong hands-on experience in Big Data tools (HDFS, Hive, Spark), ETL pipeline development, and production support in a Linux-based DevOps environment.
Soft SkillsExcellent verbal and written communication skills to effectively liaise between business stakeholders and IT teams.
Strong problem-solving abilities to identify and implement system improvements.
Attention to detail with the ability to analyze complex business processes and technical requirements.
Ability to work independently and manage multiple priorities efficiently.
Strong interpersonal skills for collaborating with diverse teams and clients.
: US-PA-Pittsburgh
: Full Time
: Individual Contributor
: Experienced
: No
: 13/10/2025, 8:32:36 AM
Read Full Description