Senior Spark Developer / Tech Lead - (CREQ185960)
Description
- 5-7+ years of experience in Hadoop/big data technologies.
- Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging.
- Relational and NoSQL database integration and data distribution principles experience
- Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
- Experience with API development and use of JSON/XML/Hypermedia data formats.
- Strong development/automation skills
- Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
- 3+ years of hands-on experience as a Scala developer (with previous Java background)
Knowledge/Experience (Preferred):
- Experience with containerization and related technologies (e.g. Docker, Kubernetes)
- Comprehensive knowledge of the principles of software engineering and data analytics
- Knowledge of agile(scrum) development methodology is a plus
- Cloudera/Hortonworks/AWS EMR, S3 experience a plus
Primary Location
: CA-ON-Mississauga
Schedule
: Full Time
Employee Status
: Individual Contributor
Job Type
: Experienced
Travel
: No
Job Posting
: 03/04/2024, 2:45:50 PM
Read Full Description