Technical Lead and Senior Software Engineer - Big Data, Hadoop, AWS Elastic MapReduce


Company Type

Job Description Amazon Web Services' Elastic MapReduce (EMR) has started a brand new team with a mission to enable our web services infrastructure to support scientific and business analysis on large data sets with extreme ease of use. The team makes it easy and secure to use the massive scale of parallel computing by non specialized software programs, via multiple layers of abstractions, as well as development and deployment tools. The team aspires to work with the open source community and to contribute significant portion of its software to the open source. This will involve bug fixes, new functionality and individual time contributions in open source projects possibly including Hadoop, Pig, Hbase and others. We are looking for an experienced technical expert in web services technologies to help us build our team in Palo Alto. As a senior engineer, you will work independently and with other software engineers including Principal engineers as well as program/product managers to create distributed services and front-end APIs for developers to consume. You will help shape the overall structure of the Amazon's web service offerings. Key Responsibilities: Hiring and Managing Developers Translation of complex functional and technical requirements into detailed architecture and design. Being very hands-on; working with the engineering team to manage the day-to-day development activities by leading architecture decisions, participating in designs, design review, code review, and implementation. Responsible for the over-all systems architecture, scalability, reliability, and performance. Responsible for real-time operational support of the team's functional areas. Developing and delivering quality services on-time and on-budget. Solutions developed by the team use Java, XML, HTTP, SOAP, Hadoop, Pig and other web technologies. Maintaining current technical knowledge to support rapidly changing technology, always on a look out for new technologies and work with management and development team in bringing new technologies. Candidate must be able to work with a minimum of technical supervision and supplemental engineering support, while responding efficiently to multiple program priorities. Basic Qualifications Bachelors degree in computer science or equivalent experience. 6+ year's overall development experience and 3+ year's enterprise software experience. Preferred Qualifications Masters degree in computer science Core competencies in Java, XML, HTTP, SOAP plus Hadoop (or other Map Reduce implementations) Strong knowledge of data structures, algorithms, enterprise systems, and asynchronous architectures. Deep understanding of web services software architectural and design issues. Experience with HBase and other cloud computing technologies (strong plus). Experience with HPC technologies (strong plus). Experience with other web technologies such as WS* and .Net (plus). Excellent verbal and written communication skills. Proven track record on delivering results, especially in the area of writing high-performance, reliable and maintainable code. Ability to adapt to new development environments, changing business requirements and learning new systems highly desired. Experience with large distributed services is a plus as is building/operating highly available systems Experience of leading the architecture of an open source messaging product is preferred Ability to work well in a team environment and be able to effectively drive cross-team solutions that have complex dependencies and requirements. Strong technical vision, presentation and technology leadership skills Ability to handle multiple competing priorities in a fast-paced environment *LI-AS2 aws-sdesdm-na

Read Full Description
Confirmed 6 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles