Recognized as a global leader in interactive and digital entertainment, Sony Interactive Entertainment (SIE) is responsible for the PlayStation® brand and family of products and services. PlayStation has delivered innovation to the market since the launch of the original PlayStation in Japan in 1994. The PlayStation family of products and services include PlayStation®4, PlayStation®VR, PlayStation®Vita, PlayStation®3, PlayStation®Store, PlayStation®Plus, PlayStation™Video, PlayStation™Music, PlayStation™Now, PlayStation™Vue, PlayStation®Original and acclaimed PlayStation software titles from SIE Worldwide Studios. Headquartered in San Mateo, California, SIE is a wholly-owned subsidiary of Sony Corporation and has global functions and regional headquarters in California, London and Tokyo. 

Spark ETL Engineer

San Mateo, CA

Description:

With over 120 Million customers in 109 countries, Sony Interactive Entertainment (SIE) is committed to using data to understand The Players: our customers, better than anyone else. Using the amazing networked power of PlayStation®4 and our other PlayStation systems we learn how they use them for gaming, and also how they use the networked services like streamed games, music, video and TV, how they pay, and how we can improve their customer experience. We work with games developers, marketing, R&D, PlayStation®Store, and many other parts of Sony to constantly improve our customer experience and maximise our business potential.

The Business Intelligence Services (BIS) team has grown rapidly over recent years in response to an increasing need for the business to leverage data to inform and shape key decisions, and to identify new opportunities. Currently there are approximately 100 staff within the BIS team, split between London and California, made up of high quality BI and data professionals covering BI architecture and platform support, data processing, insight reporting, predictive analytics, scrum masters and product management

Due to team expansion BIS are looking to recruit talented, highly driven individuals who have excelled in previous roles and are looking for a new challenge in a dynamic and rewarding environment.

We are looking for an experienced Spark ETL Engineer that has extensive experience developing in Spark to join our Business Intelligence Services team within the Sony PlayStation environment.

 

Responsibilities:

A Big Data Engineer is required to work within the Data Engineering Team with the successful applicant responsible for the design, development and maintenance of the BIS data processing & data pipelines.  They will be required to fit into a highly skilled team and work with limited supervision, under their own initiative.

The successful candidate will be eager to train team members in the Spark expertise they have. While the main ETL language will be pyspark, knowledge of the cloud echo system is a definite advantage.

This role reports to the Global Head of Data Engineering

  • Translate complex functional and technical requirements into detailed design.
  • Completion of technical assessments and impact analysis to determine level of effort of the work requested
  • Take on technical ownership of a work stream and become the subject matter expert
  • Performance tuning of code and review of fellow developer’s code to confirm adherence to best practices
  • Work with Project Managers and Business Analysts to ensure the timely delivery of project deliverables which meet requirements
  • Propose best practices & standards
  • Requires ability to work in a global and multi-cultural environment. Team members are in multiple geographies, resulting in time constraints due to time zones differences and a requirement for occasional travel
  • Ability to multi-task and prioritise within parallel development cycles and aggressive timelines
  • Experience in SDLC methodologies (Agile, Waterfall)
  • Mentoring of more junior members in the team 

Experience Required: 

  • At least 3 years’ experience of AWS and Spark (Scala, Java, Python)
  • Reinterpreted traditional ETL functionalities to Spark ETL
  • Highly skilled in SQL and a variety of database technologies
  • Ability to build generic components in Spark
  • Experienced in programming languages (e.g. Java, Python, Scala)
  • Experience working on projects that are rich in data complexity and volume
  • Considerable experience in a similar role, with proven expertise gained in challenging, business critical projects
  • Eligibility to work in the UK and travel to the US
  • Fluent in English 

Skills Required (essential):

  • Demonstrable experience in building large-scale Big Data cloud based systems
  • Good knowledge in back-end programming (Java, Scala, Python)
  • Strong UNIX shell scripting
  • Analytical and problem solving skills, applied to Big Data domain
  • Writing high-performance, reliable & maintainable code
  • Strong demonstrable skills using version control systems
  • Knowledge of database structures, theories, principles, and practices
  • Extensive experience throughout the software development lifecycle
  • Skilled in business requirements gathering with ability to translate into detailed technical specifications
  • Strong communication – ability to explain complex technical issues in non-technical terms 

Skills Required (desirable): 

  • Understanding of other data processing technologies (Kakfa, Storm, Presto, AWS Glue)
  • Experience in ETL tools (Ab Initio)
  • Familiarity with data loading tools (Sqoop, Flume)
  • Knowledge of workflow/schedulers (Control-M, Oozie, Airflow).

Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to race, color, religion, gender, pregnancy, national origin, ancestry, citizenship, age, legally protected physical or mental disability, covered veteran status, status in the U.S. uniformed services, sexual orientation, gender identity, marital status, genetic information or membership in any other legally protected category. 

We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond. 

We sincerely appreciate the time and effort you spent in contacting us and we thank you for your interest in PlayStation.

Read Full DescriptionHide Full Description
Confirmed 51 minutes ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles

One Step Register
Need an account? Sign Up