Senior Software Engineer - Hadoop Developer

Visa

Company Description

Visa operates the world's largest retail electronic payments
network and is one of the most recognized global financial services brands.
Visa facilitates global commerce through the transfer of value and information
among financial institutions, merchants, consumers, businesses and government
entities.

We offer a range of branded payment product platforms, which
our financial institution clients use to develop and offer credit, charge,
deferred debit, prepaid and cash access programs to cardholders. Visa's card
platforms provide consumers, businesses, merchants and government entities with
a secure, convenient and reliable way to pay and be paid in 170 countries and
territories.

Corporate Information Technology (CIT) encompasses enterprise
technology that empowers Visa Inc. staff to perform core business functions
needed to support ongoing management of Visa Inc. operations. Corporate
Business Systems (CBS) is a group in Corporate IT that provides application
design and development service to support corporate systems within the Finance,
Global Risk and Compliance, Sourcing, Legal, and Corporate Services portfolios.
This position is for Finance team, so an experience in Finance is necessary.
This includes managing system requirements, design, development, integration,
quality assurance, implementation and maintenance of corporate applications.
There will be interaction with customers and key stakeholders in Financial
Systems Strategy (FSS), Project Management Office (PMO) & Global
Operations

Job Description

Key Responsibilities: 

Visa is currently seeking for a Senior Hadoop with Tableau developer experience in Finance area to deliver Corporate Analytics new strategic framework initiative. This BI platform provides analytical/operational capability to various business domains that are to be used by Corporate FinanceSystems. This Developer role will be primarily responsible for designing,developing and implementing Hadoop framework ETL using relational databases anduse Tableau reporting on it. The new Hadoop framework to be used to build fromthe scratch Oracle Financial analytics/P2P/Spend/Fixed asset solution intoHadoop framework from OBIA. The individual should have a finance business backgroundwith extensive experience in OBIA Fixed Assets, P2P, Financial analytics, SpendAnalytics, and Projects. Expert in Hadoop framework components like Sqoop,Hive, Impala, Oozie, Spark, HBase, HDFS.. Currently we use OBIA Finance modules and translating that into Hadoop with Tableau. So experience in Finance and OBIA is needed. Oracle EBS modules will include General Ledger, Fixed Assets, Account Payables, Purchasing , Spend Analytics, and Projects. 

 

·       Architect, Design and implement column familyschemas of Hive and HBase within HDFS. Assign schemas and create Hive tables.Managing and deploying HDFS HBase clusters.

·       Develop efficient pig and hive scripts withjoins on datasets using various techniques. Assess the quality of datasets fora hadoop data lake. Apply different HDFS formats and structure like Parquet,Avro, etc. to speed up analytics

·       Fine tune hadoop applications for highperformance and throughput. Troubleshoot and debug any hadoop ecosystem runtime issues

·       Hands on experience in configuring, and usingHadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Sqoop, Spark,Impala, Pig, Oozie, Zookeeper and Flume.

·       Desired candidate should have strong programmingskills on Scala or Python to work on Spark

·       Experience in converting core ETL logics usingPySpark SQL or Scala language

·       Good experience on Apache Hadoop Map Reduceprogramming, PIG Scripting and Distribute Application and HDFS.

   Fine tune hadoop applications for highperformance and throughput. Troubleshoot and debug any hadoop ecosystem runtime issues

·       Hands on experience in configuring, and usingHadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Sqoop, Spark,Impala, Pig, Oozie, Zookeeper and Flume.

·       Desired candidate should have strong programmingskills on Scala or Python to work on Spark

·       Experience in converting core ETL logics usingPySpark SQL or Scala language

·       Good experience on Apache Hadoop Map Reduceprogramming, PIG Scripting and Distribute Application and HDFS.

·       In-depth understanding of Data Structure andAlgorithms.

·       Experience in managing and reviewing Hadoop logfiles.

·       Implemented in setting up standards andprocesses for Hadoop based application design and implementation.

·       Experience in importing and exporting data usingSqoop from HDFS to Relational Database Systems and vice-versa.

·       Experience in Object Oriented Analysis, Design(OOAD) and development of software using UML Methodology, good knowledge ofJ2EE design patterns and Core Java design patterns.

·       Experience in managing Hadoop clusters usingCloudera Manager tool.

·       Very good experience in complete project lifecycle (design, development, testing and implementation) of Client Server andWeb applications

·       Experience in connecting Hadoop framework componentsto Tableau reporting

  • Support, design and configuration of Tableau sites, projects and corresponding security, ETL processes, dashboards and reports.

  • Liaise with internal business and IT groups (such as database administration, infrastructure support, development) in performing support activities, system configuration and standard functionality
    analysis for enhancement requests.

  • Adhere to defined support policies, procedures, and service levels with an understanding of SOX related IT controls.

  • Provide support to strategic initiatives as assigned including, but not limited to system configuration, testing of applications and process enhancements, upgrades and new solutions, ensuring
    sound knowledge transfer to assume post-implementation support role.

  • Expected to critically evaluate customer service requests and incidents to prioritize own workload, determine potential global and/or cross-modular impacts, determine temporary procedural work-around where feasible, and communicate to the broader group of impacted parties.

  • Conduct one-on-one user training or formalized, pre-developed larger group training sessions as assigned.

  • Proactively identify, evaluate, and communicate ideas for process improvements and training needs both for applications usage by customers as well as for internal processes and skills enhancement.

  • Work with L3 teams (SME) on the critical requests and resolve it to closure.

  • Responsible for global Customer Service, including end-user support and education and issue troubleshooting and resolution for all users of the Corporate Finance Analytics Production systems.

  • Mentoring the junior team members.

         

Qualifications

Must Have Experiences:

  • BS or equivalent in MIS, CS, or related field

  • Minimum 5-7 years’ experience with Hadoop framework components (HDFS, HBase, Sqoop, Hive, Impala, Spark, Scala, Python, Oozie)

· Experience in Tableau reporting tool with Hadoop

· Experience in ETL tools like Informatica or likewise

· Finance OBIA modules experience is highly recommended: Fixed assets, PSP, Spend analytics, Financial analytics

  • Custom OBIEE Finance data marts and extending OOTB OBIA Finance data marts like
    Financial Analytics, General Ledger, Fixed Assets, Account Payables, PR, PO,
    Spend analytics. Spend classification and its integration with Oracle EBS
    • Tableau Reporting tool

    • Support data warehouses, star data models, meta-data and RPD

    • Support, design and development of ETL using Informatica 9.1

    • Support, design and development of Informatica and DAC routines

    • Configuring delivers iBots to support business requirements

  • Strong knowledge of database concepts, systems architecture, and data structures is a must

  • Extensive experience with Oracle databases and SQL development

  • Good understanding of OBIEE and Tableau architecture

  • Extensive hands-on experience with Linux and Windows

  • Process oriented with strong analytical and problem solving skills

  • Work independently and mentor others in the team and with minimal supervision

  • Experience with building analytical reports using Tableau required

  • Solid understanding of ITIL methodology.

  • Nice to have Power BI and/or any other smart BI tools such as Hadoop Eco systems

Additional Information

Common Purpose, Uncommon Opportunity. Everyone at Visa works with one goal in mind –
making sure that Visa is the best way to pay and be paid, for everyone
everywhere. This is our global vision and the common purpose that unites the
entire Visa team. As a global payments technology company, tech is at the heart
of what we do. CyberSource, a Visa company, has been and continues to be a
pioneer within the e-Commerce Payment Management world. Our VisaNet network is
capable of handling over 65,000 transaction messages per second for people and
businesses around the world, enabling them to use digital currency instead of
cash and checks. 



We are also global advocates for financial inclusion, working with partners
around the world to help those who lack access to financial services join the global
economy. Visa’s sponsorships, including the Olympics and FIFA™ World Cup,
celebrate teamwork, diversity, and excellence throughout the world. If you have
a passion to make a difference in the lives of people around the world, Visa
offers an uncommon opportunity to build a strong, thriving career. Visa is
fueled by our team of talented employees who continuously raise the bar on
delivering the convenience and security of digital currency to people all over
the world. Join our team and find out how Visa is everywhere you want to be. 



“Visa will consider for employment qualified applicants with criminal histories
in a manner consistent with the requirements of Article 49 of the San Francisco
Police Code.”

I'm interested
Read Full DescriptionHide Full Description
Confirmed 19 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles

One Step Register
Need an account? Sign Up