Data Engineer(WITT/Data Stratergy-TDH,Spark,ETL) -- Data Division

BNP Paribas

Education
Benefits
Skills

About BNP Paribas India Solutions:

Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.

About BNP Paribas Group:

BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialised businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability

Commitment to Diversity and Inclusion

At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.

About Business line/Function:

As part of WMIS department, Products & Execution division under Products &Services domain is responsible for IT projects deliveries and level 3 support for various business functions, including dealing activities for various financial products (FX, Equities, Bonds, Funds, Structed Products, Options, Derivatives), regulatory trade reporting for various countries in Asia and Europe

Job Title:

Data Integration Engineer (TDH, Spark,ETL)

Date:

Department:

DDD - Data & AI Solutions

Location:

Chennai

Business Line / Function:

Wealth Management Information Services

Reports to:

(Direct)

NA

Grade:

(if applicable)

(Functional)

Number of Direct Reports:

0

Directorship / Registration:

NA

Position Purpose

Wealth Management (WM) has embarked on a multi-year transformation project. This transformation is in particular driven by:

  • A transformation plan for a new global IT platform called WITT (Wealth Management IT TRANSFORMATION). An integral part of this program is new platform to be designed, developed and hosted in Group DMZR (Private Cloud), gathering data from all WM locations, and dedicated to reporting, analytics and data science.
  • A specific Data Strategic plan, aiming at developing at both Business and IT sides our capabilities regarding data management, data quality and data analytics/ data science.

The Data Integration Engineer will be assigned to the Data & AI Solutions Division and will add to the needed capacity of the team to fulfill the demands for new developments and/or evolution related to Data Management as expressed by Wealth Management Business.

The Data Integration Engineer is expected to work in close collaboration with the Technical Chapter lead in areas such as drafting technical specifications, development effort estimation whenever assigned. The Data Integration Engineer is expected to implement data ingestion framework and also provide guidance to other developers that would be assigned to him/her in the course of the project. The Data Integration Engineer must ensure the activities/processes performed follows strictly the development standards and processes as prescribed by in the IT governance.

Responsibilities

Direct Responsibilities

  • Design, Develop, Test, Deploy and Administer Data Integration pipeline developed on ETL / ELT tools on Data Platform.
  • Collaborate with Technical Chapter Lead, architecture, and release teams, providing architectural design recommendations, driving standards for Data Integration subjects.
  • Provide analysis/evaluation of technical solutions recommended by the group to facilitate management decision.
  • Provide support during SIT, UAT roll-out and post-production whenever needed.
  • Ensure the standards per the Wealth management governance are followed at all times.
  • Ensure all aspects of security are respected at all times during the course of work.
  • To engage the other technical stakeholders within WM (e.g. DOMAIN ARCHITECT, Conformity Cell, Security Team, Application Integration and Production team) in the course of work.

Contributing Responsibilities

  • Coordinating with team members and upstream systems for data ingestion activities

Technical & Behavioral Competencies

  • Reporting Analytics Database Platform experience creating extracting, transforming, loading, and enhancing objects to ingest structured, semi-structured, and unstructured data sources; implementing, maintaining and optimizing data warehouses; and/or gathering and implementing user requirements.
  • Extensive hands on experience in designing, building and executing data pipeline using ETL/ELT tool Apache Nifi (Source, Extraction and Processors & Sink modules).
  • Designing & Building Source Interfaces constructs in Apache Nifi to source data from API (On-Demand or Batch), Event based streams in Kafka, Direct pull from RDBMS or File Transfer.
  • Strong Hands on experience with complex Transformation based data pipelines designed &
  • developed using Apache Spark & Python Structured data API / Library.
  • Hands on experience on designing, developing, testing ETL/ELT Jobs interacting with multiple
  • storage formats – File (Avro, Parquet, ORC), DB (Postgres, Oracle), Object Storage (S3), NoSQLDB (Mongo, Elastic)
  • Experience and knowledge on Access & Data Security – AD-LDAP-SAML- Kerberos-2FA IDPAuthN plus Data security through encryption, masking, filtering, anonymization
  • Strong hands on experience in Processing Framework - Spark 2.x/3.x (Core, structured API,Streaming, MLLib) Language & Package - Python (Scripting & PySpark), Scala using Spark API,Unix Shell, SQL Query (basic & advanced)
  • Knowledge on Streaming Platform – Apache Kafka, Apache Nifi, Spark Streaming, Flink, Storm
  • Experience on BI Analytics – Tableau Server & Creator, Power BI
  • Having a good understanding of Data Sourcing, Integration, Processing, Change Data Capture,Data Warehousing architectural design principles and Data Storage Model approach covering Stage, Raw, Refined, History & Schema Evolution
  • Working experience on Agile Methodology & DataOps tools like JIRA, Jenkins, BitBucket,Serena, Autosys
  • Working knowledge of Linux operating system covering scripting & debugging.
  • Experience in collaborating with software engineers/teams to solve complex application problems
  • Good communication and collaboration skills
  • Good understanding of Wealth Management Products is a plus.

Specific Qualifications (if required)

Knowledge of Data science workloads related Statistical, machine learning, AI use cases & open source library.

Knowledge of Cloud Migration, Storage & Services especially for IBM Private-Public cloud stack

Wealth Management Domain experience working with IT, Business, Support, Product vendor

Skills Referential

Behavioural Skills: (Please select up to 4 skills)

Critical thinking

Ability to collaborate / Teamwork

Attention to detail / rigor

Ability to deliver / Results driven

Transversal Skills: (Please select up to 5 skills)

Ability to understand, explain and support change

Ability to develop and adapt a process

Ability to develop others & improve their skills

Analytical Ability

Choose an item.

Education Level:

Bachelor Degree or equivalent

Experience Level

At least 10 years

Other/Specific Qualifications (if required)

Read Full Description
Confirmed an hour ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles