Senior Principal Consultant-Data Bricks Architect

Genpact

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. 

Inviting applications for the role of Senior Principal Consultant-Data Bricks Architect! 

Responsibilities 

Data Security Analysis: 

  • Airflow Transition Discussions and actions to move Hash Audit from Talend to Airflow 
  • Databricks Connectivity set-up and discussions, Including Data Analysis and Fault Identification. Design of New Queries and Python Code Alterations. 
  • Problem solving and Analysis including Set-up and Training. 
  • Source Systems discussions and Actions, including NPA accounts rotation and New Connectivity. 
  • Governance discussions and query resolution. 
  • Analysis and Investigation of Issues outside the Normal problems experienced by Hash Audit. 

Assess current data access policies, security protocols, and data classification procedures. 

Identify data security risks and recommend mitigation strategies. 

Define data access control requirements for the UAM framework. 

Databricks Component Design: 

Create detailed design of data access control mechanisms within Databricks using appropriate features. 

Create integration guidelines to configure and integrate Databricks with other existing security tools relevant to data access control. 

Create pseudo code for auto-classification, auto-tagging, and data usage logging within Databricks. 

Collaboration & Documentation: 

Collaborate with the Platform Architect to ensure alignment between data security controls and the overall UAM architecture. 

Document the design and implementation of data access control within Databricks. 

Design pipelines to ingest & integrate structured/unstructured data from heterogeneous sources 

Collaborate with delivery leadership to deliver projects on time adhering to the quality standards 

Qualifications we seek in you! 

Minimum Qualifications 

experience working in Data Engineering Field 

Strong understanding of data security principles and best practices. 

Expertise in Databricks platform, security features, Unity Catalog, and data access control mechanisms. 

Must have designed and implemented at least 2-3 project end-to-end in Databricks. 

Must have experience on databricks which consists of various components as below 

Delta lake 

dbConnect 

db API 2.0 

SQL Endpoint – Photon engine 

Unity Catalog 

Databricks workflows orchestration 

Security management 

Platform governance 

Data Security 

Must have knowledge of new features available in Databricks and its implications along with various possible use-case. 

Must have followed various architectural principles to design best suited per problem. 

Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments. 

Experience with data classification and masking techniques. 

Strong coding skills in Python or Scala. 

Excellent analytical, problem-solving, and communication skills 

In-depth knowledge Data processing techniques and handling large data sets 

Hands on experience using different storage services on Azure for storing data, like ADLS, SQL DB, SYnapse, Delta tables, Hive 

Expert level hands on experience using Databricks in at least 4 projects, creating notebooks using Scala/Python 

Expertise using Pyspark and Spark SQL for processing data for various use cases 

Expertise in code/performance optimization, and troubleshooting PySpark notebooks 

Experience working with atleast 1 big data project using map-reduce 

Experience with Databricks scheduling features to automate Databricks jobs 

Data Architect who has implemented Data Mesh using Data Bricks 

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 

Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training. 

Read Full Description
Confirmed 10 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles