Bayt

Full time

Retail & Wholesale

Job Description

Overview of the role

As a Senior Data Engineer within the Data and Analytics team your role is pivotal in transforming complex data landscapes into actionable business insights. You will be tasked with the evaluation of diverse new data sources, originating from both SAP and Non-SAP systems. Your expertise will enable you to rapidly convert these data sources into datasets that are primed for generating business insights.

Furthermore, you will play a crucial role in the development and support of integrating these new data streams into our Azure Data platform. This includes not only the technical integration but also ensuring that the data is accessible, reliable, and structured in a way that supports our overarching business intelligence and analytics goals. Your contributions will directly impact our ability to make data-driven decisions and maintain our competitive edge in the marketplace

What you will do

• Role requires to design, document, develop, implement, and test rapid prototypes to showcase the value of data within extended business audiences.
• Engage in early-stage design discussions and feature definition activities, predefining potential insights to shape future projects.
• Responsible for building and managing reusable and scalable data pipelines, optimizing data flows for efficiency and effectiveness.
• Convert business requirements into Technical Specification Documents (TSDs) and Functional Specification Documents (FSDs), bridging the gap between business needs and technical execution.
• Assist with regular reporting queries and support other developers in utilizing tools such as Alteryx, Power BI, and Azure for data analysis and visualization.
• Act as a team player, working collaboratively with team members across multiple engineering teams. Your role will be crucial in supporting the integration of proven prototypes into core intelligence products, facilitating seamless collaboration and knowledge sharing.
• Adapt to both agile and waterfall project delivery methodologies, guiding both internal and external teams to ensure timely and on-spec business deliveries. As a senior team member your leadership will navigate the team through dynamic project environments to meet and exceed business expectations

Skills

equired Skills to be successful

• Robust working knowledge and experience with both relational and non-relational databases, demonstrating a versatile skill set capable of navigating complex data environments.
• Proven work experience in constructing and refining Big Data pipelines, architectures, and datasets.
• Strong analytical abilities, mainly in handling and deriving insights from unstructured datasets.
• Design, document, develop, implement, and test rapid prototypes to showcase the value of data within extended business audiences.
• Engage in early-stage design discussions and feature definition activities, predefining potential insights to shape future projects.
• Responsible for building and managing reusable and scalable data pipelines, optimizing data flows for efficiency and effectiveness.
• Convert business requirements into Technical Specification Documents (TSDs) and Functional Specification Documents (FSDs), bridging the gap between business needs and technical execution.
• Assist with regular reporting queries and support other developers in utilizing tools such as Alteryx, Power BI, and Azure for data analysis and visualization.
• Act as a team player, working collaboratively with team members across multiple engineering teams. Your role will be crucial in supporting the integration of proven prototypes into core intelligence products, facilitating seamless collaboration and knowledge sharing.
• Adapt to both agile and waterfall project delivery methodologies, guiding both internal and external teams to ensure timely and on-spec business deliveries. As a senior team member your leadership will navigate the team through dynamic project environments to meet and exceed business expectations.

What equips you for the role

• Minimum 10+ years of experience in data engineering in Azure and Databricks.
• Bachelor’s or Master’s degree in data management, information systems, computer science, or a related field.
• Deep knowledge and practical experience with Azure Data Factory, Databricks, Azure Event Hub, Python, PySpark, Mongo DB, Graph DB and SQL.
• Experience with Azure DevOps is required for deploying ADF pipelines, ensuring continuous integration and delivery within our development lifecycle.
• Knowledge of Data Engineering components like Python, PySpark, Spark SQL, Databricks UI, Unity Catalog, SCIM Integration, External Location, Databricks cluster and job management.
• Certifications in Azure Data Fundamentals, Databricks are preferred.

Compare your profile with other applicants

Company

Follow Following

Al Futtaim Group

Dubai, United Arab Emirates

Established in the 1930s as a trading business, Al-Futtaim is one of the most progressive regional business houses headquartered in Dubai, United Arab Emirates. Structured into six divisions; automotive, retail, electronics, engineering and technology, real estate, financial services and general services, Al-Futtaim operates through more than 60 companies and maintains a decentralised approach, giving individual businesses flexibility and versatility to maintain a competitive stance. Employing in excess of 20,000 people across the UAE, Bahrain, Kuwait, Qatar, Oman, Egypt, Syria, Pakistan, Singapore and Europe, this approach benefits employees, providing a clearly defined work culture where individuals are empowered with authority and responsibility for their work. The success of Al-Futtaim is attributed to proactively managing change whilst upholding the values of integrity, service and social responsibility. The majority of businesses, built on a portfolio of world leading brands, dominate their sector.

View Company Profile