Job Type
Full-time
Description
Middleby Corporation is a leading global manufacturer of commercial and residential kitchen equipment. We are committed to innovation, efficiency, and delivering high-quality products to our customers worldwide. Our Digital Technology team is at the forefront of leveraging data and technology to drive business growth and operational excellence.
We are seeking a talented Data Engineer to join our dynamic team at Middleby. In this role, you will be instrumental in building and optimizing our data infrastructure, focusing on large-scale data projects that integrate data from various sources across our diverse business units. You will contribute to shaping our data strategy to support data-driven decision-making, including enabling advanced AI applications that leverage OpenAI's Retrieval-Augmented Generation (RAG) models. This position offers the opportunity to collaborate closely with cross-functional teams, including business stakeholders, data scientists, and devOps software engineers.
Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes within our data lake architecture.
- Integrate, cleanse, and transform data from multiple sources, ensuring data quality, consistency, and reliability across the organization.
- Build and optimize a unified data platform that supports the analytical and reporting needs of various business units.
- Collaborate with data scientists and analysts to implement robust data models and enable advanced analytics and machine learning capabilities.
- Ensure compliance with data governance policies, security standards, and regulatory requirements in our cloud-based environments.
- Automate data ingestion, transformation, and delivery processes to improve efficiency and scalability.
- Utilize modern cloud technologies and tools, particularly within the Azure ecosystem, to develop reliable and scalable data solutions.
- Support AI-driven initiatives by enhancing data pipelines and integrating both structured and unstructured data sources.
- Collaborate with business analysts and other stakeholders to understand their data needs and translate them into technical requirements.
Qualifications:
- Bachelor’s degree in computer science, Engineering, or a related field.
- Minimum of 3+ years of experience in data engineering or a related role.
- Proficiency in Python for scripting, data manipulation, and automation tasks.
- Strong SQL skills with experience in writing complex queries for data extraction and transformation.
- Hands-on experience in designing, building, and optimizing data pipelines and ETL processes.
- Experience with data integration from diverse sources, including databases, APIs, and flat files.
Preferred Skills:
- Experience with Microsoft Azure Data services (e.g., Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Cosmos DB).
- Knowledge of data lake architecture, data warehousing concepts, and cloud-based data storage solutions.
- Familiarity with AI and machine learning concepts, particularly in supporting AI-powered applications such as those using OpenAI technologies.
- Experience working with large-scale, complex datasets from various sources and formats.
- Strong problem-solving and analytical skills, with the ability to optimize data workflows for performance and scalability.
- Understanding of data governance frameworks, data security practices, and data quality management.
At Middleby, you'll have the opportunity to work in a collaborative environment where innovation and technology are key drivers of our success. You'll be part of a team that is shaping the future of data-driven initiatives within the company, contributing to projects that have a real impact on our business and customers.
If you're passionate about data engineering and eager to contribute to a global leader in the kitchen equipment industry, we encourage you to apply and be a part of our exciting journey!
Middleby Corporation is an Equal Employment Opportunity (EOE/M/F/Vets/Disabled) employer and welcomes all qualified applicants.
Read Full Description