Machine Learning Engineer Intern - LLMs

Criteo

What if, in your next adventure, you were surrounded by people who, like you, look for an unlimited playground to explore, share, and test, would you care to hear more? You've opened the right door! As an R&D team, making sure your ideas are heard and encouraged is what we strive to do!

What You'll Do:

The goal of this internship is to explore approaches for automatically generating new markup templates that could lead to more effective layouts. In particular, we aim to leverage Large Language Models (LLMs) to generate valid and diverse templates based on existing examples.

A key advantage of LLMs is their ability to be fine-tuned and aligned with performance objectives by leveraging the right data. This enables us to pursue Generative Creative Optimization (GCO)—where a generative model, conditioned on the context, will likely produce, high-performing creatives. By integrating LLMs into this process, we can move beyond manual template design and unlock a broader, more optimised space of ad layouts.

Projected outline of the internship

This internship focuses on fine-tuning Large Language Models (LLMs) to generate high-performing ad layouts. The project will begin with a research phase, where the intern will review existing methods for LLM alignment, including RLHF, Direct Preference Optimization (DPO), and RL with constraints. During this phase, they will analyse the problem, study the dataset in hand, and define evaluation benchmarks to assess layout performance.

Once the research foundation is set, the intern will experiment with different training techniques, prompt designs, and model architectures to improve layout generation. The goal is to identify the best alignment approach based on business performance metrics and validate its effectiveness through controlled experiments.

The next stage will involve implementing and testing the model, comparing its outputs against existing manual and automated methods. The intern will refine the approach based on quantitative and qualitative evaluations, ensuring the generated layouts align with business goals.

By the end of the internship, the findings will be synthesized into a research paper for potential submission to a workshop or conference. If the approach proves successful, there may be an opportunity to explore its integration into production systems.

Who You Are:

  • Strong background in machine learning and statistics.
  • Familiarity with deep learning architectures, such as transformers.
  • Familiarity with NLP and LLMs (supervised fine-tuning, RLHF, DPO is a plus).
  • Proficiency in programming languages like Python and experience with deep learning frameworks (PyTorch and / or JAX).
  • Appetency for scientific research and its applications in the tech industry.

We acknowledge that many candidates may not meet every single role requirement listed above. If your experience looks a little different from our requirements but you believe that you can still bring value to the role, we’d love to see your application!

Who We Are:

Criteo is the global commerce media company that enables marketers and media owners to deliver richer consumer experiences and drive better commerce outcomes through its industry leading Commerce Media Platform.

At Criteo, our culture is as unique as it is diverse. From our offices around the world or from home, our incredible team of 3,600 Criteos collaborates to develop an open and inclusive environment. We seek to ensure that all of our workers are treated equally, and we do not tolerate discrimination based on race, gender identity, gender, sexual orientation, color, national origin, religion, age, disability, political opinion, pregnancy, migrant status, ethnicity, marital or family status, or other protected characteristics at all stages of the employment lifecycle including how we attract and recruit, through promotions, pay decisions, benefits, career progression and development. We aim to ensure employment decisions and actions are based solely on business-related considerations and not on protected characteristics. As outlined in our Code of Business Conduct and Ethics, we strictly forbid any kind of discrimination, harassment, mistreatment or bullying towards colleagues, clients, suppliers, stakeholders, shareholders, or any visitors of Criteo. All of this supports us in our mission to power the world’s marketers with trusted and impactful advertising encouraging discovery, innovation and choice in an open internet.

Why Join Us:

At Criteo, we take pride in being a caring culture and are committed to providing our employees with valuable benefits that support their physical, emotional and financial wellbeing, their interests and the important life events. We aim to create a place where people can grow and learn from each other while having a meaningful impact. We want to set you up for success in your job, and an important part of that includes comprehensive perks & benefits. Benefits may vary depending on the country where you work and the nature of your employment with Criteo. When determining compensation, we carefully consider a wide range of job-related factors, including experience, knowledge, skills, education, and location. These factors can cause your compensation to vary.

Read Full Description
Confirmed 18 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles