Internship - State Persistence Infrastructure for Stream Processing

Nokia

Duration: 6 weeks to 3 months

 

Bell Labs has an opportunity for a student to join our Application Platforms and Software Systems research lab in Antwerp for an internship in the area of stateful stream processing.

 

Mission:

The student will add system-wide state management support to a research stream processing platform currently being built at Nokia Bell Labs (www.worldwidestreams.io).

 

Background:

Most of the core dataflow operators used in stream processing are stateful, i.e. they maintain internal variables (e.g. counters, maps, etc) and their outputs depend on both the incoming data items as well as the internal state of the operator. Examples include windowing operators, running aggregates, and streaming joins.

These operators typically keep their state information in local in-memory structures. Upon failure, however, the state information is lost.

System-wide state management mitigates this problem by providing a uniform, efficient, and reliable storage infrastructure with a simple and well-defined API that can be used by operators to store and retrieve state information.

Such state management infrastructure can, additionally, serve as a crucial building block for scaling up and migrating the stateful operators.

 

Key Responsibilities:

·       The student will survey the approaches adopted by other stream processing platforms

·       Will design and implement his/her own state management infrastructure

·       Integrate (and test) the final subsystem with Nokia Bell Lab’s stream processing platform

·       Submit a final report and give a presentation to the research team

 

Qualifications:

·       Enrolled student in Master in Computer Science

·       Familiarity with stream processing and in-memory databases is a plus

·       Language skills: a working proficiency of English

·       Communication skills: be able to fluently present his work to a team of experts

 

 

Contact Person: kyumars.sheykh_esmaili@nokia-bell-labs.com

 

 

 

Read Full Description
Confirmed a day ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles