IBM

Introduction

At IBM Software, we transform client challenges into solutions. Building the world’s leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You’ll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM’s product and technology landscape. Here, you’ll have the tools and opportunities to advance your career while creating software that changes the world.

Your role and responsibilities

About the Role

The Stream Processing & Analytics (SPA) team is building an elastic, reliable, durable, cost effective, and performant stream processing engine for Confluent Cloud based on Apache Flink®. Stream processing is at the heart of innovations that unlock the next generation of use cases for Confluent Cloud.

As a Senior Software Developer on the FlinkSQL team, you will help build and evolve the SQL engine at the core of Confluent Cloud for Apache Flink® — the layer that makes stream processing feel as simple as using a database. You will work on the SQL planner and optimizer, SQL semantics and runtime operators, the catalog and metadata integration with Apache Kafka ® and Schema Registry, and the Table API, so that customers can express powerful streaming and batch workloads in SQL without worrying about the underlying infrastructure.

You will collaborate closely with other teams (for example, the Flink runtime and control-plane teams), but your primary focus will be on the SQL layer itself: usability, performance, and operability of Flink SQL on Confluent Cloud.

This role is based in Europe, where most of the FlinkSQL team is located. You will work daily with teammates across Europe and with partner teams in North America.

You will have the opportunity to collaborate closely with the Apache Flink Open Source community.

What You Will Do

Implement and improve features in the Flink SQL engine:

• Contribute to the SQL parser, logical planner, and optimizer (based on Apache Calcite), including new SQL syntax, built-in functions, and planner rules.
• Improve the correctness and performance of streaming SQL operators (for example, joins, aggregations, and changelog processing) as seen from the SQL layer.

Make Flink SQL a great experience on Confluent Cloud:

• Work on the integration between SQL and the Confluent ecosystem: how tables map to Kafka topics, Schema Registry schemas, data types, and formats (Avro, Protobuf, JSON).
• Contribute to features across the SQL surface, such as user-defined functions (UDFs), the Table API, and standard metadata interfaces like INFORMATION_SCHEMA.

Improve reliability and correctness of the SQL engine:

• Deliver well-scoped improvements independently and with high quality, from clarifying requirements through implementation, testing, and rollout — with guidance from senior engineers on larger designs.
• Investigate and fix planner and semantic bugs, and extend our semantic test coverage so customer queries behave predictably.

Strengthen observability and operational excellence:

• Add and refine metrics, structured logging, and dashboards that make SQL statements easier to understand and debug for customers and on-call engineers.
• Participate in the team's on-call rotation, supported by tested runbooks and processes, and contribute to incident follow-ups.
• Operate what you build in production.

Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise

Experience and fundamentals:

• 2-3+ years of industry experience building backend services, data infrastructure, or distributed systems.
• Strong computer science fundamentals, including data structures, algorithms, and a solid understanding of concurrency and distributed systems basics.
• Proficiency in Java (preferred for this role) or another JVM language (for example, Scala), with the ability to contribute to a large, existing codebase.

SQL and data processing:

• A solid understanding of SQL and relational concepts, and genuine interest in how query engines work (parsing, planning, optimization, execution).
• Familiarity with data processing systems such as databases, query engines, or stream processors — through work experience, open source, or advanced coursework/projects.

Cloud and operations:

• Experience running or operating services on at least one major public cloud (AWS, GCP, or Azure); exposure to Kubernetes-based environments is a plus.
• Willingness to own your code in production, including metrics, dashboards, alerts, and on-call participation.

Ways of working:

• Ability to deliver well-scoped features end-to-end with high quality: clarify requirements, implement, test, and roll out safely, seeking input from senior engineers where needed.
• Clear, pragmatic communication and constructive participation in design discussions and code reviews.
• High bar for code quality and testing, and a willingness to iterate based on feedback.

Preferred technical and professional experience

• Experience with Apache Flink SQL or the Table API, or with another SQL engine or large-scale data processing system (for example, Spark SQL, Trino, or a database engine).
• Familiarity with query planners and optimizers, or compiler construction (Apache Calcite is a plus).
• Understanding of streaming semantics such as event time, watermarks, and CDC handling.
• Experience with Apache Kafka, Schema Registry, or serialization formats like Avro and Protobuf.
• Contributions to open-source projects in streaming, databases, or distributed systems, ideally including Flink or related components.

ABOUT BUSINESS UNIT

IBM Software infuses core business operations with intelligence—from machine learning to generative AI—to help make organizations more responsive, productive, and resilient. IBM Software helps clients put AI into action now to create real value with trust, speed, and confidence across digital labor, IT automation, application modernization, security, and sustainability. Critical to this is the ability to make use of all data, because AI is only as good as the data that fuels it. In most organizations data is spread across multiple clouds, on premises, in private datacenters, and at the edge. IBM’s AI and data platform scales and accelerates the impact of AI with trusted data, and provides leading capabilities to train, tune and deploy AI across business. IBM’s hybrid cloud platform is one of the most comprehensive and consistent approach to development, security, and operations across hybrid environments—a flexible foundation for leveraging data, wherever it resides, to extend AI deep into a business.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

For additional information about location requirements, please discuss with the recruiter following submission of your application.

Read Full Description