Software Engineer - Spark Runtime


Databricks was founded by the team who created Apache® Spark™, a powerful open source data processing engine built for sophisticated analytics, ease of use, and speed. Databricks is the largest contributor to the open source Apache Spark project providing 10x more code than any other company. Our mission is to make big data simple, building the tools and technologies that allow everyone to gain deep insights and extract values from real-world data. Your team is will consist of 4-8 engineers who work as a Scrum development team running two-week sprints. You will join one of our teams focused on building parts of the Databrick Runtime, such as: Serverless Spark, Structured Streaming, Cluster Management, Spark SQL and more.

As an engineer at Databricks you are responsible for developing the future of Internet-scale distributed production pipelines. You will be empowered to take a customer-first approach to solving problems. Our users range from small companies doing periodic analysis to Fortune 500 companies creating just-in-time data warehouses to do real-time machine learning and artificial intelligence on web-scale data. Your team designs, plans, implements and maintains the platform they build upon. This demands a high degree of critical thinking, customer focused design, and problem solving. We are looking for engineers who will bring revolutionary ideas to an area that is largely silo'ed to data engineering, data science, and machine learning teams in large organizations. You will help us change that, freeing everyone to analyze and extract value from their data.

Excellent problem analysis and solving skills.
Excellent communication and teamwork.
Strong foundation in algorithms and data structures and their real-world use cases.
Solid understanding of computer systems and networks.
Production quality coding standards and patterns.
Passion for developing amazing customer experiences.
4+ years of general software programming experience.
BS in Computer Science, Math, related technical field or equivalent practical experience.
4+ years of modern, production level experience in one of: Java, Scala, JavaScript, or C++.
Experience with: Large scale distributed computing, Database internals, Big Data engines e.g. Spark, Hadoop

Medical, dental, vision
401k Retirement Plan
Unlimited Paid Time Off
Catered lunch (every day), snacks, and drinks
Gym reimbursement
Employee referral bonus program
Awesome coworkers
Read Full DescriptionHide Full Description
Confirmed 20 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles

One Step Register
Need an account? Sign Up