Senior Software Engineer, Data Acquisition


Company Type

As a member of the Data Acquisition and Frameworks team, you will help us build out and maintain our real-time data pipeline and supporting infrastructure. You will write software that acts on streams of data and tackle technological and operational challenges to make sure our pipeline is scalable, robust and real-time. You will be leveraging open source data processing technologies and frameworks such as Spark, Kafka and elastic. Additionally, you will research new frameworks, technologies, tools and standards to increase our efficiency, reliability, and ability to innovate as individuals, as a team, and as a company.

The Opportunity

  • Design and implement high-performance, scalable, and reliable streaming and batch data acquisition pipelines
  • Work closely with product and other engineering teams to identify requirements and iterate on solutions
  • Own Quid’s data acquisition and processing pipeline features, from design and proof-of-concept through development into robust, scalable, reliable solutions deployed in production
  • Own Quid’s frameworks, practices and standards for distributed systems, streaming pipelines, batching jobs and other data processing needs
  • Research and advocate for new technologies to add to Quid’s technology stacks
  • Evangelize and facilitate best practices, code reviews, architecture and design reviews, tested code and a great engineering culture

Your Qualifications

  • At least 3 years of professional experience in building large software systems
  • Expert level knowledge in Python, we also use Java, Scala, C++ as needed (any combination of the above is ok)
  • Solid computer science foundation; good understanding of data-structures, memory and runtime complexity
  • Experience with building large-scale distributed systems
  • BS in Computer Science or equivalent
  • Experience with Spark, Kafka or elastic is a plus


Quid builds software that augments human intelligence. We’re defining a new market and pioneering technology that helps strategic thinkers make decisions in a fraction of the time. Quid algorithms reveal patterns in large, unstructured datasets and then generate beautiful, actionable visualizations.


Our mission: We power human intuition with machine intelligence, enabling organizations to make decisions that matter.

Read about what our engineers are working on at Quid and see our product in action:

  • What are diabetes patients really saying?
  • What can banks do to improve customer happiness?
  • What technologies are shaping the future of online video?
  • What should hotels focus on first?

Please note before submitting your application: As a company, we take hiring very seriously. Interviewing with Quid may include video and phone interviews, written projects, and/or onsite interviews. Although we are unable to follow-up with each and every applicant, we do our best to run a thorough process with whom we identify a potential fit. Quid is an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Read Full DescriptionHide Full Description
Confirmed an hour ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles

One Step Register
Need an account? Sign Up