Senior Cloud Data Platform Engineer

Questrade

What’s in it for you as an employee of QFG?

  • Health & wellbeing resources and programs 
  • Paid vacation, personal, and sick days for work-life balance
  • Competitive compensation and benefits packages
  • Work-life balance 
  • Career growth and development opportunities
  • Opportunities to contribute to community causes
  • Work with diverse team members in an inclusive and collaborative environment

We’re looking for our next Senior Cloud Data Platform Engineer. Could It Be You?

The Questrade Technology Group (QTG) is home to a unique environment, where our culture thrives and most importantly, we get stuff done! Questrade is continuing with its digital transformation initiative and our infrastructure footprint is growing beyond our data centres and into the Google Cloud Platform. We are currently working towards our exciting strategy that is driven by business value. Join us and help solve some complex challenges such as handling low latency and high traffic market data, event streams and messaging, in a hybrid cloud environment within an industry that has so much room for disruption.

The Cloud Data Platform Engineer will work with a primary focus on delivering Questrade’s Data Platform footprint, as an expansion of our cloud presence, enabling key initiatives such as our Digital Banking. This role will be working with several teams in the organization in a collaborative manner, helping deliver data related components that enable productivity across QTG by leveraging automation to deliver self-service components as much as possible. This key individual will be part of a team that drives the implementation of data components such as pipelines, applications, sanitation, supporting our data scientists and working with the rest of the product teams while collaborating with the architecture team, influencing the design and delivery of our data footprint and striving for greater functionality in our data systems.

Need more details? Keep reading…

Our Cloud Data Platform Engineer needs to be able to gather and understand engineering requirements, provide a solution, and work in the team to achieve high quality features. This Engineer will need a passion for complex problems, and enjoy the challenge of operating complex and mission critical systems under extreme loads. Do you think you are up to the challenge? Would you like to learn more and stretch your skills and career?

In this role, you will be a technical expert with significant scope and impact. You will work closely with a group of Software Engineers, Product Managers, Data Scientists, and Data Engineers to create the data infrastructure and pipelines necessary to drive Questrade’s initiatives.

Successful candidates should come from a strong data engineering background. You need to have experience with structured and unstructured data, and being able to analyze/transform the data using various tools. You need to have experience in Cloud Services, Terraform and CI/CD Pipelines. Often, the pace of innovation and change implies a need to set up connections to new data sources, and our Data Platform Engineers get to participate in deep diving business use cases in order to provide automated solutions. Your analytical skills and knowledge of schema metadata will be essential.

In this role, responsibilities include but are not limited to: 

  • Create and maintain optimal data pipeline architecture.
  • Design and create new features and automated solutions that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes,implementing data governance rules, re-designing infrastructure for greater scalability, etc.
  • In Depth understanding of Data Protection and Network security rules set up on Cloud Infrastructure.
  • Expand and increase data platform capabilities to resolve new data problems and challenges by identifying, sourcing, and integrating new features
  • Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
  • Peer review code and promote dev ops culture within the data teams.
  • Have a good understanding of data platform best practices to achieve economies of scale, cost reduction and efficiencies.
  • Monitor and anticipate trends in data engineering, and propose changes in alignment with organizational goals and needs.
  • Explore AI integrations into Data Engineering Development Cycle

So are YOU our next Senior Cloud Data Platform Engineer? You are if you…

  • Minimum 3+ years of experience working in the data engineering field.
  • Proficiency in SQL language.
  • Strong knowledge of Python language.
  • Experience with any of the popular Clouds (GCP, AWS, Azure).
  • Experience with CI/CD pipeline tooling and development.
  • Good knowledge in Message Broker systems (e.g., Kafka, PubSub).
  • Experience with ML Model Training using Google Vertex AI.
  • Data modeling skills.
  • Good knowledge of popular data standards and formats (e.g, JSON, XML, Proto, Parquet, Avro, ORC, etc)
  • Experience in building Terraform scripts will be preferred.
  • Good Knowledge of Airflow Operators and Airflow DAG Configuration
  • Experience in the financial industry is an asset. 
  • Google GCP data platform (Dataflow, Dataproc, Cloud Composer, BigQuery, CloudSQL) knowledge and experience is an asset, or knowledge of the equivalent open source toolset behind those products.

Sounds like you? Click below to apply!

#LI-JW1 #LI-Remote

Read Full Description
Confirmed 13 hours ago. Posted 30+ days ago.

Discover Similar Jobs

Suggested Articles