Data Engineering Manager

  • Toronto
  • Confidential

The Toronto hub will serve as the base of our new Data/AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to for organization's vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin the organization's Next-Gen research enablement platform and data products.

This role demands exceptional leadership and technical prowess to drive the development of next-generation research enablement platforms and advanced data products leveraging AI/ML technologies.

  • Provide technical leadership to implement a strategic data foundation roadmap on Azure Databricks, ranging from architectural design to data engineering to feature engineering
  • Architect and implement production level data pipelines, including end-to-end pipeline load performance testing and optimization
  • Resident technical expert in Lakehouse technology and delta lake, data governance, data ingestion and processing, data modeling and warehousing
  • Lead proof of concept use cases, estimating workload sizing, and custom architectures
  • Mentor and train junior data engineers

Minimum Qualifications:

  • 5-10 years experience in a technical role with balanced expertise in both these areas: Data Engineering/Lakehouse - Data Applications Engineering
  • Extensive experience with Azure Databricks for data engineering and ML pipelines
  • Experience maintaining and extending production data systems to evolve with complex needs
  • Experience scaling big data workloads that are performant and cost-effective
  • Experience designing data solutions on cloud infrastructure and services, such as AWS, Azure, or GCP using best practices in cloud security, data privacy and data governance
  • Production programming experience in SQL and Python or Scala
  • Bachelor's or Master’s degree in Computer Science, Information Systems, Engineering
  • Proven leadership skills, a strategic mindset, and a passion for driving innovation in Data Engineering and AI/ML technology
  • Exceptional stakeholder management and communication skills to effectively communicate across global teams.