Senior Data Engineer

  • montréal

We are seeking a skilled Senior Data Engineer with a strong emphasis on leadership capabilities to join our DataOps team and play a key role in building and optimizing data pipelines on Google Cloud Platform . In this role, you will play a pivotal part in designing and optimizing data pipelines in Google Cloud Platform while also focusing on architectural design, documentation, and knowledge sharing within the team.

Responsibilities:

  • Design, develop, and maintain data pipelines leveraging Google Cloud products such as Cloud BigQuery, Google Cloud Storage, Cloud Pub/Sub, and Cloud BigTable.
  • Draft architecture diagrams to visualize data flow and system components for effective communication within the team.
  • Develop comprehensive documentation to ensure knowledge transfer and maintain best practices.
  • Implement and uphold data governance frameworks to ensure data quality, security, and compliance.
  • Optimize cloud costs by efficiently managing resources on Google Cloud Platform.
  • Drive innovation by spreading best practices and fostering a culture of continuous improvement within the team.
  • Contribute to the implementation of Data Warehouses or Big Data projects using technologies like Kafka, DataProc, Hadoop, Spark, etc.

Requirements:

  • 3+ years of demonstrated experience in data analytics, deploying distributed data processing systems, and data governance.
  • Proficiency in Python, Go, Java, or other coding languages.
  • Hands-on experience with Google BigQuery including query optimization and large dataset management.
  • Expertise in designing and maintaining robust data pipelines for efficient data flow.
  • Strong background in data warehousing concepts and best practices.
  • Advanced analytics skills for deriving insights from complex datasets.
  • Leadership qualities with a focus on knowledge sharing and fostering a culture of continuous improvement.
  • Cloud certification (e.g., Google Cloud Platform) is preferred.

Additional Skills:

  • Experience in drafting architecture diagrams to visualize system components and data flow.
  • Strong commitment to writing comprehensive documentation for knowledge transfer.
  • Ability to spread best practices and drive innovation within the team.
  • Knowledge of real-time streaming and processing of diverse data sources.