[dipi_breadcrumbs bc_home_icon=”off” bc_schema=”off” _builder_version=”4.17.6″ _module_preset=”default” animation_style=”fade” hover_enabled=”0″ global_colors_info=”{}” bc_separator=”symbol” bc_separator_sysmbol=”/” sticky_enabled=”0″][/dipi_breadcrumbs]

Lead Data Engineer

February 21, 2024

Toronto, ON.

Hybrid.

Make an impact at a global and dynamic investment organization

One of the fastest growing and most respected institutional investors in the world. HQ in Toronto, with multiple offices around the world.

Job Description

We are looking for an experienced Full Stack Data Engineer to join our team for building a next generation data platform built on Data Mesh architecture/principles. The ideal candidate should have extensive hands-on experience of building a big data platform, Big Data Technologies, Data Pipelines, backend development using Python, BI/Analytics tools as well as experience with DevOps, AWS.

 Responsibilities

  • Design, build, and maintain scalable and efficient data platform using data engineering technologies such as Glue, EMR, Athena, Redshift, Lake Formation, Apache Spark, Hive, HDFS and Trino.
  • Build/manage data pipelines, and common data related cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management
  • Build/manage BI/Analytical dashboard reducing time to insight for the business stakeholders.
  • Implement CI/CD pipelines using Terraform, Jenkins, Github actions, Gitflow.
  • Write clean, reusable, and efficient code.
  • Develop and maintain APIs using Python and ensure API security and best practices are implemented.
  • Implement DevOps best practices to ensure efficient application deployment and management.

Qualifications

  • Hands on Experience with data engineering technologies such as AWS Glue, EMR, Athena, Redshift, Lake Formation, Apache Spark, Apache Hive, Apache Airflow
  • Extensive experience of building data pipelines using orchestration tool like Apache Airflow. Hands on experience on building cross cutting concerns like data catalog, data lineage, data quality, data profiling, data discovery, metadata management
  • Proven and extensive experience with Python
  • Experience working with RESTful APIs and JSON. Familiarity with microservices architecture.

+ Competitive salary
+Bonus
+Excellent benefits

Ready to relocate to Canada to continue your tech career?

Please note that this position is located in Canada and will require you to relocate after your work visa is approved. Submit your candidate profile below to be considered. Upon qualification, Path to Canada will work closely with you to match you with your perfect role among all open positions within our network.

SUBMIT YOUR PROFILE TODAY!

Let’s work together to find your next role in Canada

"*" indicates required fields

Step 1 of 7

Candidate Assessment

Let this be the start of a new life for you in Canada. Please complete your profile as accurately and completely as possible to allow us to quickly determine your qualification for our Tech Talent Relocation Program.
Name*
Hidden
Hidden
Hidden
Hidden