Data Engineer
Application Period: Nov. 1, 2024 - Nov. 30, 2024
Contact: jean-olivier.pitre@mcgill.ca
Data Engineer
Looking for ways to get involved with McGill University? The DataSphere Lab at McGill University is seeking a talented Data Engineer to join our team for an exciting project with a leading aviation industry client. You'll be part of a dynamic team, working on developing a platform to manage product-related documents and business processes, leveraging AI and machine learning to drive efficiency and insights.
Job Requirements:
-
Needs to be currently registered as a student at McGill University.
-
Highly self-motivated and able to work independently.
-
Strong communication skills required.
-
Enjoy collaborating in virtual settings (online).
-
Passionate about tech.
-
Experience in software development, computer science & data science is a must.
-
Exposure to cloud computing & version control (git) is a huge asset.
Responsibilities:
-
Implement data pipelines & data solutions using Azure services such as Azure Data Factory, Azure Databricks & Azure Synapse.
-
Implement and manage data storage solutions with Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
-
Develop ETL workflows to extract data from various sources (on-premises, cloud, APIs) and transform it into usable formats.
-
Use Python for data transformation, cleansing, and enrichment.
-
Work with Github & Github Actions for CI/CD pipeline integration and version control.
-
Automate data workflows and processes using PowerShell and Azure Automation.
-
Develop and maintain data models and schemas using SQL and T-SQL.
-
Implement data security and compliance measures with Azure Key Vault and Microsoft Entra.
-
Implement Azure Api Management to simplify the complexity of our backend systems.
-
Implement error handling, logging, and monitoring to Azure Monitoring and Azure Sentinel.
-
Document processes and create guides for internal use.
Paid Position:Yes, $20-$30/hour for 5-10 hours/week
To apply
Email Jean-Olivier Pitre (jean-olivier.pitre@mcgill.ca) directly, including a CV and the details of the position you are interested in.