.. are automatically transferred to your bank account every week. You are your own boss: You decide how much or little you want to drive and earn. Grab your car, bike, or by foot and deliver with Uber whenever you want—for an hour, a weekend, or throughout the week. Signing up only takes a few minutes: .. read more
Fx Innovation vous offre une belle opportunité pour un i ngénieur de données-Intermédiaire
Faites partie d'un projet innovateur! au sein de l'équipe plateforme de données, vous allez participer à une variété de projets intéressants!
On cherche un candidat billingue!
- Bilingual (French & English) with excellent verbal and written communication skills
Our Partner in the finance sector wants to hire one data engineer azure data lake specialist .
This consultant is going to be part of the Data platform team to help in multiple projects to transform data and serve multiple needs.
The bulk of the work will be in data exploration, data ingestion, data transformation, data preparation, designing, building, and developing pipelines consolidating streaming and batch data sources into the Enterprise Data Lake. The engineer will also participate in the elaboration of a validation tool for the quality of data in the data lake.
Duration : 12 month
Possibility of renewal : Yes
Possibility to convert to a permanent position : Yes
Responsibilities / Accountabilities:
- Use of Databricks for transformation and loading of the data in the different layers
- Use of Spark/Python for the development of the libraries
- Use of Azure DevOps pipelines to automate the CI/CD
- Participate in the development of the dataset and incorporate new sources from the data lake
- Develop best practices on the data quality validation
Requirements:
Professional Experience
- 4 years in the development in spark/python
- 4 years on databricks
- 2 years on Azure DevOps
- 1 year Powershell
- Experience on azure data lake
- Experience on data factory
Soft Skills
- Strong interpersonal, teamwork, coordination and consensus building skills
- Strong communication, documentation, storytelling, creativity, and presentation skills
- Strong organizational skills, the ability to perform under pressure and to manage multiple priorities with competing demands
- Bilingual (French & English) with excellent verbal and written communication skills