The Data Engineer is passionate about data and technology-based solutions and wants to learn more about them. You'll play an active role throughout the engagement cycle - from architecture and design to implementation, testing, and deployment - by specializing in technical data solutions, including data integration, data transformation and mapping, data organization, data quality and governance, and data preparation and use.
To drive business opportunities, you'll work closely with AI scientists, and software developers to extract the right data, at the right time and in the right format.
Work with business teams to translate functional requirements into technical requirements;
Identify business and functional requirements for projects and provide specifications accordingly;
Evaluate the elements of projects pertaining to your expertise in terms of risks and efforts;
In close collaboration with AI scientists and software developers, design, put into production and maintain scalable data pipelines that can support complex data transformations;
In close collaboration with AI scientists and data labelers, participate in tasks related to data cleaning and labeling;
Collaborate on the definition and implementation of data governance principles and technologies
Develop and share dataset processes for data modeling, mining, and production;
Create and optimize complex queries for large datasets situated on different systems;
Collaborate with diverse teams (Dev, Operations, AI, customer, etc.) to ensure that they capture the right data and that it is of high-quality;
In collaboration with the product teams and AI scientists, participate in building the software architecture to put data pipelines and analytical models into production.
This includes development of workflows and tools that automate data loading processes and help ensure data quality and integrity.
Support stakeholders by resolving data and technical issues and meeting the needs of their data infrastructure;
Support stakeholders in the maintenance of analytical models deployed in production;
Participate in the diffusion of a data culture within Bentley.
You are fascinated by data structures, data models, and data trends; you enjoy manipulating, joining, and associating data sets to create a foundation for analysis.
You possess one of the following :
Technical degree in big data and business intelligence, or a technical degree in artificial intelligence, or;
Bachelor's degree in computer science, software engineering or an equivalent discipline
Experience with the commercial cloud computing platforms such as AWS, Azure and Google
Experience with data storage systems including SQL, NoSQL and hierarchical data standards
Knowledge of distributed computing systems such as Spark and Hadoop based systems
Strong interest / experience in data mining, machine learning, statistical methods, AI, etc.
Motivated and autonomous;
Versatile, fast learner and team player;
Strong presentation, facilitation, oral and written communication and interpersonal skills;
Knowledge of data cataloging tools (strong asset);
Knowledge of Kubernetes and Docker (strong asset);
Experience in a continuous delivery model (strong asset);
Experience in defining and implementing data governance principles (strong asset).