The Data Engineer is responsible for the transformation of data into a structured format that can be easily analysed in a query or report. The role is responsible for developing structured data sets that can be reused or compliment other data sets and reports. The individual analyses the data sources and data structure and will design and develop data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.Key Roles and Responsibilities:
Create data models in a structured data format to enable analysis thereof
Design and develop scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources, Participate in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
Create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
Accountable for running data migrations across different databases and applications, e.g. MS Dynamics, Oracle, SAP and other ERP systems
Work across multiple IT and business teams to define and implement data table structures and data models based on requirements
