Our client is seeking a Data Engineer to join a dynamic team that will be responsible for a variety of Big Data solutions. You will help design, implement and support full end to end BI and Data solutions working closely with stakeholders within both the IT and business functions.
Design and implement Dataflows and Datamarts on a Hadoop platform
Troubleshoot issues with existing Dataflows and Datamarts on the Hadoop platform
Design, create and maintain Data Integration Tasks on an Attunity Replicate Server
Automate tasks on Hadoop platform and Attunity Replicate Server
Maintain PowerShell automation scripts on Attunity Replicate Server
Troubleshoot and support Business Users using Hive and Impala on the Hadoop platform.
Liaise with third-party or in-house service providers to monitor progress and highlight any issues.
Plan and manage systems tests.
REQUIRED SKILLS AND EXPERIENCE
2+ years' experience as a Big Data Engineer using Hadoop.
Strong Data Integration, ETL and Data Modelling experience
Good level of proficiency with SQL
A proven track record of developing Big Data solutions
Experience of working in financial services
Experience in solution design
Knowledge of Hive, Impala and HUE