EMPLOYMENT TYPE : Permanent
1 x Junior position
5 x Mid-level positions
LOCATION : Cape Town
JOB OVERVIEW :
The successful incumbent will be responsible for sourcing and loading a wide range of data across our business so that it can be used by analysts and developers to develop data solutions to business.
You need to understand and continuously seek techniques to ingest data and ensure a high degree of quality and confidence.
In addition, you should be able to use the technology and seek to make use of the features therein to deliver value to the business.
You will not only design and develop, but also required to coordinate with security and infrastructure as well as investigate issues, troubleshoot technical issues and devise solutions in line with best practice.
You will be responsible for a team of engineers and it will be required that you guide, assist and grow the individuals in that team.
An understanding of data management solutions and a keen sense of the strategic value of information to an organization will be of importance.
DESCRIPTION OF THE POSITION :
Provide technical leadership to the team
Own, plan and manage the workload of the team and ensure delivery
Act as the escalation point for any issue the team is experiencing
Act in technical leadership capacity and design, develop and enhance the ingestion frameworks that can load data consistently with a high degree of confidence
Load large, complex data sets to and make data available for data engineers
Source data from internal and external data sources, engaging with technical subject matter experts
Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various big data’ technologies
Identify, design, and implement internal process improvements : automating manual processes, optimising data delivery, re-designing models for greater scalability
Engage with a wide range of technical stakeholders including data scientists, business analysts, other data engineers and solutions architects
Work with data analysts and data engineers to understand the dynamic nature that is required to support the solution that needs to be built
Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes
Mentor Junior Data Engineers
Design, document and communicate technical solutions that deliver on business requirements.
Fulfil the role of subject matter expert on all technical aspects of BI Solution Development.
Ensure and validate Quality of all BI development / modelling activity incl. code reviews, issue resolution and general support.
Assemble large, complex data sets to meet functional / non-functional business requirements.
Build the infrastructure required for optimal Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using various big data’ technologies.
Resolve critical data modelling issues impacting the functionality of BI products in production.
Help streamline a better data supply chain for advanced analytics that goes from experimentation into production.
Identify, design, and implement internal process improvements : automating manual processes, optimising data delivery, re-designing models for greater scalability.
Develop technical standards and best practices.
Identify opportunities to enhance and automate technical processes and solutions across BI projects and support operations.
Engage with a wide range of technical stakeholders including data scientists, business analysts, and other data engineers as well as solutions architects.
Work with data and analytics experts to strive for greater functionality in our data systems.
Support data stewards to establish and enforce guidelines for data collection, quality improvements, integration and processes.
KNOWLEDGE AND SKILLS :
Strong analytical-thinking and problem-solving abilities
Ability to collect, organize, analyse, and disseminate significant amounts of information
Strong technical and operational ability
Deadline-driven, even in pressurised and fast-paced environments
QUALIFICATIONS REQUIRED :
National Diploma in an Information Technology related discipline or Bachelor’s Degree in Computer Science, Statistics, Informatics, Information Systems or any other quantitative field (preferred)
EXPERIENCE REQUIRED :
1-3 years' experience as a Data Engineer in a BI environment (Junior)
4-7 years' experience as a Data Engineer in a BI environment (Mid-level)
8+ years' experience as a Data Engineer in a BI environment (Senior)
Strong data modelling / engineering background with the ability to interpret business requirements and technical solutions to develop components of, or complete data models
Solid background in SQL, application and information architecture and ETL principles and procedures is required
Ability to comply to and manage data assets under a strict governance framework
Excellent SQL skills and development using SQL and procedural extensions is required.
Experience in ETL toolsets (e.g. SAP Data Services) is required
Strong Data Engineering background with a specific focus on staging high quality data
A solid background in SQL, Information Architecture and ETL procedures is required
Experience in Database technologies (e.g. SAP Hana, Cloudera, Teradata or similar) and Hadoop components including HDFS, Hive, Spark, Oozie and Impala required.
Experience with object-oriented / functional / scripting languages (e.g. Python, Unix Shell scripting, Java, Scala etc.) is required.
Understanding of data warehousing (e.g. Kimball and Vault) and Big Data engineering principles desired.
Experience in agile development desired
Please note : If you have not heard from us within 2 weeks, please consider your application unsuccessful.