Data Engineer II – Cape Town – R500k to R750k PA
CapeTown, South Africa
5d ago
source : Job Placements

Data Engineer sought for top tier FMCG client based in Cape Town!

This role functions as a core member of an agile team. The Data Engineer helps to facilitate gathering data from a variety of different sources, in the correct format, assuring that it conforms to data quality standards and assuring that downstream users can get to that data timeously.

Requirements :

  • Open to Permanent Residents
  • IT Degree / Diploma 3 years
  • AWS Certification at least to associate level
  • Skills and Duties :

  • Retail Operations 3-5 years
  • Business Intelligence 3-5 years
  • Big Data 1+ years
  • Extract Transform and Load (ETL) processes 3-5 years
  • Could AWS 1+ years
  • Agile exposure, Kanban or Scrum 2+ years
  • Talend 1 year
  • AWS : EMR, EC2, S3 1 year
  • Python 1 year
  • PySpark or Spark 1 year
  • Business Intelligence Data modelling 3 years
  • SQL 3 years
  • Design and develop data feeds from an on-premises environment into a datalake environment in an AWS cloud environment
  • Design and develop programmatic transformations of the solution, by correctly partitioning, formatting and validating the data quality.
  • Design and develop programmatic transformation, combinations and calculations to populate complex datamarts based on feed from the datalake
  • Provide operational support to datamart datafeeds and datamarts
  • Design infrastructure required to develop and operate datalake data feeds.
  • Design infrastructure required to develop and operate datamarts, their user interfaces and the feeds required to populate the datalake
  • Reference Number for this position is NN51638. This is a Permanent position based in Cape Town, Brackenfell offering a cost to company salary of R500k to R750k

    Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form