Snr Specialist: Big data Engineering
Vodafone Limited
Johannesburg,South Africa
41d ago

Role purpose :

The Senior specialist Big Data Engineering providesexpert guidance and delivers through self and others to :

  • Load the necessary data from local and group sourcesonto the shared platform that are necessary for analysis and for commercialactions;
  • Building applications that make use of large volumesof data and generate outputs that allow commercial actions that generateincremental value

    Support local markets and group functions inobtaining benefiting business value from the operational data

    Designing and producing highlyperforming and stable applications to perform complex processing of massivevolumes of data in a multi-

    tenancy Hadoop environment.

    Building end-to-end applications thatmake use of large volumes of source data from the operational systems andoutput insights back to business systems.

    Building real-time data processingapplications which are integrated with business systems to enable value fromanalytic models to drive rapid decision making.

    Working with the architecture team todefine the strategy for evolving the Big Data capability

    Defining the technology components tobe used on the Big Data Platform and investigating new technologies to identifywhere they can bring benefits.

    Defining best practice for the agiledevelopment of applications to run on the Big Data Platform.

    Managing complex stakeholderrelationships

    3 year IT or IS degreeor diploma

    5 8 years BI orrelated experience

  • Expert levelexperience with using Spark, Yarn, Hive and Oozie;
  • Strong Python andScala programming ability;
  • Working knowledge ofHBase, Solr, Kafka and Flume

    Some experience withother distributed technologies such as Cassandra, ElasticSeatch and Flink wouldalso be desirable.

  • Expertlevel experience in designing, building and managing applications to processlarge amounts of data in a Hadoop ecosystem;
  • Extensiveexperience with performance tuning applications on Hadoop and configuringHadoop systems to maximise performance;
  • Experiencebuilding systems to perform real-time data processing using Spark Streaming orStorm;
  • Experiencewith managing the development life-cycle for agile software developmentprojects;
  • Experience working in a multi tenancyHadoop environment

    Add to favorites
    Remove from favorites
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form