Data Engineer(Cloud)CAPE TOWN Salary Negotiable 12 month contract Job
The Cloud Data Engineer will be involved in design and development of the Cloud environment, processes, programs, and scripts.
The data engineer would need Kafka and Cassandra experience with previous experience with CI / CD.This individual must enjoy working on a high-
intensity, fast-paced team but can be a strong individual contributor as well.
You use your excellent written and verbal communication skills to help your team achieve its goals.
You are a motivated professional with a passion for technology that wants to work for a leading edge enterprise.
As a key member of the Cloud Platform Development Team you will be responsible for designing and developing major database components of our next generation cloud platform.
Build highly scalable data abstractions and infrastructureDesign large graph infrastructure and query / search interfacesCollect and process data streams at scale (including stream-
processing and batch ETL)Work closely with engineering teams to help build and maintain systems that support advanced analyticsWork with platform architects on software and system optimizations, helping to identify and remove potential performance bottlenecksStay up to date on relevant technologies, plug into user groups, understand trends and opportunities that ensure we are using the best techniques and toolsThe ideal candidate has strong data system development experience and has worked with cloud deployment models and test-
driven development in a fast-paced agile environment.Experience in creating architecture, building and maintaining (commercial or open source) software platforms and large-
scale data infrastructuresA strong team player, able to quickly triage and troubleshoot complex problemsExperience with cloud resource platforms such as Amazon AWS, Microsoft AzureExperience building big data solutions using technologies such as Cassandra and KafkaStrong knowledge of data technologies including SQL, Map / ReduceFamiliar operating in UNIX / Linux environments Skills Category : Proven understanding and experience with KafkaProven understanding and experience with CassandraKnowledge of workflow / schedulersGood aptitude in multi-
threading and concurrency conceptsUnderstanding of metadata conceptsHigh-speed queryingAgile1 -3 years Data Engineering SkillsKnowledge in programming, specifically R, python, java, JS, Node.