Big Data Lead Engineer

Responsibilities

Responsible for design, prototyping and delivery of software solutions within the big data eco-system.
Responsible for technical ecosystem (software, data, interfaces, integration) and strategic roadmaps
Responsible for performance tuning and scalability improvements of distributed applications
Responsible for designing and building new Big Data systems for analysing data into actionable insights
Responsible for development of advanced analytics solutions and integrating new tools to improve descriptive, predictive and prescriptive analytics

Qualifications

5-6 years Big Data experience with hands on coding and development experience in Java, Scala and Python.

Big Data experience with Cloudera/Hortonworks, and or EMR

Development experience with Spark

Experience with Kafka, flink, Spark streaming, and or Nifi/StreamSets

Experience developing large-scale distributed applications

Experience with Git, GitHub, Jenkins, Artifactory