Skip to content

JobNet: Jobs for Technical People


San Francisco, California - USD Full Time Posted: Friday, 8 November 2019
Job Requirement
  • Improve big data pipeline efficiencies and perform performance tuning for user queries, complex query plan analysis, configuration settings, optimization, using technologies like Spark, MapReduce, Hive.
  • Involve in maintaining and enhancing our performance monitoring and analysis tools/frameworks, workflow and data compute and execution engines, etc
  • Actively monitor production using various internal tool as related to user experiences in query engines, and track performance profiles over time and investigate changes therein
  • Proactively analyze performance metrics and logs to identify inefficiencies and opportunities to improve for scalability and performance
  • Actively engage our internal users, who are our customers, to analyze their respective use cases to address scale and performance demands
  • Provide thought leadership and helpful feedbacks to the rest of data team in our processes, support models, performance monitoring, analysis metrics, frameworks and tools from internal users perspective so as to improve their experiences and productivities.
  • 5+ years of experience on open-source Big Data technologies
  • Background in database internals or large scale data processing systems (like Hadoop, Hive, Presto, Spark) especially query processing and/or optimization;
  • Strong debugging skills in Linux environment for performance issues
  • Experience in troubleshooting big data technology issues in processing of petabytes of data
  • Experience in deploying and maintaining distributed systems.
  • Experience in using big data storage technologies and their applications (HDFS, Columnar Storage format, Hive, Spark, Presto, etc.)
  • Proficiency in multiple systems languages (Java, Scala, Python)
For this role specifically, we are expecting to have someone who is expert level either with Spark and Scala or Hadoop and MapReduce.

San Francisco, California, United States of America
Intellipro Group Inc.
Intellipro Group Inc.
11/8/2019 11:03:43 AM

We strongly recommend that you should never provide your bank account details to an advertiser during the job application process. Should you receive a request of this nature please contact support giving the advertiser's name and job reference.

Other jobs like this

San Jose, California
San Jose, California
San Jose, California
Mountain View, California
San Jose, California