Employee Login | Customer Login | Feedback 

Follow us on       

  Home  >  About Us  >  Open Jobs 
back Back to Jobs

Sr. Software Engineer - Data Pipeline / Hive / Kafka / Big Data

Location: Sunnyvale, CA
Job # 10154311
Date Posted : 11-15-2017
We have the following urgent requirement with our direct client:
Title:  Sr. Software Engineer -  Data Pipeline / Hive / Kafka / Big Data
Location: Sunnyvale, CA
Duration:  6+ months
Compensation:  DOE

  • Candidate will work with the customer backbone Sys-Infra team. 
  • Candidate will be ingesting data from multiple sources and processing it using Big data technologies like HDFS, Couchbase, tomcat, Kafka,  Hive, Unix etc.  Language used for processing is Java and Python.
Candidate Must-Haves
 - Solid foundation with  Java programming along with data processing , REST API , Hadoop ecosystem.
- Experience with data processing / Data pipeline using Kafka messaging
 - Strong development skills around Hadoop, Hive, Pig, Couchbase, HBase, Cassandra, Map Reduce.
 - Worked on a customer facing scalable low latency Web-Service supporting 50K+ requests per day.
 - Strong skills in Object oriented design, core Java, shell scripting.
 - Strong development skills in Python and SQL.
 - Solid foundation in data structures, and algorithms.
 - BS + 6 years, MS + 4 years, PhD + 1 year of work experience in a similar role.
 - Excellent problem solving and analytical skills.
 - Ability to navigate and work through ambiguity.
 Manager’s Preferred Qualifications (3-5 "nice to haves")
 - Proven experience to lead a project team to complete complex projects from start to end.
 - Knowledge and proven experience on SOA, performance/scalability tuning, real time analytics.
 - Prior experience with Retail, eCommerce or SaaS offerings.
 - Good testing practices (unit, integration, system) with automation.
this job portal is powered by CATS