Big Data Developer- Hyderabad/ Bangalore (3-5 Years Of Experience)

4.20 Lakhs to 8.50 Lakhs 3.0 years Bengaluru , Hyderabad

Hadoop , Hive , Java , Mapreduce , Nosql , Pig , Spark , Sparql


Job Description and Responsibilities

Job Description and Responsibilities:

Participate in all aspects of Big Data solution delivery life cycle including analysis,design, development, testing, production deployment, and support.

Develop standardized practices for delivering new products and capabilities using BigData technologies, including data acquisition, transformation, and analysis.

Define and develop client specific best practices around data management within a Hadoop environment.

Recommend design alternatives for data ingestion, processing and provisioning layers

Design and develop data ingestion programs to process large data sets in Batch mode using HIVE, Pig and Sqoop technologies

Develop data ingestion programs to ingest realtime data from LIVE sources using Apache Kafka, Spark Streaming and related technologies

Experience Required:

1+ years of hands-on experience using Hadoop (preferably Hadoop 2 with YARN), MapReduce, Pig, Hive,Sqoop, and HBase

Strong understanding of Hadoop ecosystem including setting up Hadoop cluster with knowledge on cluster sizing,monitoring, storage design and encryption at rest and motion.

Experience in scheduling Hadoop jobs using oozie workflow and Falcon

Proven experience in implementing Security in Hadoop ecosystem using Kerberos, Sentry, Knox and Ranger.

2+ years of strong experience in object-oriented programming through JAVA, including optimizing memory usage and JVM configuration in distributed programming environments

Worked on developing REST API's using standard frameworks

Exposure to Hadoop's distributed column-oriented database like HBase.

Strong UNIX operating system concepts and shell scripting knowledge

Production Experience in Apache Spark using SparkSQL and Spark Streaming or Apache Storm

Exposure to different NoSQL databases within Hadoop ecosystem

College Preference

Does Not Matter

Minimum Qualification

Under Graduate


4.20 Lakhs to 8.50 Lakhs

Skills hiring for

Hadoop , Hive , Java , Mapreduce , Nosql , Pig , Spark , Sparql

Locations hiring at

Bengaluru , Hyderabad


Recommended Jobs

Data Science Consultant – Real World Evidence - Gurgaon/Pune (2 to 4 Years of Experience)

15 Lakhs to 25 Lakhs

Gurugram, Pune

Hadoop , Java , Machine Learning , Python , R , Real World Evidence (Rwe)

AWS/ Cloud Engineer - Pune/Kolkata (3 to 7 years of Experience)

5 Lakhs to 8 Lakhs

Calcutta, Pune

Aws , Data Mining , Java , Machine Learning , Nlp , Nosql , Python

NLP Engineer - Pune/Kolkata (3-8 Years of Experience)

7 Lakhs to 12 Lakhs

Calcutta, Pune

Algorithms , Java , Machine Learning , Nlp , Python

Data Science Consultant- Text Mining - Gurgaon/Pune (3 to 7 years of Experience)

1 Lakhs to 1.50 Lakhs

Gurugram, Pune

Java , Marketing Analytics , Nlp , Python , R , Text Mining