Data Crawling Engineer - Pune/Kolkata (4 to 6 Years of Experience)

8 Lakhs to 8.50 Lakhs 4.0 years Pune


Job Description and Responsibilities


1.Deep knowledge of the relevant Internet protocols such as HTTP, DNS, and familiarity with the web authoring standards such as HTML, CSS as well as de-facto data encoding, markup, and representations like JSON, XML etc. 

2.Extensive knowledge of and experience with crawling web pages and building systems to do so. 

3.Extensive knowledge of and experience with working with Web APIs, in particular, REST services and JSON-encoded responses 

4.Experience with building systems at Internet scales, that scale to terabytes or more of data, millions of API calls, and thousands of requests/second 

5.Experience with data extraction, scraping/parsing/processing semi-structured data, ETL toolsets, and mechanisms

6.Experience building robust, fault-tolerant, scalable and cost-effective distributed systems 

7.Experience with Amazon Web Services or other Cloud platforms 

Skillsets Required-

4-6 years of experience in a related occupation that provided the required skills and abilities.


Individuals must have demonstrable proficiency, knowledge and experience with the following specific areas:

Machine-learning, text-mining, Java, Python or natural language processing techniques. 

Computational linguistics for artificial intelligence. 

Lexical analysis design and implementation.

College Preference

Tier 1 : Entire Education

Minimum Qualification

No Restriction


8 Lakhs to 8.50 Lakhs

Skills hiring for

Locations hiring at



Recommended Jobs

Data Science Consultant – Real World Evidence - Gurgaon/Pune (2 to 4 Years of Experience)

15 Lakhs to 25 Lakhs

Gurugram, Pune

Hadoop , Java , Machine Learning , Python , R , Real World Evidence (Rwe)

AWS/ Cloud Engineer - Pune/Kolkata (3 to 7 years of Experience)

5 Lakhs to 8 Lakhs

Calcutta, Pune

Aws , Data Mining , Java , Machine Learning , Nlp , Nosql , Python

NLP Engineer - Pune/Kolkata (3-8 Years of Experience)

7 Lakhs to 12 Lakhs

Calcutta, Pune

Algorithms , Java , Machine Learning , Nlp , Python

Data Science Consultant- Text Mining - Gurgaon/Pune (3 to 7 years of Experience)

1 Lakhs to 1.50 Lakhs

Gurugram, Pune

Java , Marketing Analytics , Nlp , Python , R , Text Mining