Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
D. E. Shaw India
Senior Member, Data Engineer (Data Extraction)
D. E. Shaw India
Hyderabad•On-site•3-5 Yrs•15 hours ago
Job description
Data EngineerWeb RobotsData ExtractionAutomationData Pipeline
Overview
Senior Data Engineer role within product development teams based in Hyderabad, Bengaluru, and Gurugram. The role involves developing Web Robots or Web Spiders that crawl the web and retrieve data in various formats (HTML, PDF, Excel etc.), scraping website data into structured formats, building automated reports, and working on end-to-end data pipelines.
Responsibilities
- Develop Web Robots or Web Spiders that crawl through the web.
- Retrieve data in HTML, plain text, PDFs, Excel, and any other format (structured or unstructured).
- Scrape website data into structured formats.
- Build automated and custom reports on downloaded data.
- Work on automating end-to-end data pipelines.