About the job
Key Responsibilities: Maintain and enhance web scraping and data crawling projects using Python-based tools and frameworks. Develop and refine crawlers to handle dynamic content, clean and validate extracted data, and integrate it into downstream storage systems. Implement solutions for anti-bot measures, optimize crawling efficiency, and ensure compliance with web crawling best practices.
Requirements
- Python
- Web Scraping
- Data Crawling
Preferred Technologies
- Python
- Web Scraping
- Data Crawling
Similar Jobs
Data Engineer
EY
Hyderabad•Not disclosed
Last week•On-Site
Data Engineer
Tata Consultancy Services
India•Not disclosed
3 weeks ago•On-Site
Data Engineer
EXL
Chennai•Not disclosed
Last Month•On-Site