Senior Web Scraper | BeautifulSoup or Scrapy
Prefer a full account with a password? Sign Up to Apply
Job Description
As a Python Developer within the scraping team, you will be among our talented and passionate team helping us optimize data collection!
• Design, implement, and document robust Scrapy spiders, ensuring resilience against future website changes while maintaining existing ones.
• Conduct comprehensive code review and data validation to maintain the highest standards of code and data quality.
• Leverage in-depth knowledge of the HTTP protocol, the mechanisms of modern web browsers, and our own internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot countermeasures.
• Architect and contribute to significant new developments across multiple codebases, providing clear technical documentation and conducting training sessions for relevant teams when necessary.
Requirements
Function: General Business
Experience Level: Mid-Senior Level