Python Developer - Web Scraping

Web Scraper / Python Developer

Location : Pune | Work From Office

Experience : 2-5 Years

Working Days : Monday to Friday

Shift : EST - 6 : 00 PM to 3 : 00 AM IST

Employment Type : Full-Time

About the Role :

We are looking for a skilled and hands-on Web Scraper / Python Developer to join our technology team. The ideal candidate will have strong experience in Python development, web scraping, data engineering, automation, API integrations, and B2B data intelligence. You will be responsible for building scalable data collection and processing systems that power research, lead intelligence, enrichment, validation, and automation workflows.

What You'll Do :

• Develop and maintain scalable Python-based web scraping solutions.

• Build scraping pipelines using Scrapy, BeautifulSoup, Requests, Playwright, and/or Selenium.

• Handle modern, JavaScript/AJAX-driven websites, pagination, infinite scroll, sessions, cookies, DOM, XPath, and CSS selectors.

• Develop high-performance scripts using asynchronous and concurrent programming.

• Build ETL pipelines for data extraction, cleaning, transformation, normalization, and processing.

• Work with large volumes of B2B data for company research, contact discovery, persona identification, ICP filtering, and enrichment.

• Develop email validation and data-quality workflows, including deduplication, domain/MX validation, and bounce/suppression handling.

• Integrate REST APIs, webhooks, JSON, OAuth, and third-party services.

• Build automated workflows using Cron, Celery, task queues, schedulers, and retry mechanisms.

• Integrate approved outreach/email platforms and CRM/marketing systems through APIs.

• Work with AI/LLM APIs for research, classification, enrichment, entity extraction, and automation.

• Implement data-quality controls, validation, confidence scoring, monitoring, and auditability.

• Work with databases such as PostgreSQL/MySQL, with MongoDB/Redis exposure being an advantage.

• Use Git, Linux, Docker, AWS/Azure, and related development/deployment tools.

• Troubleshoot, optimize, and continuously improve scraping and data-processing pipelines.

Tech Stack :

• Python, Scrapy, BeautifulSoup, Requests, Playwright, Selenium, Pandas, PostgreSQL, MySQL, REST APIs, Git, Linux, Docker, AWS/Azure.

Compliance & Responsible Data Collection :

• Responsible data collection is an important part of this role. Candidates should have an understanding of and experience working within applicable website terms, privacy/data-protection requirements, access controls, and email/anti-spam requirements.

Why This Role? :

• Work on real-world, production-level scraping and data engineering challenges.

• Opportunity to work across Python, automation, APIs, databases, AI/LLMs, and data intelligence.

• Build scalable systems used for B2B research, lead intelligence, enrichment, and automation.

• Work in a technically challenging environment with opportunities to expand your engineering skill set.