16 Oct
Draup
Bengaluru
Designation : Sr. Python Developer
Work Experience :4-6 Years
Educational Qualification : B.Tech/M.Tech/MS
Primary Responsibilities :
- Leverage your expertise in Python to design and implement distributed systems for web scraping, ensuring robust data extraction from diverse web sources.
- Develop and optimize scalable, self-healing scraping frameworks, integrated with AI tools for intelligent automation of the data collection process.
- Implement monitoring, logging, and alerting mechanisms to ensure high availability and performance of distributed web scraping systems.
- Work with large-scale NoSQL databases (e.g., MongoDB) to store and query scraped data efficiently.
- Collaborate with cross-functional teams to research and implement innovative AI-driven solutions for data extraction and automation.
- Ensure data integrity and security while interacting with various web sources.
Required Skills :
- Extensive experience with Python and web frameworks like Flask, FastAPI, or Django.
- Experience with AI tools and machine learning libraries to enhance and automate scraping processes.
- Solid understanding of building and maintaining distributed systems, with hands-on experience in parallel programming (multithreading, asynchronous, multiprocessing).
- Working knowledge of asynchronous queue systems like Redis, Celery, RabbitMQ, etc., to handle distributed scraping tasks.
- Proven experience with web mining, scraping tools (e.g., Scrapy, BeautifulSoup, Selenium), and handling dynamic content.
- Proficiency in working with NoSQL data storage systems like MongoDB,
including querying and handling large datasets.
- Knowledge of working with various front-end technologies and how various websites are built.
(ref:hirist.tech)
▶️ Draup - Senior Python Developer - Flask/Django Frameworks
🖊️ Draup
📍 Bengaluru