Python AI Developer

Designation: Python Developer
Work Experience: 2-5 Years
Educational Qualification: B.Tech/M.Tech/MS
Primary Responsibilities

• Leverage your expertise in Python to design and implement distributed systems for web
  

scraping, ensuring robust data extraction from diverse web sources.

• Develop and optimize scalable, self-healing scraping frameworks, integrated with AI tools for
  

intelligent automation of the data collection process.

• Implement monitoring, logging, and alerting mechanisms to ensure high availability and
  

performance of distributed web scraping systems.

• 
  Work with large-scale NoSQL databases (e.g., MongoDB) to store and query scraped data
  

efficiently.

• Collaborate with cross-functional teams to research and implement innovative AI-driven
  

solutions for data extraction and automation.

• Ensure data integrity and security while interacting with various web sources.
  

Required Skills

• Extensive experience with Python and web frameworks like Flask, FastAPI, or Django.
• Experience with AI tools and machine learning libraries to enhance and automate scraping
  

processes.

• Solid understanding of building and maintaining distributed systems, with hands-on
  

experience in parallel programming (multithreading, asynchronous, multiprocessing).

• Working knowledge of asynchronous queue systems like Redis, Celery, RabbitMQ, etc., to
  

handle distributed scraping tasks.

• Proven experience with web mining, scraping tools (e.g., Scrapy, BeautifulSoup, Selenium),
  

and handling dynamic content.

• Proficiency in working with NoSQL data storage systems like MongoDB, including querying
  

and handling large datasets.

• Knowledge of working with variousfront-end technologies and how various websites are built.