Python Developer Web Crawling

Department Icon IT / Software Development & Related
Posted: 1 year ago
3-7 years
All India
IT / Software Development & Related
Work from Office
Full Time

Posted: 1 year ago
This job's closing date (27 Oct 2025) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
Similar Jobs
Please verify your account first! Send OTP

Job Description

    You are on a mission to create the future of dynamic pricing powered by artificial intelligence and big data. Your Software-as-a-Service products are used globally across various industries - retail, ecommerce, travel, and entertainment. Being a fast growth-oriented startup with an employee strength of 90+ based in a plush office at Navi Mumbai, you aim to become the most customer-oriented company on the planet. To achieve this, you are looking for exceptionally talented, bright, and driven individuals. If you'd like to contribute to building the place to find and buy anything online, this is your chance to make history. Currently, you are seeking a dynamic, organized self-starter to join your Tech Team.

    Role Overview:

    • Develop, maintain, and optimize Python-based web scraping and crawling tools to extract data from various online sources.
    • Design and implement scalable and efficient web scraping architectures and workflows.
    • Work with cross-functional teams to understand data requirements and deliver actionable insights.
    • Handle dynamic and complex websites, including those with anti-scraping mechanisms.
    • Integrate scraped data into databases, data pipelines, or analytical tools.
    • Troubleshoot and resolve issues related to data extraction, including data integrity and performance challenges.
    • Ensure compliance with legal and ethical standards for web scraping and data collection.
    • Create and maintain documentation for web scraping processes and tools.
    • Stay updated on the latest trends and technologies in web scraping, crawling, and data processing.

    Key Responsibilities:

    • Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience).
    • Proven experience in Python development, with a focus on web scraping and crawling.
    • Strong proficiency with Python libraries and frameworks such as BeautifulSoup, Scrapy, Selenium, or requests.
    • Solid understanding of web technologies including HTML, CSS, and JavaScript.
    • Experience with data handling and processing tools (e.g., Pandas, NumPy).
    • Knowledge of database systems (SQL and NoSQL) and data storage solutions.
    • Familiarity with version control systems (e.g. Git).
    • Strong problem-solving skills and attention to detail.
    • Ability to work independently and manage multiple projects simultaneously.

    Preferred Qualifications:

    • Experience with cloud platforms (e.g., AWS, Google Cloud) and containerization technologies (e.g., Docker).
    • Knowledge of API integration and data visualization tools.
    • Understanding of machine learning concepts and their application in data extraction and analysis.

    Please note that the company offers a competitive salary and comprehensive benefits package, opportunities for career growth and professional development, a collaborative and innovative work environment, as well as flexible working hours and remote work options.,

Skills

HtmlPythonJavascriptVersion ControlWeb TechnologiesApiCloudSqlDeveloperHTMLCSSData HandlingPandasSQLNumPyPythonWeb ScrapingNoSQLJavaScriptGitData Extraction

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New IT / Software Development & Related roles in All India.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.