Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs
Job Description
- As a Python Developer & Web Crawling professional at Global Checks Pvt Ltd, you will collaborate with cross-functional teams to define, design, and implement new features. Your role will involve ensuring the performance, quality, and responsiveness of web crawling systems. You will be responsible for identifying and correcting bottlenecks, fixing bugs in web crawling processes, and helping maintain code quality, organization, and automation. It is essential to stay up-to-date with the latest industry trends and technologies.
With 3+ years of experience in Web Scraping or Crawling through frameworks like Scrapy, Selenium, or other related libraries, you should be an expert in the latest version of Python. Your expertise will be crucial in fetching data from multiple online sources, cleansing it, and building APIs on top of it. A good understanding of data structure and algorithms, as well as knowledge in bypassing Bot Detection techniques, is required. Experience in Web RestFul APIs/Microservices Development is preferred.
In this role, you will need to think deeply about developing large-scale scraping tools, including data integrity, health, and monitoring systems. It is important to develop a deep understanding of vast data sources on the web and know how, when, and which data to scrape, parse, and store. Working with SQL and NoSQL databases to store raw data, developing frameworks for automating and maintaining a constant flow of data from multiple sources, and having knowledge of distributed technologies are essential.
You should possess a strong passion for coding, take quality, security, and performance seriously, and be able to work independently with little supervision to research and test innovative solutions. Collaboration with other engineers and cross-teams is necessary, and excellent communication skills are required to present effectively to both business and technical stakeholders.
Looking to get Placed? Try our Placement Guarantee Plan
This role provides a challenging yet rewarding opportunity to contribute to a cutting-edge web crawling system and work with a talented team to drive innovation and excellence in data scraping and API development.,
Skills
AlgorithmsPythonNosql DatabasesDeveloperRestfulApiSqlScalable SystemsHigh Throughput SystemsBot Detection TechniquesMicroservices DevelopmentScrapyRealtime SystemsPerformance OptimizationDistributed TechnologiesWeb CrawlingSeleniumPythonPuppeteerCodingQuality AssuranceWeb ScrapingData FetchingBeautifulsoupAPIsSecurityNoSQL DatabasesData StructureLow Latency SystemsSQLRestFul APIsIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
Important dates & deadlines?
Application Deadline
10 Oct 25, 04:43 PM IST
Similar Jobs
View AllDon't Miss out any Updates
Subscribe now for the latest job alerts
and never miss an update

