Work

Web Scrapping

Web Scrapping
Job site
Backend
Frontend

Web Scrapping

  • Developed web crawling and scraping solutions for job data across global job websites, involving extensive data analysis and validation.
  • Utilized Python and the Scrapy Framework for efficient data scraping and parsing, storing, and analyzing data with PostgreSQL and MongoDB.
  • Employed Shell Scripting and Regex for advanced data processing tasks.
  • Created a comprehensive job site that consolidated job listings from various Nepali websites.
  • Implemented data scraping techniques to gather and display job postings from multiple sources.
  • Technologies used: Django, Flask, JavaScript, Vue.js, ElasticSearch, and PostgreSQL.