Skip to content

rehmanstackdev/GitHub-User-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GitHub User Scraper Application (MERN)

A Full-Stack GitHub User Scraper application built with the MERN stack. This React.js-based application allows search github user putting url of profile in input and view GitHub profiles, displaying a list of scraped user data for convenient access. The backend, built with Node.js and Express.js, provides a robust RESTful API for efficient web scraping and data management.

📖 Features

  • GitHub User Scraping: Enter a GitHub profile URL, click "Scrape User," and the app fetches, saves, and displays user details such as name, username, email, profile picture, and location in MongoDB.
  • Profile Data Display: View all GitHub user details saved in MongoDB for easy access.
  • Responsive UI: Elegant and responsive interface built with Bootstrap.
  • Real-time Profile Data: Uses Puppeteer to scrape and display live GitHub profile data instantly.

🖥️ Tech Stack

Frontend

  • React: Component-based JavaScript library for building UIs.
  • Axios: For making API requests to the backend.
  • Bootstrap: For responsive and styled components.
  • React Router: For seamless navigation between pages.

Backend

  • Node.js: JavaScript runtime environment.
  • Express.js: Web server framework.
  • Axios: For making HTTP requests to GitHub.
  • Puppeteer: Headless browser for scraping GitHub profile data.
  • MongoDB: Database to store user data.
  • Mongoose: MongoDB object modeling.
  • Body-parser: Middleware for parsing request bodies.
  • CORS: Middleware to enable cross-origin resource sharing.
  • Dotenv: For managing environment variables.
  • Nodemon: Development tool for automatically restarting the server.

Frontend Screenshot

GitHub User Scraper Screen

Frontend Screenshot

GitHub User List Screen

Frontend Screenshot

About

A full-stack GitHub User Scraper application built with the MERN stack. This React.js-based application allows users to search for and view GitHub profiles, displaying a list of scraped user data for convenient access. The backend, built with Node.js and Express.js, provides a robust RESTful API for efficient web scraping and data management.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors