Skip to content

itsmepawansaini/Site-Sucker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Site Sucker

Site Sucker is a simple Node.js tool to download an entire website for offline use.
It recursively crawls all internal pages, downloads assets (HTML, CSS, JS, images, fonts), and preserves the folder structure.


Features

  • Download entire websites for offline browsing
  • Recursively crawl internal pages
  • Download assets (images, CSS, JS, fonts, etc.)
  • Preserve original folder structure
  • Simple and lightweight — built with Node.js
  • Tested with both custom-coded and WordPress sites

Requirements

  • Node.js (v18+ recommended)
  • npm (comes with Node)

Setup

  1. Clone or download this repository:
git clone https://github.com/itsmepawansaini/site-sucker.git
cd site-sucker
  1. Install dependencies:
npm install
  1. Open index.js and set the website URL you want to download:
const START_URL = "https://example.com/"; // Change this to your target site
  1. Run the script:
node index.js

Output

All downloaded files will be saved inside the site folder.
The script keeps the original structure of the website.


Example

node index.js

If START_URL is set to:

https://example.com/

You’ll get:

downloaded-site/
├── index.html
├── about/
│   └── index.html
├── contact/
│   └── index.html
└── assets/
    ├── css/
    ├── js/
    ├── images/
    └── fonts/

Notes

  • The script only downloads pages from the same domain.
  • JavaScript-generated content (AJAX, SPAs) may not be captured.
  • For dynamic sites, you might need a headless browser like Puppeteer.

Tech Stack


License

This project is open-source and available under the MIT License.


Contributing

Contributions, issues, and feature requests are welcome.
Feel free to fork this repository and improve the script.

About

A Node.js Tool To Download Entire Websites, Including HTML, CSS, JS, Images, & Fonts. Works With Custom-Coded & WordPress Sites.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors