SiteSucker is a Macintosh application that automatically downloads websites from the internet. It asynchronously copies web pages, images, PDF files, stylesheets, and other files from websites, saving them to your local hard drive while preserving the original directory structure of the website.

SiteSucker Pro is an enhanced version of SiteSucker that can download embedded videos, including embedded videos from YouTube and Vimeo.

SiteSucker can download an entire website to your computer while preserving the original site structure, or it can download only specific types of content (such as images, compressed files, etc.). When downloading a website with default settings, the program will not download files that are excluded by the ROBOTS.txt file in the site structure. However, this restriction can be easily disabled in the settings.

The application logs operations from the moment a download starts, including errors that occur during the download process, as well as other parameters specified by the relevant options in the Settings menu. You can view the log file via the Open Log button in the toolbar. The log file itself opens in the system’s Console application.

All feature settings are organized into dropdown menus:

GENERAL

This tab contains the most important settings, such as ignoring exclusion rules in ROBOTS.txt, program behavior when handling duplicate files, choosing the destination folder on your hard drive, etc.

LOGS

Used to select the types of events that appear in the program’s log file.

LIMITS

Used to set download limits, including parameters such as link crawling depth, maximum number of files to download, minimum and maximum file sizes, etc.

FILE TYPES

Used to configure file download rules. In this tab, you can set the program to download all files or only files of specified types.

The settings in the LIMITS and FILE TYPES tabs allow flexible control over which file types need to be downloaded, avoiding the meaningless download of large numbers of useless files, while also greatly simplifying the subsequent processing of downloaded websites.

PATHS

This tab allows you to add specific website files or page links, which can be set to be mandatory downloads or explicitly skipped.

ADVANCED

This contains advanced settings for the program. These options are not required, but they can significantly expand the program’s functionality.

For example, some websites prohibit website download tools from scraping their content. To address this, SiteSucker can modify its user agent so that it does not identify itself as SiteSucker but instead mimics a browser such as Safari or Firefox, thereby bypassing some download restrictions.