SCrawler is a free, open source social networking project written in Visual Basic .NET and released under GPL-3.0. It has 2,240 GitHub stars, 156 forks and 2 open issues, and was last pushed 4 days ago. On this registry it ranks #16 of 47 tracked projects in Social Networking, with 5 head-to-head comparisons available. It gained 51 stars over the last 30 tracked days.

What is SCrawler?

SCrawler is a GPL-3.0 licensed, Visual Basic .NET media downloader and crawler that pulls photos and videos from user profiles and feeds across social networks and adult platforms, aimed at individuals who want a local archive of media they already have access to.

What it is

SCrawler is an open-source desktop crawler and download manager for photos and videos. It connects to user profiles, channels, playlists, boards and search queries on a long list of platforms, then downloads the media it finds into a local collection the user manages. The project lives in the social networking and community tooling space; its topic list names crawler, downloader, manager, media, image, photo and pictures, and the README describes it as a program to download photo and video from any site.

The concrete problem it solves is that each platform exposes its own interface for saved posts, stories, likes, playlists and search results, and none of them provide a unified way to keep that media. SCrawler replaces the piecemeal routine of saving items one at a time in a browser or using several single-site tools. It supports YouTube, YouTube Music, Reddit, Twitter, Bluesky, Mastodon, Instagram, Threads, Facebook, TikTok, Pinterest, Imgur, RedGifs, Gfycat, OnlyFans, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid and LPSG, with an additional section of other supported sites.

Key capabilities

  • Downloads images and videos from user profiles, including YouTube videos, shorts, community feeds, playlists, music and tracks, Reddit galleries and saved posts, and Twitter bookmarked posts, likes and communities.
  • Handles saved and bookmarked content per platform: OnlyFans stories and saved posts, JustForFans and Mastodon saved posts, Instagram tagged and saved posts, Threads and Facebook saved posts, Pinterest saved posts.
  • Runs search-based downloads on adult platforms, covering PornHub and XHamster likes and search queries, XVIDEOS search queries and categories, and ThisVid search queries, categories and tags.
  • Parses Reddit channel and view data, so a channel can be browsed and its users added as download targets.
  • Supports multiple accounts, user labelling, download groups, favorites and temporary users, and filtering of existing users by label or group.
  • Provides a Subscription mode that downloads post previews without downloading the media file, plus a feed of downloaded media files and subscription posts.
  • Offers automation that downloads data automatically every X minutes, alongside media-type selection and a standalone YouTube application.

Who uses it and how

  • Individual archivists who want a single local library instead of per-platform download tools, using download groups and labels to keep large collections organised.
  • Users tracking many creators at once, relying on the feed and Subscription mode to preview posts before committing storage and bandwidth.
  • Reddit users who parse a channel, review its data, and add users directly from the parsed channel into their download set.
  • People with multiple accounts on the same platform, using multi-account support to cover content visible only to one identity.
  • Anyone wanting unattended collection, using automation to run downloads every X minutes while media-type selection limits what is fetched.

Getting started

The README points to the GitHub releases page for downloads, with the project wiki acting as the guide, FAQ.md for common questions, and a Discord server for faster help.

How it compares

No paid products and no comparable tools are named in the provided facts, so SCrawler stands alone in this registry rather than being positioned against alternatives. Its licence is GPL-3.0, and it is distributed as project releases rather than as a hosted subscription service.

When to use it โ€” and when not to

Choose SCrawler if a single local tool covering mainstream social networks and adult platforms is worth configuring per-platform accounts and managing your own media storage. Do not choose it if you need a hosted service, a documented API, or commercial support, since the project directs users to its wiki and Discord server instead. The published facts are thin on installation detail and system requirements, and the README excerpt is a feature list rather than a setup guide, so expect to rely on the wiki, the FAQ and community help before a first successful download.

project readme (upstream, from github) โ€” read inline

๐Ÿณ๏ธโ€๐ŸŒˆ Happy LGBT Pride Month ๐ŸŽ‰

๐Ÿณ๏ธโ€๐ŸŒˆ Social networks crawler ๐Ÿณ๏ธโ€๐ŸŒˆ

GitHub release (latest by date) GitHub license Discord GitHub all releases FAQ GUIDE How to support :eu: :greece:

A program to download photo and video from any site (e.g. YouTube, YouTube Music, OnlyFans, Reddit, Twitter, Mastodon, Instagram, Threads, Facebook, TikTok, RedGifs, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid, LPSG, Pinterest).

If you like SCrawler, please like the program on this site and/or this

Join our Discord server: https://discord.gg/uFNUXvFFmg
If you have problems using the program, you can get help faster on our Discord server!

Bitcoin: BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET

Main window Channels window

YouTube standalone application:

YouTube application

What can program do:

  • Download pictures and videos from user profiles:
    • YouTube videos, shorts, community feeds, users, artists, playlists, music, tracks;
    • Reddit images, galleries of images, videos, text, saved posts;
    • Redgifs images and videos (https://www.redgifs.com/);
    • Twitter images and videos, text, saved (bookmarked) posts, likes, communities;
    • Bluesky images and videos, text;
    • OnlyFans images and videos, text, saved (bookmarked) posts, stories;
    • JustForFans images and videos, saved (bookmarked) posts;
    • Mastodon images and videos, saved (bookmarked) posts;
    • Instagram images and videos, text, tagged posts, stories, saved posts;
    • Threads images and videos, text, saved posts;
    • Facebook images and videos, stories, saved posts;
    • TikTok images and videos;
    • Pinterest boards, users, saved posts;
    • Imgur images, galleries and videos;
    • Gfycat videos;
    • PornHub images, videos, save (liked) posts, search queries, search categories;
    • XHamster images, videos, saved posts, search queries, search categories, search tags;
    • XVIDEOS videos, saved posts, search queries, search categories;
    • ThisVid images, videos, saved posts, search queries, search categories, search tags;
    • Other supported sites
  • Parse Reddit channel and view data
  • Download saved posts
  • Add users from parsed channel
  • Advanced user management
  • Automation (downloading data automatically every X minutes)
  • Feed (feed of downloaded media files and subscriptions posts)
  • Multiple accounts support
  • Labeling users
  • Create download groups
  • Adding users to favorites and temporary
  • Adding users and search queries in the Subscription mode (download post preview, but do not download the media file)
  • Filter exists users by label or group
  • Selection of media types you want to download (images only, videos only, both)
  • Download a special video, image or gallery
  • Making collections (grouping users into collections)
  • Specifying a user folder (for downloading data to another location)
  • Changing user icons
  • Changing view modes
  • ...and many others...

Supported sites

  • YouTube
  • YouTube Music
  • Reddit
  • Twitter
  • Bluesky
  • OnlyFans (partial support)[^1]
  • Instagram
  • Threads
  • Facebook
  • JustForFans (partial support) (video issue)[^1]
  • Mastodon (out of support)
  • TikTok
  • RedGifs
  • Pinterest
  • Imgur (out of support)
  • Gfycat
  • LPSG
  • PornHub
  • XHamster
  • XVIDEOS
  • ThisVid
  • Other sites

SITES REQUIREMENTS

How it works

First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.

How to request a new site

I'm currently not accepting requests to develop new sites.

Requirements

  • Windows 10, 11 with NET Framework 4.6.1 or higher (v4.6.1 must be installed). You can check version compatibility with this tool.
  • SITES REQUIREMENTS

Guide

Full guide you can find here

Video on how to configure

How to configure

Installation

Just download the latest release, unzip the program archive to any folder and enjoy. :blush:

Don't put program in the Program Files system folder (this is portable program and program settings are stored in the program folder)

I highly doubt you can run SCrawler on Linux or Mac. SCrawler is a program that is heavily dependent on Windows.

Updating

Just download latest version and unpack it into the program folder. Before launching a new version, I recommend making a backup copy of the program settings folder and user settings/data files.

You can also use the updater included in the release package.

How to report a problem

How to build from source

How to make a plugin

How to support

Settings and usage

The program has an intuitive interface.

SITES REQUIREMENTS

How to configure

Just add a user profile and click the Download button.

stateDiagram
Start: Add site credentials
What: What would I like to do
DownUser: Download user
DownVideo: Download video
AUser: Add user (1)
OVIF: Open standalone downloader (2)
AVideo: Add video url
F5: Press 'F5' or click the download button
[*]-->Start
Start-->What
What-->DownUser
What-->DownVideo
DownUser-->AUser
DownVideo-->OVIF
OVIF-->AVideo
AVideo-->F5
AUser-->F5
F5-->[*]
  1. Press Insert or click the Download button (read more here, hot keys)
  2. Click the Download button, then Standalone downloader (read more here)

Add user

Contact me

Discord server: https://discord.gg/uFNUXvFFmg

[^1]: Partial support means that I don't have personal accounts on paid porn sites because I don't pay for porn. If this site has stopped downloading and you want me to fix it, please be ready to give me access to an account with at least one active subscription. Otherwise, the download from this site will not be fixed.

Frequently asked questions

Is SCrawler free to use?

SCrawler is open source under the GPL-3.0 licence. There is no licence fee and no seat count โ€” you can self-host it or, where the project offers one, pay a vendor for a managed version instead.

What does SCrawler do?

๐Ÿณ๏ธโ€๐ŸŒˆ Media downloader from any sites, including Twitter, Reddit, Instagram, BlueSky, TikTok, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamste

What is SCrawler written in?

SCrawler is primarily written in Visual Basic .NET. Its source is publicly available at https://github.com/AAndyProgram/SCrawler, and it has 2,240 GitHub stars.