SCrawler is a free, open source social networking project written in Visual Basic .NET and released under GPL-3.0. It has 2,174 GitHub stars, 154 forks and 2 open issues, and was last pushed 1 months ago. On this registry it ranks #17 of 44 tracked projects in Social Networking, with 5 head-to-head comparisons available. It gained 2 stars over the last 3 tracked days.

What is SCrawler?

SCrawler is a GPL-3.0 licensed, Visual Basic .NET media downloader and crawler that pulls photos and videos from user profiles and feeds across social networks and adult platforms, aimed at individuals who want a local archive of media they already have access to.

What it is

SCrawler is an open-source desktop crawler and download manager for photos and videos. It connects to user profiles, channels, playlists, boards and search queries on a long list of platforms, then downloads the media it finds into a local collection the user manages. The project lives in the social networking and community tooling space; its topic list names crawler, downloader, manager, media, image, photo and pictures, and the README describes it as a program to download photo and video from any site.

The concrete problem it solves is that each platform exposes its own interface for saved posts, stories, likes, playlists and search results, and none of them provide a unified way to keep that media. SCrawler replaces the piecemeal routine of saving items one at a time in a browser or using several single-site tools. It supports YouTube, YouTube Music, Reddit, Twitter, Bluesky, Mastodon, Instagram, Threads, Facebook, TikTok, Pinterest, Imgur, RedGifs, Gfycat, OnlyFans, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid and LPSG, with an additional section of other supported sites.

Key capabilities

  • Downloads images and videos from user profiles, including YouTube videos, shorts, community feeds, playlists, music and tracks, Reddit galleries and saved posts, and Twitter bookmarked posts, likes and communities.
  • Handles saved and bookmarked content per platform: OnlyFans stories and saved posts, JustForFans and Mastodon saved posts, Instagram tagged and saved posts, Threads and Facebook saved posts, Pinterest saved posts.
  • Runs search-based downloads on adult platforms, covering PornHub and XHamster likes and search queries, XVIDEOS search queries and categories, and ThisVid search queries, categories and tags.
  • Parses Reddit channel and view data, so a channel can be browsed and its users added as download targets.
  • Supports multiple accounts, user labelling, download groups, favorites and temporary users, and filtering of existing users by label or group.
  • Provides a Subscription mode that downloads post previews without downloading the media file, plus a feed of downloaded media files and subscription posts.
  • Offers automation that downloads data automatically every X minutes, alongside media-type selection and a standalone YouTube application.

Who uses it and how

  • Individual archivists who want a single local library instead of per-platform download tools, using download groups and labels to keep large collections organised.
  • Users tracking many creators at once, relying on the feed and Subscription mode to preview posts before committing storage and bandwidth.
  • Reddit users who parse a channel, review its data, and add users directly from the parsed channel into their download set.
  • People with multiple accounts on the same platform, using multi-account support to cover content visible only to one identity.
  • Anyone wanting unattended collection, using automation to run downloads every X minutes while media-type selection limits what is fetched.

Getting started

The README points to the GitHub releases page for downloads, with the project wiki acting as the guide, FAQ.md for common questions, and a Discord server for faster help.

How it compares

No paid products and no comparable tools are named in the provided facts, so SCrawler stands alone in this registry rather than being positioned against alternatives. Its licence is GPL-3.0, and it is distributed as project releases rather than as a hosted subscription service.

When to use it β€” and when not to

Choose SCrawler if a single local tool covering mainstream social networks and adult platforms is worth configuring per-platform accounts and managing your own media storage. Do not choose it if you need a hosted service, a documented API, or commercial support, since the project directs users to its wiki and Discord server instead. The published facts are thin on installation detail and system requirements, and the README excerpt is a feature list rather than a setup guide, so expect to rely on the wiki, the FAQ and community help before a first successful download.

project readme (upstream, from github) β€” read inline

πŸ³οΈβ€πŸŒˆ Happy LGBT Pride Month πŸŽ‰

πŸ³οΈβ€πŸŒˆ Social networks crawler πŸ³οΈβ€πŸŒˆ

GitHub release (latest by date) GitHub license Discord GitHub all releases FAQ GUIDE How to support :eu: :greece:

A program to download photo and video from any site (e.g. YouTube, YouTube Music, OnlyFans, Reddit, Twitter, Mastodon, Instagram, Threads, Facebook, TikTok, RedGifs, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid, LPSG, Pinterest).

If you like SCrawler, please like the program on this site and/or this

Join our Discord server: https://discord.gg/uFNUXvFFmg
If you have problems using the program, you can get help faster on our Discord server!

Bitcoin: BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET

Main window Channels window

YouTube standalone application:

YouTube application

What can program do:

  • Download pictures and videos from user profiles:
    • YouTube videos, shorts, community feeds, users, artists, playlists, music, tracks;
    • Reddit images, galleries of images, videos, text, saved posts;
    • Redgifs images and videos (https://www.redgifs.com/);
    • Twitter images and videos, text, saved (bookmarked) posts, likes, communities;
    • Bluesky images and videos, text;
    • OnlyFans images and videos, text, saved (bookmarked) posts, stories;
    • JustForFans images and videos, saved (bookmarked) posts;
    • Mastodon images and videos, saved (bookmarked) posts;
    • Instagram images and videos, text, tagged posts, stories, saved posts;
    • Threads images and videos, text, saved posts;
    • Facebook images and videos, stories, saved posts;
    • TikTok images and videos;
    • Pinterest boards, users, saved posts;
    • Imgur images, galleries and videos;
    • Gfycat videos;
    • PornHub images, videos, save (liked) posts, search queries, search categories;
    • XHamster images, videos, saved posts, search queries, search categories, search tags;
    • XVIDEOS videos, saved posts, search queries, search categories;
    • ThisVid images, videos, saved posts, search queries, search categories, search tags;
    • Other supported sites
  • Parse Reddit channel and view data
  • Download saved posts
  • Add users from parsed channel
  • Advanced user management
  • Automation (downloading data automatically every X minutes)
  • Feed (feed of downloaded media files and subscriptions posts)
  • Multiple accounts support
  • Labeling users
  • Create download groups
  • Adding users to favorites and temporary
  • Adding users and search queries in the Subscription mode (download post preview, but do not download the media file)
  • Filter exists users by label or group
  • Selection of media types you want to download (images only, videos only, both)
  • Download a special video, image or gallery
  • Making collections (grouping users into collections)
  • Specifying a user folder (for downloading data to another location)
  • Changing user icons
  • Changing view modes
  • ...and many others...

Supported sites

  • YouTube
  • YouTube Music
  • Reddit
  • Twitter
  • Bluesky
  • OnlyFans (partial support)[^1]
  • Instagram
  • Threads
  • Facebook
  • JustForFans (partial support) (video issue)[^1]
  • Mastodon (out of support)
  • TikTok
  • RedGifs
  • Pinterest
  • Imgur (out of support)
  • Gfycat
  • LPSG
  • PornHub
  • XHamster
  • XVIDEOS
  • ThisVid
  • Other sites

SITES REQUIREMENTS

How it works

First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.

How to request a new site

I'm currently not accepting requests to develop new sites.

Requirements

  • Windows 10, 11 with NET Framework 4.6.1 or higher (v4.6.1 must be installed). You can check version compatibility with this tool.
  • SITES REQUIREMENTS

Guide

Full guide you can find here

Video on how to configure

[How to configure](https://www.youtube.com/watch?v=XDn

readme truncated β€” read the full docs on github

Frequently asked questions

Is SCrawler free to use?

SCrawler is open source under the GPL-3.0 licence. There is no licence fee and no seat count β€” you can self-host it or, where the project offers one, pay a vendor for a managed version instead.

What does SCrawler do?

πŸ³οΈβ€πŸŒˆ Media downloader from any sites, including Twitter, Reddit, Instagram, BlueSky, TikTok, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamste

What is SCrawler written in?

SCrawler is primarily written in Visual Basic .NET. Its source is publicly available at https://github.com/AAndyProgram/SCrawler, and it has 2,174 GitHub stars.