Releases: AAndyProgram/SCrawler
2023.9.21.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Fixed
- PornHub: videos are not downloading
2023.9.20.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Instagram: user active (non-pinned) stories (Issue #17)
- Reddit: reduce the number of token updates (refresh the token if there are Reddit users in the download queue)
- YouTube (standalone app): priority download protocol (
Settings-Defaults-Protocol) (you can now select the default protocol you want to download media on:Any,https,m3u8)) - Automation: ability to change schedulers (
Download-Automation-Script icon) - Collections: update colors for the added user
- Fixed
- YouTube: can't detect
shortslinks - Incorrect MD5 validation initial value
- Instagram: handle error 500
- Collections: update labels only for the added user
- YouTube: can't detect
2023.8.27.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- JustForFans. Special thanks @archwaycommons
- Advanced download (
Download-Download (advanced)) - Advanced filter (
View-Advanced filter) - Auto downloader: cloning plans
- Feed: add button to go to custom page
- Special log for non-existent users
- Twitter: group 'limit' notifications
- Ability to set custom color for subscription users
- Other improvements
- Fixed
- Auto downloader: new plan date display bug (Issue #161)
- Auto downloader: downloading stuck
- Minor bugs
Contributors
Assets 4
2023.8.6.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Please, read the following release notes carefully!
To support the new functionality, the configurations of some profiles have been changed. So once you start using this version, you might not be able to downgrade it. I highly recommend backing up user settings and user data files before start using. You can see an example CMD script here.
Reddit. Added OAuth authorization. Reddit can download timelines without cookies and without errors. To do this, Reddit's settings now have new options to enable/disable the use of cookies for download timelines. If you still want to use OAuth authorization, I've added a guide on how to do it. Please read it carefully.
TikTok is back. But in order to download TikTok profiles, you need to download a special plugin for TikTok users. I've added a guide on how to do it. Please read it carefully. TikTok also requires yt-dlp.
Added bug report. You can send an anonymous bug report for those of you who don't have a GitHub account. It also allows you to attach photo files (that illustrate the bug). This report will be sent to my personal Discord. You can also say something nice (Anon message - Nice), suggest a feature, or say whatever you want. 😊 Please, don't send too many bug reports. One bug report is enough. You can say something nice as many times as you want, without limits. 😊
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- The ability to remove user data and/or download history for redownload
- Subscription mode
- Settings to change the program title and information in the program information
- Settings for saving video thumbnail along with the file or in the cache (temporary cache or permanent cache)
- A bug report form to create a bug report or say something nice to the developer 😊
- Prevent adding site-specific labels when adding to a collection
- Ability to select custom user highlighting in the main window and feed.
- Add a notification to the log if the user is not found on the site
- Added visualization of users download queue
- Ability to set more than one global paths
- Improve user paths changing: now you can also simply move the user/collection to another global location
- Ability to move multiple user/collection to another location
- Download groups: added
Subscriptionoptions - Download groups: the ability to set the number of users to download
- Auto downloader: new group options
- Auto downloader: additional skip options
- Auto downloader: added force start
- Feed: press
Ctrl+Gto go to a specific page - Feed: added site icon to post
- Feed: always using
Friendly nameinstead ofUserNameif it exists - Missing posts: the ability to delete all missing posts
- Standalone downloader: add the ability to store download locations and quickly select after
- Standalone downloader: add
Ctrl+Ohotkey to select destination path - Standalone downloader: add
Alt+Ohotkey to select destination path and save it to download locations - User editor: ability to hide/show site-specific labels in collection editing mode
- Main window: filters by subscription and user
- Instagram: if the user is not found on the site, SCrawler will check for a new user name
- OnlyFans: handling of
504and429errors - OnlyFans: the
sec-ch-uaheader is now optional - OnlyFans: ability to download 'Highlights' and media from chats
- PathPlugin: incorrect detection of path existence
- PornHub: completely rewritten videos parser
- PornHub: now you choose which videos you want to download (uploaded, tagged, private, favorites)
- PornHub: subscription mode
- PornHub: ability to download search queries and search categories
- Reddit: added bearer token (optional)
- Reddit: added OAuth authorization (optional)
- Reddit: options to use the bearer token for the timeline and/or saved posts
- Reddit: option to disable the use of cookies for the timeline
- ThisVid: now you can also download user's favorite videos
- ThisVid: ability to download search queries, search categories and search tags
- ThisVid: subscription mode
- Twitter: new options:
Use the appropriate model,New endpoint: search,New endpoint: profiles,Abort on limit,Download already parsedandMedia Model: allow non-user tweets - Twitter: new user option
Force apply - xHamster: ability to download search queries, search categories and search tags
- xHamster: subscription mode
- xHamster: pornstars download
- XVideos: ability to download search queries, search categories and search tags
- XVideos: subscription mode
- YouTube: added
Output path: ask for a nameandOutput path: auto addsettings - YouTube: added the ability to store download locations and quickly select after
- YouTube: subscription mode
- Plugins.Attributes: added
DependentFieldsattribute - Plugins.Attributes: replace
DependencieswithArguments(PropertyUpdaterattribute) - Plugins.IPluginContentProvider: added
OptionsandIsSubscriptionproperties - Plugins.ISiteSettings: added
SubscriptionsAllowedproperty - Plugins.ExchangeOptions: added
Optionsfield - Plugins: added
ExitException - Other improvements
- Updated
- gallery-dl up to version 1.25.8
- yt-dlp up to version 2023.07.06
- LibVLCSharp up to 3.7.0
- VideoLAN up to 3.0.18
- Fixed
- TikTok supported again (read about the new TikTok requirements here)!
- Auto downloader: excluded labels and sites in default mode are not respected
- Download info: does not remember the last size and location
- Download info: hide unnecessary error
- Feed:
webmphotos not showing - Search users: incorrect search by name
- OnlyFans: incorrect parsing of username containing dots
- OnlyFans: incorrect error handler
- Reddit: handling error 502 (Reddit data not downloading)
- RedGifs: incorrect behavior when updating token
- Twitter: gifs are not downloading
- xHamster: some channels cannot be downloaded or are not fully downloaded
- YouTube: re-saving elements when loading a video list
- YouTube: files were not deleted when the delete button was clicked
- YouTube: a bug that caused the video to redownload
2023.6.19.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
- Added
- OnlyFans. Special thanks @archwaycommons
- YouTube: make the playlists parsing progress more informative
- YouTube: add
Addbutton to tray - YouTube: add
Ctrl+Clickon tray icon to add download - YouTube: add setting
Download on click in tray: show form - Minor improvements to progress bars
- Other improvements
- Fixed
Contributors
Assets 4
2023.6.9.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
- Fixed
- YouTube: opening paths to downloaded playlists and channels
- Twitter: make the algorithm faster
- Make progress more informative
2023.6.8.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
- Added
- YouTube: append artist name to music playlist output path
- YouTube: save thumbnail path for playlist and channel
- Fixed
- YouTube: opening paths to downloaded playlists and channels
- Twitter: profile not fully downloaded
- Instagram site settings: Corrected form size for small monitors (Issue #136)
2023.6.5.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Twitter has completely moved to the new API. Gallery-dl is now required to download any Twitter content. Headers have been removed from the Twitter settings as they are not required for content to download.
If Twitter profiles in SCrawler are marked in red, you can simply download them all:
- In the main window, in the
Downloadmenu, press theDownload all site users [FULL]button withShift. - Check
Twitter - Click
Ok
- Added
- Instagram: add additional authorization headers
- Setting to prevent user icon and banner from downloading (Request #129)
- Add standalone downloader to tray context menu
- YouTube downloader: added
Replace modification datesetting - Minor improvements
- Fixed
- Fascist Twitter: posts not downloading (new API)
- Main window: refill bug when the number of filtered profiles = 0
- Standalone downloader: new items are not added to the queue
- Standalone downloader: bug when not downloaded videos do not appear in the list when loading the program
- Standalone downloader: add videos array not working
- Saved posts: remove main progress perform when downloading saved posts
- Minor bugs
2023.5.12.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
- Added
- Advanced progress (make progress bars more informative)
- User metrics calculation
- Reddit: improve parsing function
- PornHub: add
Download UHDoption
- Fixed
- MD5 GIF hash bug
- Mastodon: handle 'Forbidden' error
- Mastodon: bug in parsing non-user posts
- Pinterest: remove cookies requirement for saved posts
- PornHub: resolutions issue
- Reddit: missing & broken images bug
- Main window: collection pointing bug
2023.4.28.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
- Added
- YouTube
- YouTube Music
- Mastodon
- ThisVid
- YouTube downloader (standalone app)
- Redesigned standalone downloader and update environment
- Added icons to download progress
- Added icons to saved posts downloader
- Cookies: new ways to add cookies. You can now export cookies using the browser extension and then import them into SCrawler!
- User creation: ability to extract the user's URL from the buffer and apply parameters if found
- User creation: simplified way to create new users (
Ctrl+Insertto create a new user with default parameters from clipboard URL) - Ability to customize the placement of ffmpeg (and other) files
- Ability to customize the command line encoding
- New notification options for standalone downloader
- Reddit: now it can download saved crossposts
- RedGifs: added
UserAgentoption - Other improvements
- Removed
- User creation: remove the 'Channel' checkbox because it confuses people
- Removed an ability to open SCrawler with
-vargument - All ways to create users except URL. You can only properly create a user using the user's URL.
- Plugins
- Added
IDownloadableMediainterface - Removed
Channeloption from all functions and enums - ISiteSettings: added
GetSingleMediaInstancefunction - IPluginContentProvider: added
DownloadSingleObjectfunction - IPluginContentProvider: added tokens to
GetMediaandDownloadfunctions - IPluginContentProvider: removed
GetSpecialDatafunction - UserMediaTypes: added
AudioandAudioPreenums
- Added
- Fixed