Skip to content

Releases: AAndyProgram/SCrawler

2022.12.27.0

27 Dec 12:30
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


ATTENTION!

Instagram requirements changed. Headers and cookies are now required to download Timeline, Stories and Saved posts; hash to download tagged posts. Please update your credentials.

Instagram tagged posts no longer provide the total amount of tagged posts. I've corrected the tagged posts notification, but now I can't tell how many requests will be spent on downloading tagged posts. And from now on, one request will be spent on downloading each tagged post, because Instagram doesn't provide complete information about the tagged post with the site's response. In this case, if the number of tagged posts is 1000, 1000 requests will be spent. Be careful when downloading them. I highly recommend that you forcefully disable the downloading of tagged posts for a while (Settings-Instagram-Download tagged).

Please, review your Instagram settings and check them all.

  • Added
    • XVideos: added downloading 'Quickies'
    • Instagram: added more enable/disable options
  • Fixed
    • XVideos not downloading (sorry, I broke it in a previous release)

How to support the program

2022.12.26.0

26 Dec 14:45
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


ATTENTION!

Instagram requirements changed. Headers and cookies are now required to download Timeline, Stories and Saved posts; hash to download tagged posts. Please update your credentials.

Instagram tagged posts no longer provide the total amount of tagged posts. I've corrected the tagged posts notification, but now I can't tell how many requests will be spent on downloading tagged posts. And from now on, one request will be spent on downloading each tagged post, because Instagram doesn't provide complete information about the tagged post with the site's response. In this case, if the number of tagged posts is 1000, 1000 requests will be spent. Be careful when downloading them. I highly recommend that you forcefully disable the downloading of tagged posts for a while (Settings-Instagram-Download tagged).

  • Added
    • Updated user loading algorithm
    • Channels button to tray context menu
    • (Request #96) Add FFmpeg to x86 version
  • Fixed
    • PornHub wrong behavior when downloading images
    • Unable open XVideos user profile
    • Cannot delete multiple collections at once
    • Can't focus user from the download info form
    • Instagram downloader not working
    • (Issue #69) RedGifs data is not downloading. Again πŸ˜•.
    • Minor bugs

How to support the program

2022.11.16.0

16 Nov 10:49
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


ATTENTION! This version makes changes to the base SCrawler user configuration file. Since you started using this version, you still can downgrade. BUT! Once you add a virtual collection or a virtual user to a collection, you won't be able to downgrade without losing data.

  • Added
    • PornHub
    • XHamster
    • An ability to download saved XVIDEOS posts
    • Download indicator. While downloading, the rainbow tray icon changed to a blue arrow.
    • Collections: the ability to edit a collection using a form
    • Collections: the ability to create a virtual collection and add a virtual user to a real collection
    • Collections: an easier way to added users to a collection (you can select multiple users and a collection to add users to this collection)
    • Collections: an easier way to create collections (you can select multiple users and a collection to add users to this collection)
    • Added icons for channels form context menu buttons
    • More convenient change of user labels from the context menu of the user list
    • Notifications: complete transition from default notifications to ToastNotifications
    • Notifications: when you click on the notification that some of the channels are downloaded, the channels form opens
    • Notifications: when you click on the notification that all users are downloaded, the main window form opens
    • Notifications: when you click on the notification that the saved posts are downloaded, the saved posts form opens
    • Import users
    • Minor improvements
  • Plugins
    • Added
      • TaskGroup attribute
      • IUserMedia interface
    • Changed
      • GetUserUrl and GetUserPostUrl functions: String UserName and String UserID changed to IPluginContentProvider User
  • Fixed
    • Collections editor: new added collections are still not added to the top of the collections list
    • Users search form doesn't remember last size
    • Minor bugs

How to support the program

2022.10.23.0

23 Oct 14:35
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


Attention! The RedGifs site no longer requires cookies. Please delete the Responser_RedGifs_Cookies.dat file (if it exists) from the SCrawler settings folder. The RedGifs token is now auto-renewing.

  • Added
    • RedGifs token Auto-Renewal
    • Download groups: ability to select sites
    • Download groups: ability to exclude labels and sites
    • AutoDownloader: ability to exclude labels and sites in All, Default and Specified modes
    • The Download All button turns blue when pause is enabled
    • Updated Twitter status codes
    • Minor improvements
  • Fixed
    • Updated Twitter status codes
    • AutoDownloader: incorrect next run date in scheduler task information
    • AutoDownloader: minor bugs
    • (Issue #69) RedGifs data is not downloading. Requires token. Special thanks to @altbdoor
    • Minor bugs

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.10.18.0

18 Oct 09:49
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


  • Added
    • TikTok (limited)
    • Search form (Ctrl+F)
    • Feed improvements
    • Ability to save the download session for viewing later
    • Ability to download user, excluding from the feed (use the Ctrl key with a button click of with a hot key press)
    • Ability to disable the notification about the absence of the ffmpeg.exe file
    • Extended user information with labels
    • Advanced AutoDownloader pause options
    • Added pause buttons to tray icon and AutoDownloader form
    • Additional Instagram protection
    • Advanced notification management
    • Silent mode (temporarily disable notification)
    • Excluding users whose profiles do not exist from downloading with groups and AutoDownloader
    • Minor improvements
  • Updated
    • Grouped all download buttons into one menu
    • Finished missing posts. You can now download missing posts if they exist.
    • PluginProvider: added BeginEdit and EndEdit methods
    • PluginProvider: GetSpecialData return type changed from IEnumerable(Of PluginUserMedia) to IEnumerable
    • XVIDEOS and LPSG plugins are moved from libraries to SCrawler
  • Fixed
    • (Issue #69) RedGifs data is not downloading. Requires cookies and token.
    • Some minor bugs when deleting a collection
    • Feed: start video playing may cause the program to freeze (strange behavior of the vlc library)
    • Feed: videos hosted on Reddit not showing up in feed
    • Feed: minor bugs
    • Collection users were not banned when deleted with the ban option
    • When trying to delete multiple collections, each collection asked for confirmation to delete
    • Minor bugs

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.9.24.0

24 Sep 17:29
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


(Issue #69) Temporary disabled downloading data from the RedGifs site. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

  • Added
    • Ability to copy user data to another destination
    • Ability to add 'Session' and 'Date' values to the post title in the feed
    • Minor 'feed' improvements
    • The newly created collection will now appear at the top of the list (after reopening the form)
    • Ability to add multiple users at a time to the collection.
  • Fixed
    • Autodownloader opens a compressed image instead of a full one
    • Incorrect resizing of the feed grid after deleting a media file
    • Incorrect behavior when deleting/removing a user from a collection.
    • An incorrect function that displayed the number of spent Instagram requests.
    • Bug in the XVIDEOS downloader
    • Minor bugs

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.9.17.0

17 Sep 17:51
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


(Issue #69) Temporary disabled downloading data from the RedGifs site. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

  • Added
    • Added two date filters to filter users (in range, not in range)
    • (Request #71) Download data for a specific date range
    • The ability to disable site downloading (in the site settings form)
  • Updated
    • Plugins
  • Fixed
    • (Issue #71) Download data to the date doesn't work for Twitter
    • Download data for a specific date range doesn't work for multiple users
    • Incorrect 'Feed' sorting algorithm
    • Minor bugs

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.9.16.0

16 Sep 16:47
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


(Issue #69) Temporary disabled downloading data from the RedGifs site. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

  • Fixed
    • Failed to get video thumbnail for channel video post
    • Incorrect rendering of the 'Feed' table when the number of columns is more than one
    • Minor design bugs

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.9.13.0

13 Sep 13:25
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


(Issue #69) Temporary disabled downloading data from the RedGifs site. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

Why are the archives so huge? This is due to the fact that in the previous version I added the 'Feed' feature. I initially used the Windows native library for Windows Media Player. This library is thin and quite simple. In practice, I have found that this is not the best choice. Unbelievable huge memory leak. So I decided to change this library to the VLC library. And that's why the archives are so huge. SCrawler remains the same size. But the VLC libraries are really huge.

  • Added
    • Video duration to the feed
  • Fixed
    • (Issue #70) Instagram posts not downloading if there are pinned posts that have already been downloaded.
    • Minor bugs
  • Added since version 2022.9.8.0
    • Feed (feed of downloaded media files)
    • Missing posts tracking and management (still under development)
    • Simple scheduler notifications

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program

2022.9.10.0

10 Sep 09:40
Compare
Choose a tag to compare

πŸ³οΈβ€πŸŒˆ ❀️ If you like SCrawler, please like the program on this site. ❀️ πŸ³οΈβ€πŸŒˆ


(Issue #69) Temporary disabled downloading data from the RedGifs site. You can still add RedGifs profiles, but they won't download. You will be able to download them when this issue is fixed.

Why are the archives so huge? This is due to the fact that in the previous version I added the 'Feed' feature. I initially used the Windows native library for Windows Media Player. This library is thin and quite simple. In practice, I have found that this is not the best choice. Unbelievable huge memory leak. So I decided to change this library to the VLC library. And that's why the archives are so huge. SCrawler remains the same size. But the VLC libraries are really huge.

  • Fixed
    • The memory is still leaking. This time because of the video. Using WMP was not the best choice.
    • Missed posts are not saved
  • Added since version 2022.9.8.0
    • Feed (feed of downloaded media files)
    • Missing posts tracking and management (still under development)
    • Simple scheduler notifications

If you are use the x64 version of the program, don't forget to download ffmpeg from the official repo or from my first release


How to support the program