Home

Main Window

This window contains all data management tools.

• Add/Edit/Delete - actions with users.
• Refresh - refresh the user list. You do not need to press this button. Added just in case...
• Info - show downloaded users and what exactly and how many were downloaded.
• Feed - show recently downloaded data

Buttons

Info

This form will show downloaded items (sorted by latest download date). Each line of data contains information about how many images and videos have been downloaded for the user. If no media is downloaded, the user will not appear in this form.

Right-clicking on this button opens the 'Missing posts' window.

Double-clicking on the data line will open the content folder.

• View - view modes:
  • Session - show downloaded results for this session only;
  • All - show downloaded results for all users, sorted by last downloaded date.
• Up / Down - list navigation buttons
• Find - find the selected user in the main window
• Refresh - update information list. You don't need to press this button. Added just in case...
• Clear - clear the information list of the current download session.

In the Session view, the list is updated automatically.

Hot keys:

• F2 - Down
• F3 - Up
• F4 - Find
• F5 - Refresh

Feed

This form will show the recently downloaded data (images and videos). Each image/video contains download information (tooltip), file address, user information, etc.

Double-clicking on an image will open the original image in an external viewer.

Buttons:

• Refresh - the feed will be updated to receive new downloaded items and/or remove missing items
• Clear - clear list of recent downloads
• Delete selected - delete marked items from the disk

Context menu:

• Open picture/video - open picture/video in external viewer
• Open user (with folder image) - open user folder
• Open user (with globe) - open user site
• Open post - open post in browser
• Find user - find user in the main window
• Information - show post information
• Delete picture/video - delete picture/video

Hot keys

• F5 - Refresh
• F3 - Previous page
• F4 - Next page

You can read about the settings here.

Missing posts

Still under development

This form shows posts that have not been downloaded. This form is opened by right-clicking on the 'Info' button in the main window

Buttons:

• Delete - delete selected posts
• Update - check the missing posts again and refill the list
• Download ALL - download all missing posts (not working, in development)
• Info - show post information

Context menu:

• Download - download selected post
• Open post - open post in browser
• Open user folder - open user folder
• Show post information - show post information
• Find user - find user in the main window
• Delete post - delete selected post

Hot keys:

• F1 - Update

Channels

The channels form will open.

More about channels here.

Saved posts

This function requires cookies

Hash 2 and cookies required to download saved Instagram posts

Go to Settings - Settings - Reddit/Instagram/Twitter. Enter your username in the "Saved posts user" textbox. Click OK. Go to the main window.

This button looks like a bookmark. When you click on this button, a form for downloading saved posts will open. Saved posts are stored in the Reddit/Instagram/Twitter data path in the !Saved posts folder.

Download

• Download selected - start downloading one or more selected users.
• Download all: ATTENTION! THE BUTTONS IN THIS MENU DO NOT RESPECT VIEW MODES (SUCH AS LABELS AND/OR GROUPS), FILTERS, AND OTHER OPTIONS.!
  • Download all - Download all users marked Ready for download from all sites.
  • Download all site users - Download all users marked Ready for download from specific sites.
  • Download all FULL - Download all users from all sites. The Ready for download option will be ignored.
  • Download all site users FULL - Download all users from specific sites. The Ready for download option will be ignored.
  • Add a new download group - Create a new download group (read more here)
  • Automation - Automatic download settings (read more here
  • Pause automation - Pause the automation process. This allows you to pause the automation for a while. The pause will remain in effect until you press this button again or restart SCrawler.
• Download video - download a separate video (Reddit and Twitter videos supported) or Instagram post (photo and video).
• Stop - stop all download operations.

View

• View - users view modes.

  • The first block specifies how users will be displayed in the form.
    • Large/Small images - with icons.
    • List / Details - simple, without icons.
  • The second block specifies the user sites that will be displayed in the form.
    • All - default
    • Specific sites - select sites to be displayed
  • The third block specifies which users will be displayed in the form.
    • All - default.
    • Regular - only show users who are not marked as Favorite or Temporary.
    • Temporary - only show users marked as temporary.
    • Favorite - only show users marked as favorite.
    • Deleted - only show users whose profiles have been deleted
    • Suspended - only show users whose profiles have been suspended
    • Labels - show users labeled with one or more selected label
    • No Labels - only show users without a label
    • Excluded labels - exclude from displaying users with the selected labels (this is suitable for situations where you want to hide a user but don't want to delete)
    • Ignore excluded labels - Ignore excluding labels. This allows you to show users that should be excluded from display without resetting the current selection of excluded labels.
    • Show groups instead of labels - show sites groups instead of labels (when filtering users by labels)
  • The fourth block specifies the date range of the last download, whose users will be displayed in the form.
    • Limit dates (not in range) - filter users whose last download date is not in the selected date range
    • Limit dates (in range) - filter users whose last download date is in the selected date range

  

LOG

The error log will be opened by clicking on this button. The log contains program and download errors. The log is saved automatically when you close the program, but you still can save, copy, or clear it (using the special buttons on the log form) if you want...

Hot keys

• Insert - add user
• F3 - edit user
• F5 - start downloading one or more selected users
• F6 - start downloading all your users marked as Ready for download.
• F2 - download a separate video or Instagram post
• Del - delete one or more selected users

Double-click the user to open the content folder.

Download separate video

The download does not start automatically in this form

• Add - add one video or Instagram post to download.

• Add list - add one or more video URLs to download.

• Delete - remove URL.

• Download - download all videos you added.

• Open saving path - a folder will open where the videos are downloaded to.

  

Users list

Context menu

• Download data - download this user/collection data.
• Download data limited - download this user/collection data only the specified number of posts.
• Download data to the date - download this user/collection data up to selected date.
• Edit user information - open a form to change user parameters.
• Delete user/collection - delete one or more selected users/collections.
• Copy data to another folder - allows you to copy user data to another folder.
• Change favorite - if the user was marked as favorite, he becomes a regular; otherwise, he becomes the favorite.
• Change temporary - if the user was marked as temporary, he becomes a regular; otherwise, he becomes the temporary.
• Change ready for download - download this user in the operation Download all.
• Change labels - change user labels.
• Change script usage - change script usage for selected users.
• Add to collection - add user to collection.
• Merge collection files - move files to collection root folder.
• Change folder - change user data folder
• Change image - change user icon.
• Open contains folder - open selected user/collection folder.
• Open site - open user profile.
• Information - some user information.

Collections

I've developed collections for users with multiple profiles, but you can use them however you like.

To add a user to the collection, click Add to collection in the context menu. Add a new one by clicking the + button, or select an existing one.

When you add a user to a collection, the user's data will be moved to the collection folder with the name you specified.

Merging collection files

When you add a user to the collection, a new folder will be created in the collection folder named by pattern Site_UserName. That is, each profile in the collection is stored separately. When you merge, all files in the profiles' folders are moved to the root of the collection.

Deleting a collection

1. Select the collection you want to delete.
2. Click the Delete button or right-click on the collection and select Delete user / collection.
3. In the dialog box, click Delete button.
   • You will be prompted to delete the collection and all of its files:
     • Yes - The collection and all its files will be permanently deleted.
     • No - You will be prompted to split the collection.
       • Yes - The collection will be split: each user profile in the collection will be displayed as a separated profile (as is), and the collection will be deleted.
       • No - Cancel operation.

Collections example

You have two users: SomeUserName1 (from Reddit) and SomeUserName1 (from Twitter).

1. Creation of the "First collection" collection.
2. The folder "First collection" will be created in the collections folder (you specify it in the program settings).
3. The SomeUserName1 (Reddit) folder will be moved to the "First collection" folder and renamed to "Reddit_SomeUserName1".
4. The SomeUserName1 (Twitter) folder will be moved to the "First collection" folder and renamed to "Twitter_SomeUserName1".

If you want to merge the collection.

Files from the "Reddit_SomeUserName1" and "Twitter_SomeUserName1" folders will be moved to the "First collection" folder.

Black list

The program has the Black list, which included users you have added to. It is only a blacklist of the program and no impact on the site!

Users in this list will be skipped when downloading channels. If you add a new user to the program and this user is already blacklisted, you will receive a notification about. The notification includes the username and the reason (if specified) for deletion.

The program implements two ways to add users to this list:

• with a reason (you can specify the reason for the ban for cases if you try to add this user again);
• with no reason.