Forum » Scripting / Automation »

Post a reply

Options
Add an Attachment

If you do not want to add an Attachment to your Post, please leave the Fields blank.

(maximum 10 MB; please compress large files; only common media, archive, text and programming file formats are allowed)

Options

Topic review

hoss

Re: threaded sync?

kleach wrote:

IS there a way to sync files from a remote directory tree to a local one with multiple threads instead of file by file? I am syncing over 25 directories containing over 90k files total. Mostly smaller image files (~20KB).. Is is slow going with a file by file approach... is there a way to thread it so I can use 10 connections or something to that effect? I know I could have one job per directory... I am looking for one command line that will thread it..

-Ken


I agree, this should be a thing. Maybe something like 
-threads=N
or 
-workers=N
martin

Re: threaded sync?

WinSCP does not support that.
kleach

threaded sync?

IS there a way to sync files from a remote directory tree to a local one with multiple threads instead of file by file? I am syncing over 25 directories containing over 90k files total. Mostly smaller image files (~20KB).. Is is slow going with a file by file approach... is there a way to thread it so I can use 10 connections or something to that effect? I know I could have one job per directory... I am looking for one command line that will thread it..

-Ken

Documentation

Support

Associations

Follow Us