threaded sync?

Advertisement

kleach
Joined:
Posts:
6

threaded sync?

IS there a way to sync files from a remote directory tree to a local one with multiple threads instead of file by file? I am syncing over 25 directories containing over 90k files total. Mostly smaller image files (~20KB).. Is is slow going with a file by file approach... is there a way to thread it so I can use 10 connections or something to that effect? I know I could have one job per directory... I am looking for one command line that will thread it..

-Ken

Reply with quote

Advertisement

hoss
Joined:
Posts:
1
Location:
Earth

Re: threaded sync?

kleach wrote:

IS there a way to sync files from a remote directory tree to a local one with multiple threads instead of file by file? I am syncing over 25 directories containing over 90k files total. Mostly smaller image files (~20KB).. Is is slow going with a file by file approach... is there a way to thread it so I can use 10 connections or something to that effect? I know I could have one job per directory... I am looking for one command line that will thread it..

-Ken

I agree, this should be a thing. Maybe something like
-threads=N
or
-workers=N

Reply with quote

Advertisement

You can post new topics in this forum