Delays when synchronizing large directory
I'm using a WinSCP.com command line script for FTP with /ini=nul and synchronize commands to update my local directories to match the remote server. For example:
option batch continue
synchronize -transfer=binary -criteria=time -delete local plotworld plotworld
Now I understand WinSCP has to go through the entire directory tree to compare files to see what to do. Some of the subdirectories have ~2000 files in them, so that takes time. But once the transfers of the modified files start and WinSCP goes to one of these large directories, it just sits there for about 10 seconds before downloading the first file. I suspect it's re-reading the directory contents before starting the transfer. Is this really necessary? Can I turn off the second reading of the directories?
option batch continue
synchronize -transfer=binary -criteria=time -delete local plotworld plotworld
Now I understand WinSCP has to go through the entire directory tree to compare files to see what to do. Some of the subdirectories have ~2000 files in them, so that takes time. But once the transfers of the modified files start and WinSCP goes to one of these large directories, it just sits there for about 10 seconds before downloading the first file. I suspect it's re-reading the directory contents before starting the transfer. Is this really necessary? Can I turn off the second reading of the directories?