Synchronize failing at 99% on large file

Advertisement

GreenWaterboy
Joined:
Posts:
1

Synchronize failing at 99% on large file

Hello

I have a script that executes the synchronize command to sync up a folder. I have been tinkering with it over 2 weeks changing timeout values and stuff and the script consistently will download all the small files, but fails at 99% when downloading the Large file (67 GB). If I do not manually delete the incomplete large file it will skip it the next to the script runs.

Here is my script

// Configuration
 
// Session to connect to
var SESSION = "";
// Path to winscp.com
var WINSCP = "C:\\WinSCP\\winscp.com";
 
var filesys = WScript.CreateObject("Scripting.FileSystemObject");
var shell = WScript.CreateObject("WScript.Shell");
   
var logfilepath = filesys.GetSpecialFolder(2) + "\\" + filesys.GetTempName() + ".xml";
 
var exec;
 
// run winscp to sync folders
exec = shell.Exec("\"" + WINSCP + "\" /log=\"" + logfilepath + "\"");
exec.StdIn.Write(
    "option batch abort\n" +
    "open \"" + SESSION + "\"\n" +
    "synchronize local -delete c:\localfolder /hostfolder \n" +
    "exit\n");
  
// wait until the script finishes
while (!exec.StdOut.AtEndOfStream)
{
    WScript.Echo(exec.StdOut.ReadAll());
}
 
if (exec.ExitCode != 0)
{
    WScript.Echo("Error downloading " + filenameLatest);
    WScript.Quit(1);
}

This is the output I am getting on the transfer for that file
'/hostfolder'  Synchronizing...  Local 'C:localfolder' <= Remote '/hostfolder'  bigfile.bigfile |   64756707 KiB |   70.8 KiB/s | binary |  99%  Lost connection.  12-29-12  07:48PM

I have other scripts that pull larger files down using a modified version of this script https://winscp.net/eng/docs/script_download_most_recent_file

I would like to keep using synchronize though because the folders contents are constantly changing and writing a script to synchronize it would be a pain.

Here is the information for the Host and Client

Host
------
IIS7 FTP
Windows Server 2008 R2

Client
-------
Windows Server 2008 R2
WinSCP version 5.1.2 (Build 2816) portable
File protocol: FTP
Encryption: SSL/TLS Implicit encryption
Connection: passive mode
Timeouts: 200 seconds
Keep Alives: Executing Dummy... 31 second (originally was off, turning it on didnt change anything)[/list][/code]

Reply with quote

Advertisement

martin
Site Admin
martin avatar
Joined:
Posts:
41,468
Location:
Prague, Czechia

Re: Synchronize failing at 99% on large file

Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you may email it to me. You will find my address (if you log in) in my forum profile. Please include link back to this topic in your email. Also note in this topic that you have emailed the log.

Reply with quote

JSMTNY
Joined:
Posts:
1
Location:
USA

Synchronize disconnect when uploading Large Files

I am having the same issue with sync of large files upload failure when reaching 99% progress
Script Used:

option batch abort
option confirm off
open ftp://<Server>:<Pwd>@<IP>
option transfer binary
synchronize -filemask="*.bak" -criteria=none -speed=600 remote "c:\backup\" "/Backup/"
close
exit


when reaching 99% winscp loose the connection, then retry to connect and report 100%
This happens on large files > 100mb

The FTP server used is QNAP Turbo NAS.

I use the console command line winscp.com version 3.2.1.2735 (provided with winscp 5.1.1)

Thank you,
john

Reply with quote

martin
Site Admin
martin avatar
Joined:
Posts:
41,468
Location:
Prague, Czechia

Re: Synchronize disconnect when uploading Large Files

The same response as above:
Please attach a full log file showing the problem (using the latest version of WinSCP).

To generate log file, use /log=path_to_log_file command-line argument. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you may email it to me. You will find my address (if you log in) in my forum profile. Please include link back to this topic in your email. Also note in this topic that you have emailed the log.

Reply with quote

Advertisement

You can post new topics in this forum