no support for files > 2 GB ?

Hi,

when I connect to a Unix-system and want to delete a folder with WinSCP 3.4.2 (Build 197) I get the following error message:

Command 'rm -f -r "db"'
failed with return code 1 and error message
rm: cannot remove `db/db.db': Value too large for defined data type
rm: cannot remove directory `db': File exists
rm: cannot remove directory `db': File exists.

The file db.db is greater than 2 GB. It's also not shown in the remote directory. It is also not recognized, when I select properties and calculate for a folder. I get the wrong size without the size of the big file.

Do you only support file systems with 32bit and not 64bit?
Could you please add support for files greater 2 GB in your future versions of WinSCP.

MfG

guest wrote:

Command 'rm -f -r "db"'
failed with return code 1 and error message
rm: cannot remove `db/db.db': Value too large for defined data type
rm: cannot remove directory `db': File exists
rm: cannot remove directory `db': File exists.

What does happen, if you type the command 'rm -f -r "db"' on command-line by yourself (from SSH terminal for example)? As you may see WinSCP in this case tries to delete the whole directory at once, leaving deletion of files in the directory to the server. It does not care about them, so it as well does not case that the file has > 2 GB.

The file db.db is greater than 2 GB. It's also not shown in the remote directory. It is also not recognized, when I select properties and calculate for a folder. I get the wrong size without the size of the big file.

This may be different case. Can you please post a WinSCP log file showing the directory listing of the respective directory?

guest wrote:

Command 'rm -f -r "db"'
failed with return code 1 and error message
rm: cannot remove `db/db.db': Value too large for defined data type
rm: cannot remove directory `db': File exists
rm: cannot remove directory `db': File exists.

What does happen, if you type the command 'rm -f -r "db"' on command-line by yourself (from SSH terminal for example)? As you may see WinSCP in this case tries to delete the whole directory at once, leaving deletion of files in the directory to the server. It does not care about them, so it as well does not case that the file has > 2 GB.

There aren't any problems when I delete the folder from a SSH terminal by rm -r -f db.db. I still think it's the filesize. The file isn't recognized, so the folder isn't empty and can't be deleted.

The file db.db is greater than 2 GB. It's also not shown in the remote directory. It is also not recognized, when I select properties and calculate for a folder. I get the wrong size without the size of the big file.

This may be different case. Can you please post a WinSCP log file showing the directory listing of the respective directory?

Here you have the log entry:

Getting size of directory "words"
Listing directory "words".
ls -la "words" ; echo "WinSCP: this is end-of-file:$?"
ls: words/db.db: Value too large for defined data type
total 1414694
drwxr-xr-x 2 af069 stud 512 Jan 18 15:55 .
drwxr-xr-x 7 af069 stud 512 Jan 18 16:07 ..
-rw-r----- 1 af069 stud 8192 Jan 18 13:37 __db.001
-rw-r----- 1 af069 stud 270336 Jan 18 13:37 __db.002
-rw-r----- 1 af069 stud 98304 Jan 18 13:37 __db.003
-rw-r----- 1 af069 stud 16384 Jan 18 13:37 __db.004
-rw-r----- 1 af069 stud 389464064 Jan 18 15:55 db.index_SENTENCE
-rw-r----- 1 af069 stud 1058062336 Jan 18 15:43 db.index_WORD
-rw-r----- 1 af069 stud 28621 Jan 18 15:55 log.0000001460
WinSCP: this is end-of-file:1

And for comparison the output from a SSH terminal for the same folder:

/users/database -> ls -la words
total 4079758
drwxr-xr-x 2 af069 stud 512 Jan 18 15:55 .
drwxr-xr-x 7 af069 stud 512 Jan 18 16:07 ..
-rw-r----- 1 af069 stud 8192 Jan 18 13:37 __db.001
-rw-r----- 1 af069 stud 270336 Jan 18 13:37 __db.002
-rw-r----- 1 af069 stud 98304 Jan 18 13:37 __db.003
-rw-r----- 1 af069 stud 16384 Jan 18 13:37 __db.004
-rw-r----- 1 af069 stud 2727677952 Jan 18 15:09 db.db
-rw-r----- 1 af069 stud 389464064 Jan 18 15:55 db.index_SENTENCE
-rw-r----- 1 af069 stud 1058062336 Jan 18 15:43 db.index_WORD
-rw-r----- 1 af069 stud 28621 Jan 18 15:55 log.0000001460

MfG

Anonymous wrote:

There aren't any problems when I delete the folder from a SSH terminal by rm -r -f db.db. I still think it's the filesize. The file isn't recognized, so the folder isn't empty and can't be deleted.

OK, maybe. But I believe it is not a problem of WinSCP. You can see in the log that WinSCP issues right command. I cannot do anything with the fact that your server cannot process it. Any idea?

Getting size of directory "words"
Listing directory "words".
ls -la "words" ; echo "WinSCP: this is end-of-file:$?"
ls: words/db.db: Value too large for defined data type
total 1414694

Same as above (rm). For some reason your server (shell) cannot work with >2GB files when WinSCP asks for it.

I've searched the google trying to find some solution. It seems that to work with files >2GB the special set of tools is required. So my idea is that either different shell or tools (which cannot work with >2GB) are used for WinSCP session and different shell/tools for your session with SSH terminal. It maybe issue of PATH configuration (it points somewhere else than for your regular SSH session). Is it possible?

You may also try SFTP instead of SCP if it helps.

Thank you for your tips. I found the problem. It was the server where I was logged in. I used different servers for my SSH terminal and WinSCP. I changed the server in WinSCP to the another one and than I could view and calculate the size of the 3GB file without any problems. So I think the removal of files will also work.

MfG

Hello

I'm having the same problem, and I can not change the server !!

What do you mean by 'special set of tools'? Putty does see the files., and I believe your program uses/needs it (sorry but I have not seen your code so I could know better).

Thank you in advance.

FMC

Anonymous wrote:

I'm having the same problem, and I can not change the server !!

What do you mean by 'special set of tools'? Putty does see the files., and I believe your program uses/needs it (sorry but I have not seen your code so I could know better).

What protocol? SCP or SFTP?
What do you mean by "Putty does see the files"? Putty is just SSH terminal, it does understand/interpret what it does see. Do you mean PSCP or PSFTP?

Hello

Thank you for your fast answer.

I changed the protocol to scp and I could see the missing files.

What I meant is that I supossed your were using some functionality from putty, not psftp. Psftp does no show the files neither, so you were rigth about different sessions.

Again, thank you very much for your help.