Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

FTP size limit error called 'Broken Pipe'

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM
View previous topic :: :: View next topic  
Author Message
morpheus007

New User


Joined: 27 Dec 2005
Posts: 58

PostPosted: Wed Sep 12, 2007 3:46 pm    Post subject: FTP size limit error called 'Broken Pipe'
Reply with quote

We are trying to extract large VSAM files to flat files and then ftp them to another server.We are facing issues with large files in this.
At exactly 1073741312 bytes the ftp fails and gives an error called 'Broken Pipe'.When I convert this to GB's it comes to about 1GB.Is there any such limit on the size of the file that can be transfered.
Back to top
View user's profile Send private message

mkk157

Active User


Joined: 17 May 2006
Posts: 310

PostPosted: Wed Sep 12, 2007 4:32 pm    Post subject: FTP
Reply with quote

Ur assumption may also be right.

Besides that, there is a chance of violation from the file server that u r trying to FTP. Admin is the right person to answer this query. Ask him the Configuration details .

And let us know the final solution for this.
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Wed Sep 12, 2007 4:57 pm    Post subject: Re: FTP size limit
Reply with quote

morpheus007 wrote:
Is there any such limit on the size of the file that can be transfered.


Not from the z/OS point of view. However, as mkk157 already mentioned, it may be very possible that there is a limit on the server side.
Back to top
View user's profile Send private message
diwa_thilak

Active User


Joined: 13 Jul 2006
Posts: 205
Location: At my desk

PostPosted: Wed Sep 12, 2007 5:04 pm    Post subject: Reply to: FTP size limit
Reply with quote

Hi,

May be i can throw some light with respect to my project.

Actually there are many parameters with respect to transmitting a file in Mainframe.

Once such thing is the connection parameter, the destination server sets al imit for the transmission (i.e data connection). If the particular transmission takes more time this data connection will be closed and control connection will be used to exit the server resulting in Broken pipe error.

In that case, you may need to speak to the N/w team to decide about the transmission time (or) spilit the file and transmit them.

Hope i made it clear to you.

Note :

I beleive a compression utility is also available. May be you can check this option as well.

Cheers,
Diwakar

-------------------------
Nobody is Perfect. I am Nobody
Back to top
View user's profile Send private message
stodolas

Active Member


Joined: 13 Jun 2007
Posts: 632
Location: Wisconsin

PostPosted: Wed Sep 12, 2007 11:30 pm    Post subject:
Reply with quote

I have transferred files up to 11GB from the mainframe. If I am doing it via JCL, then if the job doesn't get any CPU time for longer than the timeout interval, I get the broken pipe error. But since your is always failing at exactly the same size, I assume you have tried running the job at different times of the day.

Note: Compression will not help much in transfer time. An uncompress text file will transfer at extremely high speeds because of the built in compression. But if you zip the file, you will get slower speeds. Your times should be comparable. Try it sometime, take a huge uncompressed file and send it via FTP, look at your k/s speed. Then compress it and try the same, your speed should be lower.
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Wed Sep 12, 2007 11:56 pm    Post subject: Reply to: FTP size limit error called 'Broken Pipe'
Reply with quote

Interesting. That's exactly opposite how it used to be when using an SNA network connection.
Back to top
View user's profile Send private message
stodolas

Active Member


Joined: 13 Jun 2007
Posts: 632
Location: Wisconsin

PostPosted: Thu Sep 13, 2007 12:01 am    Post subject:
Reply with quote

My tests were non-mainframe FTP quite a while ago over 14.4 modems to sites with upload ratios. I don't know if it has changed, I probably shouldn't have mentioned information that is 10 years old...
Back to top
View user's profile Send private message
diwa_thilak

Active User


Joined: 13 Jul 2006
Posts: 205
Location: At my desk

PostPosted: Thu Sep 13, 2007 12:51 pm    Post subject:
Reply with quote

Kevin,

Can you throw some light about the SNA network connection ?

How it handles the FTP process ?

Is my assumption/explanation about FTP file transfer is right ?

Thanks,
Diwakar

-------------------------------
Nobody is Perfect. I am Nobody
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> JCL & VSAM All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts IMS T-Pipe queue counts in a COBOL Pr... Siva NKK Kothamasu IMS DB/DC 0 Tue May 09, 2017 6:31 pm
No new posts Getting error while opening a variabl... apandey1 COBOL Programming 5 Fri May 05, 2017 12:22 pm
No new posts To find out size allocated to a seque... ashek15 JCL & VSAM 15 Thu Apr 27, 2017 9:42 am
No new posts IDC2902I Error tzeche ABENDS & Debugging 2 Tue Mar 28, 2017 11:39 am
No new posts Need help with below DB2 error ashek15 DB2 3 Sat Mar 18, 2017 5:56 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us