Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

FTP XML huge files to mainframe

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF
View previous topic :: :: View next topic  
Author Message
vishwanath001

New User


Joined: 06 Jun 2016
Posts: 2
Location: India

PostPosted: Mon Jun 06, 2016 8:21 pm    Post subject: FTP XML huge files to mainframe
Reply with quote

We are trying to FTP XML files to Mainframe server.The file size varies up to 15 GB

We are trying to use the below command

SITEENTRIES="UNIT=TAPE READTAPEFORMAT=V LRECL=32000 DATACLAS=EDC000EC LOCSITE PRI=128000 SEC=128000 CYLINDERS"

but the ftp fails with following error

451-File transfer failed. File contains records that are longer than the LRECL of the new file.
451 Transfer aborted due to file error. File is deleted.
421 Service not available, remote server has closed connection

Please help/guide to do ftp XML files to mainframe that can range up to 15 GB

code used :

ftp -D 3600 -v -n -i <server name>
user user id pwd
ascii
site "UNIT=TAPE READTAPEFORMAT=V LRECL=32756 DATACLAS=EDC000EC LOCSITE PRI=32760 SEC=32760 CYLINDERS"
put src file 'tgt file'

If there are any changes in code required or any other solution, please let us know

Please note this process is done for XML archival, we also need to retrieve archived mainframe File is same fashion whenever required
Back to top
View user's profile Send private message

Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7913
Location: Bellevue, IA

PostPosted: Mon Jun 06, 2016 10:08 pm    Post subject:
Reply with quote

What are you doing on the source machine to ensure that no record is longer than 32760 bytes? You ABSOLUTELY must put record terminators (CR/LF on Windows or LF on Unix) at intervals of no more than 32760 bytes to split the source file into records on the mainframe. You may have to have a corresponding process to recombine the records into one when retrieving the data from the mainframe. If you are going to disk, putting record terminators every 27996 or 27997 bytes (for Windows or Unix) would maximize disk space efficiency.

And what you posted doesn't really make sense -- UNIT=TAPE would not require any cylinders of space; if you use cylinders than TAPE is not an option. And 15 GB is about 19,176 cylinders at half-track blocking (the most efficient).
Back to top
View user's profile Send private message
vishwanath001

New User


Joined: 06 Jun 2016
Posts: 2
Location: India

PostPosted: Mon Jun 06, 2016 11:14 pm    Post subject:
Reply with quote

Thanks Robert for the clear explanation icon_smile.gif

Can you please share the sample code snippet which does the record splitting at the mainframe end and also which uses the cylinders with maximum efficiency as i 'm a novice to mainframe FTP'ing process


I appreciate your support on this

icon_rolleyes.gif
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7913
Location: Bellevue, IA

PostPosted: Mon Jun 06, 2016 11:42 pm    Post subject:
Reply with quote

Quote:
Can you please share the sample code snippet which does the record splitting at the mainframe end
I don't think you understand yet -- the data received in z/OS on the mainframe must have records no longer than 32760 bytes; you CANNOT convert it on the mainframe. I don't recall what the limit is for a Unix System Services file, but I suspect 15 GB might be over the limit. I don't know if your source machine is Unix or Windows, but you (or somebody) will have to write a program in the language of your choice to split the file into records BEFORE it is transferred to z/OS.

For a tape, 32760 bytes is most efficient as that's the longest block size you can use (barring special circumstances). For disk, half-track blocking is typically most efficient which is 27998 bytes.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts High CPU consumption Job using IAM fi... aswinir JCL & VSAM 8 Thu Dec 01, 2016 8:28 pm
This topic is locked: you cannot edit posts or make replies. Urgent Mainframe Requirments (2-10 yr... Shankar779 Mainframe Jobs 0 Sun Nov 27, 2016 1:48 pm
No new posts Match or compare two files in VB Format anatol DFSORT/ICETOOL 14 Thu Nov 03, 2016 7:41 pm
This topic is locked: you cannot edit posts or make replies. Mainframe Developer requirement in Ku... capricorn Mainframe Jobs 0 Sun Oct 23, 2016 3:49 pm
This topic is locked: you cannot edit posts or make replies. How to use 2 input files in control c... Gunapala CN DFSORT/ICETOOL 23 Thu Oct 13, 2016 3:42 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us