Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

FTP data truncate problem

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> All Other Mainframe Topics
View previous topic :: :: View next topic  
Author Message
AJAYREDDY

New User


Joined: 17 Feb 2007
Posts: 47
Location: USA

PostPosted: Wed Mar 23, 2011 9:07 pm    Post subject: FTP data truncate problem
Reply with quote

I am GETing .TXT file from non-mainframe server to Mainframe using JCL. I am able to successfully retrieve (GET) 4 .TXT files from the server. These are having less than 50000 records.

But one of the file which contains around 4 to 5 million records is not creating the file properly. It is FB 404 .TXT file. I am using TAPE file to retrieve data. After running the JCL it is creating VB 256 with below FTP log even though I am creating FB 404 Tape file. Did anyone get similar problem? Why Data is getting truncated?

226 File transfer completed successfully.
EZA1617I 1909582801 bytes transferred in 761.990 seconds.
EZA2802I Data was truncated.
EZA1460I Command:
EZA1736I quit
EZA1701I >>> QUIT
221 QUIT subcommand received.

Thanks
Back to top
View user's profile Send private message

Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7931
Location: Bellevue, IA

PostPosted: Wed Mar 23, 2011 9:17 pm    Post subject:
Reply with quote

Is the file preallocated before the FTP step runs?
If not, do you have LOCSITE values for RECFM LRECL BLKSIZE?
If not, your results would not be unusual as the IBM default is for FTP to use RECFM=VB, LRECL=256 if there's no other source of DCB data (although this can be overridden by your site in the TCP PARMS for FTP). You can confirm this by using QUOTE LOCSTAT in your FTP commands to see what values FTP defaults to.
Back to top
View user's profile Send private message
AJAYREDDY

New User


Joined: 17 Feb 2007
Posts: 47
Location: USA

PostPosted: Wed Mar 23, 2011 11:01 pm    Post subject: Reply to: FTP data truncate problem
Reply with quote

Yes the file is preallocated before the FTP runs. I asked non-mainframe people to reduce the file size to 10000 records and run FTP step again. This time it worked creating FB 404 without any truncation. I am still trying to figure out whether FTP can handle millions of records at a time or not.
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7931
Location: Bellevue, IA

PostPosted: Wed Mar 23, 2011 11:30 pm    Post subject:
Reply with quote

We run -- daily -- over 13 GB of data through FTP (that total is for sending and receiving) and peak at over 30 GB in a day. I have monthly processes where I'm downloading from a server and uploading to a mainframe 6 to 8 GB in a day. One of those files has just over 2 million records. So if FTP is set up at your site correctly, the number of records is not a concern.

However, you may have to work with your site support group to resolve network issues -- often there are limits inside the network on traffic and those limits, not any issue with FTP, can cause the FTP to fail. They may also need to tweak some of the FTP default settings.
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Thu Mar 24, 2011 1:16 am    Post subject: Reply to: FTP data truncate problem
Reply with quote

I'll bet that there's a record in the source file that's longer than the specified LRECL.
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Thu Mar 24, 2011 1:22 am    Post subject: Reply to: FTP data truncate problem
Reply with quote

I don't understand. Can the FTP process really override values specified in the JCL for the RECFM, LRECL, and BLKSIZE?
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7931
Location: Bellevue, IA

PostPosted: Thu Mar 24, 2011 1:29 am    Post subject:
Reply with quote

Kevin, you can specify these values on the LOCSITE or SITE commands in FTP. Since FTP is a running program, the values specified in the FTP should override the JCL values as documented in the JCL manual. I'm not sure I've tested this specific scenario, though.
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Thu Mar 24, 2011 1:40 am    Post subject: Reply to: FTP data truncate problem
Reply with quote

Don't know for a 100% sure. The documentation DOES state:

Quote:

When a data set is allocated using a ddname and the DCB information is needed before open, the FTP client must be able to find the DCB information on the DD statement that was used to allocate the data set.

DCB attributes for a ddname allocation are acquired using the attributes or data set name specified in the DD statement DCB parameter. See the z/OS MVS JCL Reference for restrictions on using backward references in the DCB parameter.

If the DD statement refers to a cataloged DASD data set, any DCB attributes that are not specified are retrieved from the DSCB. DCB attributes on the DD statement that override those found in the DSCB, except that LRECL=0 and BLKSIZE=0 do not override a different value in the DSCB.

If the DD statement refers to a tape data set that is to be opened for input (PUT //DD:), the record format that is specified on the DD statement is used instead of the READTAPEFormat setting. If no record format (RECFM) is specified on the DD statement, the READTAPEFormat setting (if any) is used.

Once the data set is opened by FTP, its attributes are set using the data returned in the DCB by open.
Back to top
View user's profile Send private message
AJAYREDDY

New User


Joined: 17 Feb 2007
Posts: 47
Location: USA

PostPosted: Thu Mar 24, 2011 8:56 pm    Post subject: FTP data truncate problem
Reply with quote

Thank you guys. I will work with FTP folks and find out information. I will update any findings later.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> All Other Mainframe Topics All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Storing huge volume of data, compare ... Pradeep K M All Other Mainframe Topics 3 Mon Jan 16, 2017 5:08 pm
No new posts how to recover an uncataloged VSAM da... archanamuthukrishnan All Other Mainframe Topics 3 Wed Jan 11, 2017 6:18 pm
No new posts HALDB data refresh/copy from producti... vineetanand2007 IMS DB/DC 0 Mon Jan 02, 2017 11:16 am
No new posts SYMNAMES problem jacobdng DFSORT/ICETOOL 7 Thu Dec 22, 2016 7:47 am
No new posts JES2 JEC: Use UNIX Pipes to Pass Data... Virendra Shambharkar JCL & VSAM 21 Tue Dec 20, 2016 6:55 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us