IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

How to import a large text file into mainframe thru FTP?


IBM Mainframe Forums -> All Other Mainframe Topics
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
Gopalakrishnan V

Active User


Joined: 28 Jun 2010
Posts: 102
Location: chennai

PostPosted: Tue Nov 23, 2010 4:29 pm
Reply with quote

Hi,

I want to import a large text file of having size about 1.5 GB with 300million records into mainframe thru FTP.

Please provide your inputs and suggessions.

Because I got some error messages as follow,


IKT00405I screen erasure caused by error recovery procedure
Back to top
View user's profile Send private message
enrico-sorichetti

Superior Member


Joined: 14 Mar 2007
Posts: 10872
Location: italy

PostPosted: Tue Nov 23, 2010 4:35 pm
Reply with quote

I really do not see how the IKt*** message could be related to FTP processing

talk to Your support about the FTP standards implemented in Your organization
( file sizes and friends )
Back to top
View user's profile Send private message
Rahul Agrawal

New User


Joined: 19 Jul 2010
Posts: 9
Location: Noida

PostPosted: Tue Nov 23, 2010 7:09 pm
Reply with quote

Please refer to the link:
www-01.ibm.com/support/docview.wss?uid=isg1OA01536
Back to top
View user's profile Send private message
enrico-sorichetti

Superior Member


Joined: 14 Mar 2007
Posts: 10872
Location: italy

PostPosted: Tue Nov 23, 2010 7:35 pm
Reply with quote

thanks for the effort,
but did You notice that the apar is a few years old (2003 )
and relates to an old ISPF version/release?
Back to top
View user's profile Send private message
Rahul Agrawal

New User


Joined: 19 Jul 2010
Posts: 9
Location: Noida

PostPosted: Tue Nov 23, 2010 7:37 pm
Reply with quote

Ah. I didn't noticed. Nice observation. icon_smile.gif[/quote]
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Tue Nov 23, 2010 10:09 pm
Reply with quote

Hello,

Quote:
I want to import a large text file of having size about 1.5 GB with 300million records into mainframe thru FTP.

Please provide your inputs and suggessions.
We routinely ftp files that are 9-12 gig with no problems. . .

If there is a problem with your environment, suggest you talk with your network management or storage management people to determine what you need to change.
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 2:04 pm
Reply with quote

1610612736 (1.5 GB) / 300.000.000 = 5,36870912

Now i would say thats a very strange record size.
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8696
Location: Dubuque, Iowa, USA

PostPosted: Wed Nov 24, 2010 4:29 pm
Reply with quote

There may be network or site restrictions on the transfer, but there is no reason that an FTP of 1.5 GB would fail due to TCP/IP or FTP. We FTP larger files every day in production so I know there's no problem due to the size of the file transfer.
Back to top
View user's profile Send private message
Gopalakrishnan V

Active User


Joined: 28 Jun 2010
Posts: 102
Location: chennai

PostPosted: Wed Nov 24, 2010 4:43 pm
Reply with quote

Hi,

I was done FTP successfully with 1.5 lac records in mainframe . But If i give more records ie 300million records it got FTP as follow,

Code:


D  10011200303-00020+00000-00020+00000102220101428         
.D  10011200323-00051+00000-00051+00000102220101428         
 .D  10011200337+00028+00000+00028+00000102220101428       
  .D  10011200360+00054+00003+00054+00000102220101428       
   .D  10011200384+00029+00000+00029+00000102220101428     
    .D  10011200394-00018+00000-00018+00000102220101428     
     .D  10011200395-00016+00000-00016+00000102220101428   
      .D  10011200407-00019+00000-00019+00000102220101428   
       .D  10011200473+00013+00000+00013+00000102220101428 
        .D  10011200493+00150+00005+00150+00000102220101428
         .D  10011200494+00000+00000+00000+00000102220101428
          .D  10011200495-00050+00000-00050+0000010222010142
8          .D  10011200496+00014+00000+00014+000001022201014
28          .D  10011200497-00016+00000-00016+00000102220101
428          .D  10011200500-00052+00000-00052+0000010222010
1428          .D  10011200506-00018+00000-00018+000001022201
01428          .D  10011200510-00019+00000-00019+00000102220
101428          .D  10011200518-00019+00000-00019+0000010222
0101428          .D  10011200519-00016+00000-00016+000001022
20101428          .D  10011200520+00070+00000+00070+00000102
220101428          .D  10011200521-00019+00000-00019+0000010
2220101428          .D  10011200522-00016+00000-00016+000001
02220101428          .D  10011200524-00018+00000-00018+00000
102220101428          .D  10011200550-00019+00000-00019+0000
0102220101428          .D  10011200567-00019+00000-00019+000
00102220101428          .D  10011200579-00018+00000-00018+00
000102220101428          .D  10011200586+00148+00005+00148+0
0000102220101428          .D  10011200587-00019+00000-00019+
00000102220101428          .D  10011200588-00050+00000-00050
+00000102220101428          .D  10011200589-00019+00000-0001
9+00000102220101428          .D  10011200590-00051+00000-000
51+00000102220101428          .D  10011200592+00013+00001+00





Please Give your inputs.
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8696
Location: Dubuque, Iowa, USA

PostPosted: Wed Nov 24, 2010 4:51 pm
Reply with quote

Is your FTP going to a previously allocated data set? Many times this type of stair stepping occurs when the LRECL of the dataset is not the same as the record length of the data being transferred.
Back to top
View user's profile Send private message
Gopalakrishnan V

Active User


Joined: 28 Jun 2010
Posts: 102
Location: chennai

PostPosted: Wed Nov 24, 2010 5:04 pm
Reply with quote

No it is not preallocated. But i mentioned in FTP options , LRECL as 60.

For 1 lac it processed correctly. Then also same set up i used.
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 6:20 pm
Reply with quote

Is this a double post ?

ibmmainframes.com/viewtopic.php?t=52261

What the hell is a "lac" ?

Are we talking sanskrit now?
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales

PostPosted: Wed Nov 24, 2010 6:29 pm
Reply with quote

Peter, you're showing your "lac" of knowledge there icon_lol.gif
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 6:52 pm
Reply with quote

expat wrote:
Peter, you're showing your "lac" of knowledge there icon_lol.gif


Expat, thats a nice one. The way you say it im shooting myself in the foot . icon_lol.gif
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8797
Location: Welsh Wales

PostPosted: Wed Nov 24, 2010 8:01 pm
Reply with quote

Peter, just so long as my foot is safe ..............................
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 8:04 pm
Reply with quote

expat wrote:
Peter, just so long as my foot is safe ..............................


I would never hurt you. icon_biggrin.gif
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Wed Nov 24, 2010 8:27 pm
Reply with quote

Quote:
Peter, just so long as my foot is safe ..............................

Better the foot than somewhat higher. . . icon_wink.gif
Back to top
View user's profile Send private message
Akatsukami

Global Moderator


Joined: 03 Oct 2009
Posts: 1788
Location: Bloomington, IL

PostPosted: Wed Nov 24, 2010 9:21 pm
Reply with quote

PeterHolland wrote:
Is this a double post ?

ibmmainframes.com/viewtopic.php?t=52261

What the hell is a "lac" ?

Are we talking sanskrit now?

Nope, Pali.

(A "lac" (also romanized as "lakh") is 100,000. Some of the people posting in these fora will also use "crore", 10,000,000, which is derived from Sanskrit.)
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 10:52 pm
Reply with quote

Akatsukami wrote:
PeterHolland wrote:
Is this a double post ?

ibmmainframes.com/viewtopic.php?t=52261

What the hell is a "lac" ?

Are we talking sanskrit now?

Nope, Pali.

(A "lac" (also romanized as "lakh") is 100,000. Some of the people posting in these fora will also use "crore", 10,000,000, which is derived from Sanskrit.)


Thank you so much for explaining, what i want to say is talk english how the hell is anyone to understand if i answer in my own language. Except of course some expats from Europe.
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen

PostPosted: Wed Nov 24, 2010 10:55 pm
Reply with quote

dick scherrer wrote:
Quote:
Peter, just so long as my foot is safe ..............................

Better the foot than somewhat higher. . . icon_wink.gif


Dick, im so sorry to tell you im one of those guys having 3 legs. icon_redface.gif
Back to top
View user's profile Send private message
Akatsukami

Global Moderator


Joined: 03 Oct 2009
Posts: 1788
Location: Bloomington, IL

PostPosted: Wed Nov 24, 2010 11:06 pm
Reply with quote

PeterHolland wrote:
Akatsukami wrote:
PeterHolland wrote:
Is this a double post ?

ibmmainframes.com/viewtopic.php?t=52261

What the hell is a "lac" ?

Are we talking sanskrit now?

Nope, Pali.

(A "lac" (also romanized as "lakh") is 100,000. Some of the people posting in these fora will also use "crore", 10,000,000, which is derived from Sanskrit.)


Thank you so much for explaining, what i want to say is talk english how the hell is anyone to understand if i answer in my own language. Except of course some expats from Europe.

"Lakh" and "crore" are English. Indian English, to be sure, but as has been said, English doesn't borrow words from other languages, it mugs them, drags them into dark alleys and rifles their pockets for vocabulary icon_lol.gif
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Thu Nov 25, 2010 12:39 am
Reply with quote

Hi Peter,

Quote:
Dick, im so sorry to tell you im one of those guys having 3 legs.


How did you lose the 4th leg . . . icon_rolleyes.gif

d
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> All Other Mainframe Topics

 


Similar Topics
Topic Forum Replies
No new posts How to split large record length file... DFSORT/ICETOOL 7
No new posts Extracting Variable decimal numbers f... DFSORT/ICETOOL 17
No new posts Mainframe openings in Techmahnidra fo... Mainframe Jobs 0
No new posts SFTP Issue - destination file record ... All Other Mainframe Topics 2
No new posts Access to non cataloged VSAM file JCL & VSAM 18
Search our Forums:

Back to Top