Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

IRX0662E error whiel reading flat filein REXX

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> CLIST & REXX
View previous topic :: :: View next topic  
Author Message
mosinjamadar

New User


Joined: 26 Sep 2007
Posts: 42
Location: pune

PostPosted: Mon Apr 06, 2009 5:56 pm    Post subject: IRX0662E error whiel reading flat filein REXX
Reply with quote

Hi all

I am getting IRX0662E error when reading a flat file which contains 10,000,000 records. Below is peace of code which i am using to read the file

"EXECIO * DISKR INDD (STEM NEWVAR."

error is
NO OF RECORDS
IRX0662E EXECIO error. Unable to obtain storage.

please help me out with any other way I can over come this

thanks
Back to top
View user's profile Send private message

enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10201
Location: italy

PostPosted: Mon Apr 06, 2009 6:00 pm    Post subject: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

already debated to death,
the EXCIO as coded will read into storage all the dataset records
for large number of records that' s the least You can expect

process them in chunks , search the forum for samples

another suggestion ...
review Your process and evaluate alternatives
for large datasets processing REXX is not the best tool around
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Mon Apr 06, 2009 6:05 pm    Post subject:
Reply with quote

Quote:
for large datasets processing REXX is not the best tool around

Very true. I usually cut out as much rubbish as possible from the input bt preprocessing with a SORT step. That way I only get the records and fields that I need. Makes it so much quicker.
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Mon Apr 06, 2009 8:48 pm    Post subject:
Reply with quote

Hello,

Quote:
for large datasets processing REXX is not the best tool around
My experience has this more strongly negative. . .

REXX may be the worst possible tool for processing large datasets" icon_evil.gif

There are just too many alternatives to the brute force reading of entire huge files in rexx. . .

As i've mentioned before, i suppose this is ok if your family has the mainframe hardware account. . .
Back to top
View user's profile Send private message
bala kalluri
Warnings : 1

New User


Joined: 08 Jan 2009
Posts: 21
Location: INDIA

PostPosted: Wed Apr 15, 2009 5:43 pm    Post subject: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

Even I'm facing the same problem, rexx isn't able to handle huge amounts of data.

Could you tell me, what alternate way have you chosen.
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Wed Apr 15, 2009 9:21 pm    Post subject:
Reply with quote

Hello,

Depending on what you want to do, you could use real code or possibly the sort product that is in use on your system.
Back to top
View user's profile Send private message
bala kalluri
Warnings : 1

New User


Joined: 08 Jan 2009
Posts: 21
Location: INDIA

PostPosted: Wed Nov 25, 2009 4:47 pm    Post subject: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

HI All,

I have huge number of data in a flat file.
My requirement is to find a particular string in the file.
IF i implement the logic of reading record one by one and searching for a particulart string, then its throwing "storage exhaust" problem.

If not rexx, is there any program in cobol which can help me out to find the record number which contains the searched string details.

Thanks,
Bala
Back to top
View user's profile Send private message
superk

Moderator Team Head


Joined: 26 Apr 2004
Posts: 4648
Location: Raleigh, NC, USA

PostPosted: Wed Nov 25, 2009 5:10 pm    Post subject: Re: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

bala kalluri wrote:
My requirement is to find a particular string in the file.


Why aren't you using a utility like sort (either DFSORT or Syncsort)?
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Wed Nov 25, 2009 5:34 pm    Post subject:
Reply with quote

or the 3 dot option searchfor?
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Wed Nov 25, 2009 5:37 pm    Post subject:
Reply with quote

Do you really mean reading "one by one" or do you mean trying to load a stem with the datset.

This has been discussed numerous times, and you can process the file into a stem in manageable segements, or you could (and most probably should) use your sort product to do this.
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Wed Nov 25, 2009 9:35 pm    Post subject: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

Probably, i oversimplfy, but ten million records should not be processed in rexx. . . icon_sad.gif

d
Back to top
View user's profile Send private message
bala kalluri
Warnings : 1

New User


Joined: 08 Jan 2009
Posts: 21
Location: INDIA

PostPosted: Mon Nov 30, 2009 7:45 pm    Post subject: Reply to: IRX0662E error whiel reading flat filein REXX
Reply with quote

I want read record line by line and to capture the one which satisfies my search criteria. I have huge number of records in range of 10-20 lakhs.
Reading records in stem variable will not help, it will throw storage exhausted error.

I cant use sort utility here, all records contains different data.
Back to top
View user's profile Send private message
expat

Global Moderator


Joined: 14 Mar 2007
Posts: 8593
Location: Back in jolly old England

PostPosted: Mon Nov 30, 2009 7:49 pm    Post subject:
Reply with quote

Please elaborate why you can not use sort to select only those records which contain the required string. Using the SS capabilities of DFSORT should not cause you any problems.

RECFM & LRECL of the input file, and possible positions of the required string.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Mon Nov 30, 2009 7:54 pm    Post subject:
Reply with quote

Quote:
I cant use sort utility here, all records contains different data


well, I would hope. why would you have 10-20 lakhs of the same record?
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> CLIST & REXX All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts S922 Error yuvan ABENDS & Debugging 3 Fri Dec 02, 2016 6:58 pm
No new posts Invoke Webservice Fails with DFHPI100... divated CICS 2 Thu Nov 24, 2016 5:57 pm
No new posts What is the command to check MODE of ... rohanthengal CLIST & REXX 6 Fri Nov 18, 2016 1:48 pm
This topic is locked: you cannot edit posts or make replies. Rexx to create GDG by scanning JJ result krish.deepu CLIST & REXX 5 Tue Oct 25, 2016 5:32 pm
No new posts How to delete second instance from Fl... Gunapala CN DFSORT/ICETOOL 6 Tue Oct 18, 2016 11:42 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us