Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Omit condition for around 50000 records

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
PrachiSathe

New User


Joined: 26 Dec 2007
Posts: 2
Location: India

PostPosted: Thu Dec 27, 2007 11:42 am    Post subject: Omit condition for around 50000 records
Reply with quote

Hi,

I have around 50,000 records to be omitted from a reference file.
For eg, the SORT CARD is as below:
SORT FIELDS=(5,7,PD,A)
OMIT COND=(5,7,PD,EQ,2220000005647,
OR,5,7,PD,EQ,2220000005657,
OR,5,7,PD,EQ,2220000005668,
OR,5,7,PD,EQ,2220000005678,
OR,5,7,PD,EQ,2220000005689,
OR,5,7,PD,EQ,2220000005699..... count goes upto 50K

The reference file is a TAPE File and declared as VB.
Similary the output is a GDG , Tape file Declared as VB.

JCL for the above requirement goes as below,
(DCI0000),CIS,CLASS=T,MSGCLASS=X,NOTIFY=&SYSUID,
// REGION=0M
//STEP0010 EXEC PGM=SORT,
// PARM='HIPRMAX=OPTIMAL'
//SYSUDUMP DD SYSOUT=D
//SYSOUT DD SYSOUT=*
//SYSPRINT DD SYSOUT=*
//SORTIN DD DSN=CI.M204DEV3.CIVS9202.DATA.G0002V00,DISP=SHR -->Reference file (tape file)
//SORTOUT -->GDG version getting generated
// SORTWRK1 --> 12 SORTWRK files are used.
//SYSIN DD DSN=CI.M204DEV3.INCOR.FINALNS.NODUPFIL.SYSIN,DISP=SHR
--> this file contains the SORT CARD(example as above)
//*

Result for above execution:
THe job gets executed only for 500 (max) records, otherwise it gives an error TOO MANY OMIT CONDITIONS with MAxCC 16



-PrachiSathe
Back to top
View user's profile Send private message

enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10211
Location: italy

PostPosted: Thu Dec 27, 2007 11:50 am    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Wouldn' t it be more practical to use a simple 2 file match/nomatch approach ?

write the keys to be included/omitted to a dataset and search the forum for the classic 2 file match/nomatch problem

search the dfsort forum for samples
Back to top
View user's profile Send private message
PrachiSathe

New User


Joined: 26 Dec 2007
Posts: 2
Location: India

PostPosted: Thu Dec 27, 2007 11:59 am    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

That could have been the solution, but in this case the input file, TAPE FILE is huge with 150 million records.
With such scenario, will the two file comparison still work, & to add on, the TAPE file takes too much of time to read and compare.
Back to top
View user's profile Send private message
abhishekmdwivedi

New User


Joined: 22 Aug 2006
Posts: 95
Location: india

PostPosted: Thu Dec 27, 2007 12:20 pm    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Hi prachi,

Quote:

but in this case the input file, TAPE FILE is huge with 150 million records.
With such scenario, will the two file comparison still work, & to add on, the TAPE file takes too much of time to read and compare.


If a time is a constraint you may dump your tape file on faster disk drives
(through IEBGENER) and then apply match logic using ICETOOL. There are many examples in this forum (search the DFSORT forum for samples).
Back to top
View user's profile Send private message
enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10211
Location: italy

PostPosted: Thu Dec 27, 2007 12:26 pm    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Quote:
but in this case the input file, TAPE FILE is huge with 150 million records.


If You are running a sort the tape will have to be read anyway...
it also depends whether the field used for the omit/include processing
is the sequence key or not ( it looks like it is !!!) and if the tape file is
already sorted on that key...

if the tape file is already sorted then there should be no performance issue
just make sure that the file used for the match is sorted
( not even the need to sort again, a straightt file match should be enough )
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Removing Duplicates based on certain ... chandracdac DFSORT/ICETOOL 8 Fri Dec 09, 2016 4:40 am
No new posts Limit duplicate records in the SORT pshongal SYNCSORT 6 Mon Nov 21, 2016 12:54 pm
This topic is locked: you cannot edit posts or make replies. How to pass the previous month date i... Suganya87 DFSORT/ICETOOL 5 Mon Oct 31, 2016 4:13 pm
No new posts How to split the records using the am... vnktrrd DFSORT/ICETOOL 24 Fri Oct 28, 2016 7:33 pm
No new posts Sort records based on numeric field. Alks SYNCSORT 2 Wed Oct 19, 2016 10:14 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us