Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Omit condition for around 50000 records

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
PrachiSathe

New User


Joined: 26 Dec 2007
Posts: 2
Location: India

PostPosted: Thu Dec 27, 2007 11:42 am    Post subject: Omit condition for around 50000 records
Reply with quote

Hi,

I have around 50,000 records to be omitted from a reference file.
For eg, the SORT CARD is as below:
SORT FIELDS=(5,7,PD,A)
OMIT COND=(5,7,PD,EQ,2220000005647,
OR,5,7,PD,EQ,2220000005657,
OR,5,7,PD,EQ,2220000005668,
OR,5,7,PD,EQ,2220000005678,
OR,5,7,PD,EQ,2220000005689,
OR,5,7,PD,EQ,2220000005699..... count goes upto 50K

The reference file is a TAPE File and declared as VB.
Similary the output is a GDG , Tape file Declared as VB.

JCL for the above requirement goes as below,
(DCI0000),CIS,CLASS=T,MSGCLASS=X,NOTIFY=&SYSUID,
// REGION=0M
//STEP0010 EXEC PGM=SORT,
// PARM='HIPRMAX=OPTIMAL'
//SYSUDUMP DD SYSOUT=D
//SYSOUT DD SYSOUT=*
//SYSPRINT DD SYSOUT=*
//SORTIN DD DSN=CI.M204DEV3.CIVS9202.DATA.G0002V00,DISP=SHR -->Reference file (tape file)
//SORTOUT -->GDG version getting generated
// SORTWRK1 --> 12 SORTWRK files are used.
//SYSIN DD DSN=CI.M204DEV3.INCOR.FINALNS.NODUPFIL.SYSIN,DISP=SHR
--> this file contains the SORT CARD(example as above)
//*

Result for above execution:
THe job gets executed only for 500 (max) records, otherwise it gives an error TOO MANY OMIT CONDITIONS with MAxCC 16



-PrachiSathe
Back to top
View user's profile Send private message

enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10274
Location: italy

PostPosted: Thu Dec 27, 2007 11:50 am    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Wouldn' t it be more practical to use a simple 2 file match/nomatch approach ?

write the keys to be included/omitted to a dataset and search the forum for the classic 2 file match/nomatch problem

search the dfsort forum for samples
Back to top
View user's profile Send private message
PrachiSathe

New User


Joined: 26 Dec 2007
Posts: 2
Location: India

PostPosted: Thu Dec 27, 2007 11:59 am    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

That could have been the solution, but in this case the input file, TAPE FILE is huge with 150 million records.
With such scenario, will the two file comparison still work, & to add on, the TAPE file takes too much of time to read and compare.
Back to top
View user's profile Send private message
abhishekmdwivedi

New User


Joined: 22 Aug 2006
Posts: 95
Location: india

PostPosted: Thu Dec 27, 2007 12:20 pm    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Hi prachi,

Quote:

but in this case the input file, TAPE FILE is huge with 150 million records.
With such scenario, will the two file comparison still work, & to add on, the TAPE file takes too much of time to read and compare.


If a time is a constraint you may dump your tape file on faster disk drives
(through IEBGENER) and then apply match logic using ICETOOL. There are many examples in this forum (search the DFSORT forum for samples).
Back to top
View user's profile Send private message
enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10274
Location: italy

PostPosted: Thu Dec 27, 2007 12:26 pm    Post subject: Reply to: Omit condition for around 50000 records
Reply with quote

Quote:
but in this case the input file, TAPE FILE is huge with 150 million records.


If You are running a sort the tape will have to be read anyway...
it also depends whether the field used for the omit/include processing
is the sequence key or not ( it looks like it is !!!) and if the tape file is
already sorted on that key...

if the tape file is already sorted then there should be no performance issue
just make sure that the file used for the match is sorted
( not even the need to sort again, a straightt file match should be enough )
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Include/omit with "ALL" pa... mgl DFSORT/ICETOOL 6 Wed Jun 14, 2017 2:31 pm
This topic is locked: you cannot edit posts or make replies. Need help on If condition continuatio... ashok_uddaraju CLIST & REXX 4 Fri May 19, 2017 8:55 am
No new posts Check if any Detail records and extra... V S Amarendra Reddy SYNCSORT 19 Mon May 08, 2017 8:54 pm
No new posts Join giving more records than expected Danielle.Filteau SYNCSORT 2 Thu Mar 09, 2017 3:28 am
No new posts TSO or command line utility to genera... kishpra JCL & VSAM 3 Thu Mar 09, 2017 1:11 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us