Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Help Need for Performance issue in SORT

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
Rajesh1979

New User


Joined: 24 Dec 2007
Posts: 9
Location: Chennai

PostPosted: Sat Apr 03, 2010 7:16 pm    Post subject: Help Need for Performance issue in SORT
Reply with quote

I have 8 input files concatenated and the below SORT is used for creating 3 different output files.

But the job is running for close to 6 minutes.

Input file might have records close to 28,000,000 records.

Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                         
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     


Is there any other way we can optimize the SORT and reduce the CPU time. Please suggest.
Back to top
View user's profile Send private message

dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Sat Apr 03, 2010 8:17 pm    Post subject:
Reply with quote

Hello,

6 minutes is not very long for 28 million records icon_confused.gif

Use INREC to eliminate all of the records that have neither T nor I in position 100 before sorting - inrec exclusions will not be sorted to be later discarded after the sort.

If you have DFSORT, Syncsort suggestions might not help you. If you have Syncsort, your topic needs to be relocated.
Back to top
View user's profile Send private message
Escapa

Senior Member


Joined: 16 Feb 2007
Posts: 1399
Location: IL, USA

PostPosted: Mon Apr 05, 2010 3:29 pm    Post subject:
Reply with quote

If count of discarded records is more then the overhead of sorting them can be reduced as Dick has mentioned.
Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,100,1,CH,EQ,C'I')
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     
Back to top
View user's profile Send private message
Skolusu

Senior Member


Joined: 07 Dec 2007
Posts: 2205
Location: San Jose

PostPosted: Mon Apr 05, 2010 8:31 pm    Post subject: Reply to: Help Need for Performance issue in SORT
Reply with quote

Rajesh1979,

Ideally I would use these control cards
Code:

//SYSIN    DD *                                                   
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,                               
                100,2,SS,EQ,C'TU,TF',OR,                           
               (100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED'))           
                                                                   
  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                       
                                                                   
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                       
  OUTFIL FILES=02,INCLUDE=(100,2,SS,EQ,C'TU,TF')                   
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED')
//*
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts How to change 'K' or 'M' use Sort vice_versa DFSORT/ICETOOL 5 Thu May 18, 2017 7:11 am
No new posts Adding big TEXT lines to each record ... bshkris SYNCSORT 4 Sat May 06, 2017 1:40 am
No new posts Issue with NDM process to transmit ES... chetanambi All Other Mainframe Topics 6 Wed May 03, 2017 10:52 am
This topic is locked: you cannot edit posts or make replies. SORT trick needed bshkris SYNCSORT 6 Tue May 02, 2017 4:35 am
No new posts SORT JSON type of data maxsubrat DFSORT/ICETOOL 8 Wed Apr 19, 2017 6:01 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us