Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Help Need for Performance issue in SORT

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
Rajesh1979

New User


Joined: 24 Dec 2007
Posts: 9
Location: Chennai

PostPosted: Sat Apr 03, 2010 7:16 pm    Post subject: Help Need for Performance issue in SORT
Reply with quote

I have 8 input files concatenated and the below SORT is used for creating 3 different output files.

But the job is running for close to 6 minutes.

Input file might have records close to 28,000,000 records.

Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                         
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     


Is there any other way we can optimize the SORT and reduce the CPU time. Please suggest.
Back to top
View user's profile Send private message

dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Sat Apr 03, 2010 8:17 pm    Post subject:
Reply with quote

Hello,

6 minutes is not very long for 28 million records icon_confused.gif

Use INREC to eliminate all of the records that have neither T nor I in position 100 before sorting - inrec exclusions will not be sorted to be later discarded after the sort.

If you have DFSORT, Syncsort suggestions might not help you. If you have Syncsort, your topic needs to be relocated.
Back to top
View user's profile Send private message
Escapa

Senior Member


Joined: 16 Feb 2007
Posts: 1399
Location: IL, USA

PostPosted: Mon Apr 05, 2010 3:29 pm    Post subject:
Reply with quote

If count of discarded records is more then the overhead of sorting them can be reduced as Dick has mentioned.
Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,100,1,CH,EQ,C'I')
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     
Back to top
View user's profile Send private message
Skolusu

Senior Member


Joined: 07 Dec 2007
Posts: 2205
Location: San Jose

PostPosted: Mon Apr 05, 2010 8:31 pm    Post subject: Reply to: Help Need for Performance issue in SORT
Reply with quote

Rajesh1979,

Ideally I would use these control cards
Code:

//SYSIN    DD *                                                   
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,                               
                100,2,SS,EQ,C'TU,TF',OR,                           
               (100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED'))           
                                                                   
  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                       
                                                                   
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                       
  OUTFIL FILES=02,INCLUDE=(100,2,SS,EQ,C'TU,TF')                   
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED')
//*
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Innovations in Your Mainframe Sort Arun Raj PC Guides & IT News 4 Wed Mar 15, 2017 10:38 pm
No new posts SORT VSAM file with each field one by... maxsubrat DFSORT/ICETOOL 6 Tue Mar 14, 2017 1:07 pm
No new posts SORT requirement sjiraga COBOL Programming 6 Thu Mar 09, 2017 9:11 pm
No new posts SORT to append Month and YEAR in MMYY... tisamf DFSORT/ICETOOL 1 Wed Mar 08, 2017 4:46 pm
No new posts JCL sort Match and NoMatch rakeshsekar1987 SYNCSORT 2 Thu Feb 02, 2017 10:26 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us