Portal | Manuals | References | Downloads | Info | Programs | JCLs | Mainframe wiki | Quick Ref
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Profile Log in to check your private messages Log in
 
Help Need for Performance issue in SORT

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
Rajesh1979

New User


Joined: 24 Dec 2007
Posts: 9
Location: Chennai

PostPosted: Sat Apr 03, 2010 7:16 pm    Post subject: Help Need for Performance issue in SORT
Reply with quote

I have 8 input files concatenated and the below SORT is used for creating 3 different output files.

But the job is running for close to 6 minutes.

Input file might have records close to 28,000,000 records.

Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                         
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     


Is there any other way we can optimize the SORT and reduce the CPU time. Please suggest.
Back to top
View user's profile Send private message

dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Sat Apr 03, 2010 8:17 pm    Post subject:
Reply with quote

Hello,

6 minutes is not very long for 28 million records icon_confused.gif

Use INREC to eliminate all of the records that have neither T nor I in position 100 before sorting - inrec exclusions will not be sorted to be later discarded after the sort.

If you have DFSORT, Syncsort suggestions might not help you. If you have Syncsort, your topic needs to be relocated.
Back to top
View user's profile Send private message
Escapa

Senior Member


Joined: 16 Feb 2007
Posts: 1399
Location: IL, USA

PostPosted: Mon Apr 05, 2010 3:29 pm    Post subject:
Reply with quote

If count of discarded records is more then the overhead of sorting them can be reduced as Dick has mentioned.
Code:

  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,100,1,CH,EQ,C'I')
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                         
  OUTFIL FILES=02,INCLUDE=(100,1,CH,EQ,C'T',AND,                     
                         (101,1,CH,EQ,C'U',OR,101,1,CH,EQ,C'F'))
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,                     
                         57,3,CH,NE,C'NED')     
Back to top
View user's profile Send private message
Skolusu

Senior Member


Joined: 07 Dec 2007
Posts: 2205
Location: San Jose

PostPosted: Mon Apr 05, 2010 8:31 pm    Post subject: Reply to: Help Need for Performance issue in SORT
Reply with quote

Rajesh1979,

Ideally I would use these control cards
Code:

//SYSIN    DD *                                                   
  INCLUDE COND=(100,1,CH,EQ,C'T',OR,                               
                100,2,SS,EQ,C'TU,TF',OR,                           
               (100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED'))           
                                                                   
  SORT FIELDS=(9,9,CH,A,35,9,CH,A,48,1,CH,A)                       
                                                                   
  OUTFIL FILES=01,INCLUDE=(100,1,CH,EQ,C'T')                       
  OUTFIL FILES=02,INCLUDE=(100,2,SS,EQ,C'TU,TF')                   
  OUTFIL FILES=03,INCLUDE=(100,1,CH,EQ,C'I',AND,57,3,CH,NE,C'NED')
//*
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Difference in SORT & ICETOOL Mohan Kothakota DFSORT/ICETOOL 5 Fri Sep 22, 2017 4:56 pm
No new posts OC4 in SORT Mohan Kothakota DFSORT/ICETOOL 2 Tue Sep 12, 2017 6:30 pm
No new posts SORT Trailer Count - LRECL Output co... amorante DFSORT/ICETOOL 5 Tue Aug 29, 2017 8:57 pm
No new posts Changing sort Card Dynamically vickey_dw DFSORT/ICETOOL 5 Sat Aug 19, 2017 2:33 pm
No new posts SORT to unpack a feild shr_amar DFSORT/ICETOOL 7 Fri Jul 07, 2017 4:32 am

Facebook
Back to Top
 
Job Vacancies | Forum Rules | Bookmarks | Subscriptions | FAQ | Polls | Contact Us