Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Converting ICETOOL Job to DFSORT/ICEMAN

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL
View previous topic :: :: View next topic  
Author Message
prasun dhara

New User


Joined: 01 Mar 2008
Posts: 49
Location: kolkata

PostPosted: Fri Jul 08, 2011 10:52 am    Post subject: Converting ICETOOL Job to DFSORT/ICEMAN
Reply with quote

Hi,

I have a requirement to compare performance between ICETOOL and ICEMAN/DFSORT for a perticular SORT step

Now I have the SORT STEP which is using ICETOOL need to be converted to DFSORT step or ICEMAN step

//STEPXXX EXEC PGM=ICETOOL
//TOOLMSG DD SYSOUT=*
//DFSMSG DD SYSOUT=*
//INPUT1 DD DSN=FILE1,DISP=SHR
//INPUT2 DD DSN=FILE2,DISP=SHR
//OUTPUT DD DSN=FILE3,
// DISP=(MOD,CATLG,DELETE),
// RECFM=FB,LRECL=186,
// UNIT=SYSDA,SPACE=(TRK,(100,100),RLSE)
//TOOLIN DD *
COPY FROM(INPUT1) TO(OUTPUT) USING(CTL1)
COPY FROM(INPUT2) TO(OUTPUT) USING(CTL2)
/*
//CTL1CNTL DD *
SORT FIELDS=(11,1,CH,A,12,12,CH,A,24,1,CH,A,25,4,CH,A,
29,1,CH,A,30,4,CH,A)
OUTREC BUILD=(3,8,25,4,11,23,154X'41')
/*
//CTL2CNTL DD *
SORT FIELDS=(11,1,CH,A,12,12,CH,A,24,1,CH,A,25,4,CH,A,
29,1,CH,A,30,4,PD,A,34,1,CH,A,35,1,CH,A)
OUTREC BUILD=(3,8,25,4,11,174)
/*

Thanks
Back to top
View user's profile Send private message

vasanthz

Global Moderator


Joined: 28 Aug 2007
Posts: 1445
Location: Azeroth

PostPosted: Fri Jul 08, 2011 11:27 am    Post subject:
Reply with quote

Hello,

Have two sort steps, one with SYSIN
Code:
SORT FIELDS=(11,1,CH,A,12,12,CH,A,24,1,CH,A,25,4,CH,A,
29,1,CH,A,30,4,CH,A)
OUTREC BUILD=(3,8,25,4,11,23,154X'41')


and other with SYSIN
Code:
SORT FIELDS=(11,1,CH,A,12,12,CH,A,24,1,CH,A,25,4,CH,A,
29,1,CH,A,30,4,PD,A,34,1,CH,A,35,1,CH,A)
OUTREC BUILD=(3,8,25,4,11,174)


As far as I am aware, DFSORT and ICETOOL are the same,

Quote:
I have a requirement to compare performance between ICETOOL and ICEMAN/DFSORT for a perticular SORT step


I am almost sure that there will hardly any performance difference between DFSORT and ICETOOL for the above shown job.
Back to top
View user's profile Send private message
dbzTHEdinosauer

Global Moderator


Joined: 20 Oct 2006
Posts: 6966
Location: porcelain throne

PostPosted: Fri Jul 08, 2011 11:39 am    Post subject:
Reply with quote

Read about DFSORT Overview

and then about ICETOOL/DFSORT Relationship
Back to top
View user's profile Send private message
Bill Woodger

DFSORT Moderator


Joined: 09 Mar 2011
Posts: 7236

PostPosted: Fri Jul 08, 2011 2:17 pm    Post subject: Reply to: Converting ICETOOL Job to DFSORT/ICEMAN
Reply with quote

If you have to go to two steps, and then a third step to give you a single sorted output files, I'd put my money on the ICETOOL approach being quite a bit more effective.

You might be able to do the OUTREC processing on one step, if the records are identifiable to the particular input dataset, but I don't know if you can select the sort key to be different, so your output will not be the same.

Not sure why you want to even try this.
Back to top
View user's profile Send private message
prasun dhara

New User


Joined: 01 Mar 2008
Posts: 49
Location: kolkata

PostPosted: Fri Jul 08, 2011 5:39 pm    Post subject: Reply to: Converting ICETOOL Job to DFSORT/ICEMAN
Reply with quote

Thanks for the reply. Actually I am aware of this three step breakup.

But is it possible in single step in DFSORT ??
Back to top
View user's profile Send private message
Bill Woodger

DFSORT Moderator


Joined: 09 Mar 2011
Posts: 7236

PostPosted: Fri Jul 08, 2011 6:44 pm    Post subject: Reply to: Converting ICETOOL Job to DFSORT/ICEMAN
Reply with quote

The two sorts that you are doing are different. They are the same up to a point, then with the second file the list of key fields is longer. You are also sorting on PD vs CH. If you do either both on CH or both on PD you will get different order for your output. I can't tell you whether that difference is significant.

If you could use the same sort key for both datasets (remembering they are concatenated) and you can identify which dataset the current record is from then you would be able to do it in a single sort step.

I guess you have to try it and look at the output.

I still don't get the performance angle that you are looking at. If you do the above so you can see whether it works for your data, and then post answer plus volumes, I'm sure you can get some very professional answers to explain the timings, but it would help to know the reason you want to make the change.
Back to top
View user's profile Send private message
sqlcode1

Active Member


Joined: 08 Apr 2010
Posts: 578
Location: USA

PostPosted: Fri Jul 08, 2011 6:52 pm    Post subject:
Reply with quote

prasun dhara,
In your CTL1CNTL you are using BUILD to create output record of 189 bytes but then you are forcing LRECL to be 186... You need to change this so that output record is 186 bytes and is in sync with your JCL or probably don't use LRECL in JCL and let DFSort decide LRECL based on your sort card.

Regardless, you are using 154X'41', did you mean 154X'40'?
Code:
OUTREC BUILD=(3,8,25,4,11,23,154X'41')


Also for the 2 control cards, first you show 25 through 4 bytes as being sorted as CH and in the second card the same is sorted as being PD but then you select this field in the same output file. This doesn't seem correct.

From the performance point of view, please provide LRECL for both the input files. If LRECL is same for both the files, do they both use the same layout?

Thanks,
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Fri Jul 08, 2011 11:09 pm    Post subject:
Reply with quote

Quote:
Actually I am aware of this three step breakup.

But is it possible in single step in DFSORT ??


It would require two DFSORT steps, not three. But it can't be done in one DFSORT step because the SORT fields are different.

There should be no significant difference in performance between using two DFSORT steps or one ICETOOL step with two operators.
Back to top
View user's profile Send private message
prasun dhara

New User


Joined: 01 Mar 2008
Posts: 49
Location: kolkata

PostPosted: Sat Jul 09, 2011 10:17 am    Post subject:
Reply with quote

Frank Yaeger,

I have just tested and comapred the CPU time for 2 step DFSORT and 1 step ICETOOL method for our Test input file and found ICETOOL step is taking 6% less CPU.

Thanks
Prasun
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Mon Jul 11, 2011 10:39 pm    Post subject:
Reply with quote

Well, that doesn't really tell us anything since we don't know exactly what you did, or if you set up the jobs equivalently.

You would need to post the complete JES log from both runs in order for anyone to comment on whether what you're seeing is meaningful.
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 7913
Location: Bellevue, IA

PostPosted: Mon Jul 11, 2011 10:59 pm    Post subject:
Reply with quote

Quote:
I have just tested and comapred the CPU time for 2 step DFSORT and 1 step ICETOOL method for our Test input file and found ICETOOL step is taking 6% less CPU.
Another totally meaningless statement made by someone who does not understand what they are attempting to do. When you say "CPU time" -- do you mean TCB time? SRB time? combined TCB and SRB time? Did you look at the SMF data to get actual CPU usage, or are you using the numbers provided on the job listing? How much time are you talking about, any way? 6% of 1000 CPU seconds would be very different than 6% of 1 CPU seconds! From a system performance standpiont, you'd want to look at EXCP counts as well -- dropping CPU usage by 6% but having EXCP go up 600% might not work well in a site that is using a lot of channel capacity already.
Back to top
View user's profile Send private message
prasun dhara

New User


Joined: 01 Mar 2008
Posts: 49
Location: kolkata

PostPosted: Mon Jul 11, 2011 11:12 pm    Post subject: Reply to: Converting ICETOOL Job to DFSORT/ICEMAN
Reply with quote

Thank you very much Robert for your nice reply.

This percentage is calculated based on the "Total CPU time" displayed in the Job listing/Job log.

Entire job listing is not possible to post here.So, please let me know what are the values I should post so that performance issues can be discussed clearly.

Prasun
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Moderator


Joined: 15 Feb 2005
Posts: 7130
Location: San Jose, CA

PostPosted: Mon Jul 11, 2011 11:25 pm    Post subject:
Reply with quote

Quote:
Entire job listing is not possible to post here


Well, then how about sending it to me offline (yaeger@us.ibm.com)?

Quote:
So, please let me know what are the values I should post so that performance issues can be discussed clearly


Well, you can start by posting the SOURCE for your jobs (that is, complete JCL) as well as information about the files used (RECFM, LRECL, BLKSIZE, DSORG, number of records). That way, we can recreate what you did and see if it holds up.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DFSORT/ICETOOL All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts TOT & DATE parameter in ICEMAN hemanthj642 DFSORT/ICETOOL 4 Mon Nov 14, 2016 5:19 am
No new posts How to get the remainder and quotient... vnktrrd DFSORT/ICETOOL 2 Mon Oct 31, 2016 10:59 am
No new posts How to delete second instance from Fl... Gunapala CN DFSORT/ICETOOL 6 Tue Oct 18, 2016 11:42 pm
No new posts ICETOOL/SYNCSORT - SYSPRINT output nartcr DFSORT/ICETOOL 17 Wed Oct 05, 2016 10:46 pm
No new posts Change date (DD/MM/YY) in 2nd record ... uday kiran DFSORT/ICETOOL 12 Wed Sep 07, 2016 10:57 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us