IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

Sort Merge tune performance


IBM Mainframe Forums -> DFSORT/ICETOOL
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Fri Jul 27, 2012 8:40 pm
Reply with quote

Hello,

If there are 50,000 new adds per day and the file keeps data for 120 days, how are there 35million records? At 50,000 a day, this would be about 1.5 million per month which would be less than 7million for 120 days would it not?

Yes, IAM is not the same as VSAM - program code will work as though it is VSAM, but the underlying mechanics are quite different.

I still don't understand why this needs to be one huge file. As requested earlier, please post how/when this history data is used.

Also when each monthly is run, how are the "old" records removed from the file. Hopefully, they are not just "marked" as deleted and are actually removed.
Back to top
View user's profile Send private message
enrico-sorichetti

Superior Member


Joined: 14 Mar 2007
Posts: 10873
Location: italy

PostPosted: Fri Jul 27, 2012 9:11 pm
Reply with quote

Quote:
It is a KSDS VSAM but out DASD Manager asked us to use IAM as the owner which helps in compression.

plain horse manure ....

defining $IAM as the owner makes the <thing> a IAM object

as described here ....

www.fdr.com/products/iam/pdf/IAMRec_772011.pdf

so we are just wasting time trying to help using the wrong/untold/told too late assumptions/premises
Back to top
View user's profile Send private message
Skolusu

Senior Member


Joined: 07 Dec 2007
Posts: 2205
Location: San Jose

PostPosted: Fri Jul 27, 2012 11:12 pm
Reply with quote

divya_maddi wrote:
bufferspace is BUFFERSPACE(24576) for all our VSAM file definitions both input and output.


Well Your sysout shows that is NOT the case. Read my earlier post about CISIZE.

Do a LISTCAT on all the vsam CLUSTERS and see the CISIZE value.

Oh well as enrico pointed out, may be you should asking FDR tuning tips.
Back to top
View user's profile Send private message
divya_maddi

New User


Joined: 03 Nov 2005
Posts: 33

PostPosted: Fri Jul 27, 2012 11:42 pm
Reply with quote

50,000 a day is an average (more recent average) - it might go higher than that. But we currently have the total at 35 million for 120 days. Old records are removed each day with the sort I already gave in the beginning. Mentioning again for you reference:

INCLUDE=(23,10,CH,GE,DATE1(-)-120)
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix

PostPosted: Sat Jul 28, 2012 1:50 am
Reply with quote

Hello,

Quote:
But we currently have the total at 35 million for 120 days.
How? This is almost 6 times the expected volume . . . Adctually, this would average 291666.6666666667 per day for 120 days. . .

Are you sure there is an understanding as to just what is in this file?

Does any of this relate to the newly acquired company?

I believe you are getting as good performance as you can given the process is running the way it is. Until we (at least i) understand this a bit better, it may be tough to offer other suggestions.
Back to top
View user's profile Send private message
Pete Wilson

Active Member


Joined: 31 Dec 2009
Posts: 582
Location: London

PostPosted: Wed Sep 19, 2012 3:34 pm
Reply with quote

May be worth looking at some of the IAM tuning options that can be modified through the //IAMOVRID DD * when you define the VSAM file, and also check that the Global Options are set to optimal values.

Add the //IAMINFO DD SYSOUT=* which will produce a report with useful information about the file and how it is used.

Innovation also recommend defining IAM files are Large Format by coding DSNTYPE=LARGE in a Create Override.

Contacting Innovation may be worthwhile as well.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> DFSORT/ICETOOL Goto page 1, 2  Next

 


Similar Topics
Topic Forum Replies
No new posts Need to set RC4 through JCL SORT DFSORT/ICETOOL 5
No new posts How to split large record length file... DFSORT/ICETOOL 10
No new posts JCL sort card - get first day and las... JCL & VSAM 9
No new posts Sort First/last record of a subset th... DFSORT/ICETOOL 7
No new posts Merge two VSAM KSDS files into third ... JCL & VSAM 6
Search our Forums:

Back to Top