IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

Will massive file definition impact CICS performance?


IBM Mainframe Forums -> CICS
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
dejunzhu

Active User


Joined: 08 May 2008
Posts: 390
Location: China

PostPosted: Fri Jan 11, 2013 6:54 am
Reply with quote

let's say we have over 30,000 tellers in my shop, and I want to define a ESDS file which is used to store log records for each teller, so, over 30,000 ESDS file will be defined into CICS.

I'm concerning about whether this will give impact to CICS performance?
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8700
Location: Dubuque, Iowa, USA

PostPosted: Fri Jan 11, 2013 8:47 am
Reply with quote

From the CICS V3.1 System Definition Guide manual:
Quote:
VSAM file limit
The number of VSAM files that can be allocated to a CICS address space is about 10000. However, VSAM maintains a table entry for each file actually opened, and table space limits the number of files opened to about 8189.
No performance impact since it is not possible to define 30000 VSAM ESDS files to a region.
Back to top
View user's profile Send private message
Bill O'Boyle

CICS Moderator


Joined: 14 Jan 2008
Posts: 2501
Location: Atlanta, Georgia, USA

PostPosted: Fri Jan 11, 2013 8:51 am
Reply with quote

30,000 Files icon_eek.gif icon_eek.gif icon_eek.gif A good example of a bad idea icon_rolleyes.gif
Back to top
View user's profile Send private message
enrico-sorichetti

Superior Member


Joined: 14 Mar 2007
Posts: 10886
Location: italy

PostPosted: Fri Jan 11, 2013 12:58 pm
Reply with quote

topic will be locked shortly to prevent further stupidity...

But really Your organization should consider hiring a properly skilled consultant !
Back to top
View user's profile Send private message
Bill Woodger

Moderator Emeritus


Joined: 09 Mar 2011
Posts: 7309
Location: Inside the Matrix

PostPosted: Fri Jan 11, 2013 2:39 pm
Reply with quote

There'd be TIOT size to consider as well, even if it were possible to get anywhere close to it.

And what would you do to process all of these in batch? 30,000 copies of each references in each piece JCL, one step running 30,000 times, or "dynamic allocation" with 30,000 datasets to really ensure that no-one can ever follow what is going on?

What problems have you come to in your design just using one file and a reference?
Back to top
View user's profile Send private message
Pete Wilson

Active Member


Joined: 31 Dec 2009
Posts: 590
Location: London

PostPosted: Fri Mar 01, 2013 7:57 pm
Reply with quote

I would assume a separate entry within the same ESDS for each individual teller, otherwise.....time fa coffee
Back to top
View user's profile Send private message
dejunzhu

Active User


Joined: 08 May 2008
Posts: 390
Location: China

PostPosted: Sat Mar 16, 2013 6:40 am
Reply with quote

Bill Woodger wrote:
There'd be TIOT size to consider as well, even if it were possible to get anywhere close to it.

I intend to save transaction runlog for each teller into a specific ESDS file, and these files are not meant to be processed by batch jobs, but just for reading when necessary.
As there would be over 30,000tellers, so, over 30,000 ESDS files should be defined in CICS...

Why do I want to save runlog of each teller into one file? If I don't choose this way, for massive transactions , ONE file will be too large for developers to read when problem occurs.

If there is a better solution, please advise. thanks.
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8700
Location: Dubuque, Iowa, USA

PostPosted: Sun Mar 17, 2013 5:13 am
Reply with quote

Quote:
As there would be over 30,000tellers, so, over 30,000 ESDS files should be defined in CICS...
Since this is not possible (see my quote from the IBM manual on Jan 10, 2013), there will be a better solution -- that is, a solution that will actually work since your proposed solution is not possible. Define one file per region, or one file per branch, but don't expect to define more than 30,000 files to a CICS region since that will not happen -- period.
Back to top
View user's profile Send private message
Bill Woodger

Moderator Emeritus


Joined: 09 Mar 2011
Posts: 7309
Location: Inside the Matrix

PostPosted: Sun Mar 17, 2013 5:42 am
Reply with quote

From your system design there will be a natural split that can be made for these log files. It will not be an individual level, it is also unlikely to be "everything jammed in one". Somewhere in between you will find the point where the log files will give you the most benefit. If those logs have no particular relevant content beyond the technical detail, then put the split at a level where the number of datasets involved can still be managed by humans, and nowhere near approaching any limits, and then write some stuff to give you the detailed information you need.

You will not have "developers" nosing around in Production log files (I hope). If you do, prepare to have your Audit department jump down your throats. If they don't, expect all types of scandal and corruption and incompetence with your data generally. If your system is not Auditable, then it will fall apart. If it is Auditable, then you don't consider doing things this way.

How you can continue on your original route having been shown it was not even possible, I don't know.
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19243
Location: Inside the Matrix

PostPosted: Mon Mar 18, 2013 7:37 am
Reply with quote

Hello,

Many of us have been following this effort for multiple years.

If/when this application ever goes live with the full compliment of users and data, we should prepare for the deluge of problem questions . . .

d
Back to top
View user's profile Send private message
Gary McDowell

Active User


Joined: 15 Oct 2012
Posts: 139
Location: USA

PostPosted: Tue Mar 19, 2013 3:12 am
Reply with quote

Quote:
I'm concerning about whether this will give impact to CICS performance?

Yes, it will cripple CICS. It will also cost the designer of this project his/her job. The person defining the 30,000 ESDS files will be happy. Let's see about 500-hours - yea, good small gig for a contract programmer.
Back to top
View user's profile Send private message
Bill O'Boyle

CICS Moderator


Joined: 14 Jan 2008
Posts: 2501
Location: Atlanta, Georgia, USA

PostPosted: Tue Mar 19, 2013 6:32 am
Reply with quote

Your TIOT draws 16-Bit storage from z/OS. For a TIOT with 30,000 files (which has been explained to you that this is not possible), you'd been playing with fire as you've also reduced the amount of DSA (16-Bit CICS storage) who also draws real storage from z/OS.

Conclusion: I don't believe you'd be able to start a region with such a huge amount of 16-Bit storage being taken from z/OS as well as a only a fraction of necessary shortage allocated to CICS/DSA. Remember, there are still many CICS Internal Modules, which require below-the-line storage. You'd wind up with an S80A abend and a U1800 (and no, that's not a submarine).

You need to get a group of savvy technicians together, draw pictures, order a couple of pizzas, submit opinions and keep doing this until you have a better plan.

Otherwise, you may want to consider getting your CV updated and circulated just prior to the attempted (bad idea) implementation and your all but inevitable demise. icon_eek.gif
Back to top
View user's profile Send private message
Anuj Dhawan

Superior Member


Joined: 22 Apr 2006
Posts: 6248
Location: Mumbai, India

PostPosted: Tue Mar 19, 2013 9:14 am
Reply with quote

Bill O'Boyle wrote:
a U1800 (and no, that's not a submarine).
See, I knew there would be someone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...! icon_biggrin.gif
Back to top
View user's profile Send private message
dejunzhu

Active User


Joined: 08 May 2008
Posts: 390
Location: China

PostPosted: Tue Mar 19, 2013 9:28 am
Reply with quote

Bill O'Boyle wrote:
Your TIOT draws 16-Bit storage from z/OS. For a TIOT with 30,000 files (which has been explained to you that this is not possible), you'd been playing with fire as you've also reduced the amount of DSA (16-Bit CICS storage) who also draws real storage from z/OS.

Conclusion: I don't believe you'd be able to start a region with such a huge amount of 16-Bit storage being taken from z/OS as well as a only a fraction of necessary shortage allocated to CICS/DSA. Remember, there are still many CICS Internal Modules, which require below-the-line storage. You'd wind up with an S80A abend and a U1800 (and no, that's not a submarine).

You need to get a group of savvy technicians together, draw pictures, order a couple of pizzas, submit opinions and keep doing this until you have a better plan.

Otherwise, you may want to consider getting your CV updated and circulated just prior to the attempted (bad idea) implementation and your all but inevitable demise. icon_eek.gif


sorry, but what is 'TIOT'? I googled, but no expected result returned.
Back to top
View user's profile Send private message
dejunzhu

Active User


Joined: 08 May 2008
Posts: 390
Location: China

PostPosted: Tue Mar 19, 2013 9:32 am
Reply with quote

Anuj Dhawan wrote:
Bill O'Boyle wrote:
a U1800 (and no, that's not a submarine).
See, I knew there would be someone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...! icon_biggrin.gif


I cannot get a clue on the connection between the topic and your comment...
What's your point?
Back to top
View user's profile Send private message
Nic Clouston

Global Moderator


Joined: 10 May 2007
Posts: 2454
Location: Hampshire, UK

PostPosted: Tue Mar 19, 2013 1:15 pm
Reply with quote

TIOT - loads of references if you google TIOT IBM including what TIOT is an acronym for on the results page.
Regarding:
Quote:
a U1800 (and no, that's not a submarine).
See, I knew there would be soeone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...!

that is some joking so you can ignore it (but not the U1800 - that is a real abend)
Back to top
View user's profile Send private message
Pete Wilson

Active Member


Joined: 31 Dec 2009
Posts: 590
Location: London

PostPosted: Tue Mar 19, 2013 1:31 pm
Reply with quote

Task I/O Table (aka (TIOT)

For every dataset you add to a job or started task, and for every volume that the dataset(s) reside on there's ~4kb of storage taken from the TIOT assigned to your job or task. The TIOT is limited in size depending on Z/OS level, so trying to add 30k files to your CICS region would blow up your TIOT well before it gets near 30k, let alone 10k files. I think max TIOT is around 64kb up until I think Z/OS 1.12 or 1.13 when XTIOT became available and extended the capacity of TIOT.

For the sake of your reputation look for a way of storing this data in as few datasets as technically possible. It doubt it will be a problem for you even if these files get quite large.
Back to top
View user's profile Send private message
Anuj Dhawan

Superior Member


Joined: 22 Apr 2006
Posts: 6248
Location: Mumbai, India

PostPosted: Tue Mar 19, 2013 2:46 pm
Reply with quote

Thanks Nic.

dejunzhu - please ignore my comment, it was for Bill, not for you.
Back to top
View user's profile Send private message
Garry Carroll

Senior Member


Joined: 08 May 2006
Posts: 1205
Location: Dublin, Ireland

PostPosted: Tue Mar 19, 2013 4:47 pm
Reply with quote

Why not include your teller-ids in the log records, have one huge ESDS to contain all these log records and use your SORT product in batch to extract the records for the teller-id(s) you're interested in?

Garry.
Back to top
View user's profile Send private message
dick scherrer

Moderator Emeritus


Joined: 23 Nov 2006
Posts: 19243
Location: Inside the Matrix

PostPosted: Wed Mar 20, 2013 12:30 am
Reply with quote

Hello,

Quote:
sorry, but what is 'TIOT'? I googled, but no expected result returned.
What did you expect? I got many hits . . .

Try searching for TIOT IBM. Or TASK INPUT OUTPUT TABLE.

Quote:
I cannot get a clue on the connection between the topic and your comment...
What's your point?
This was a bit of humor. What everyone is telling you is that this is a simply awful approach.

These kiinds of questions and misunderstanding ("cannot get a clue") demonstrate a considerable lack of technical depth.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> CICS

 


Similar Topics
Topic Forum Replies
No new posts Unable to interpret a hex value to De... COBOL Programming 4
No new posts Associating a USERID with a CICS-Libe... CICS 0
No new posts keylist key definition longer than 40... TSO/ISPF 2
No new posts omegamon for cics -UNSUPPORTED ENVIRO... CICS 2
No new posts Help needed in automation cics transa... CLIST & REXX 1
Search our Forums:

Back to Top