View previous topic :: View next topic
|
Author |
Message |
dejunzhu
Active User
Joined: 08 May 2008 Posts: 390 Location: China
|
|
|
|
let's say we have over 30,000 tellers in my shop, and I want to define a ESDS file which is used to store log records for each teller, so, over 30,000 ESDS file will be defined into CICS.
I'm concerning about whether this will give impact to CICS performance? |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8700 Location: Dubuque, Iowa, USA
|
|
|
|
From the CICS V3.1 System Definition Guide manual:
Quote: |
VSAM file limit
The number of VSAM files that can be allocated to a CICS address space is about 10000. However, VSAM maintains a table entry for each file actually opened, and table space limits the number of files opened to about 8189. |
No performance impact since it is not possible to define 30000 VSAM ESDS files to a region. |
|
Back to top |
|
|
Bill O'Boyle
CICS Moderator
Joined: 14 Jan 2008 Posts: 2501 Location: Atlanta, Georgia, USA
|
|
|
|
30,000 Files A good example of a bad idea |
|
Back to top |
|
|
enrico-sorichetti
Superior Member
Joined: 14 Mar 2007 Posts: 10888 Location: italy
|
|
|
|
topic will be locked shortly to prevent further stupidity...
But really Your organization should consider hiring a properly skilled consultant ! |
|
Back to top |
|
|
Bill Woodger
Moderator Emeritus
Joined: 09 Mar 2011 Posts: 7309 Location: Inside the Matrix
|
|
|
|
There'd be TIOT size to consider as well, even if it were possible to get anywhere close to it.
And what would you do to process all of these in batch? 30,000 copies of each references in each piece JCL, one step running 30,000 times, or "dynamic allocation" with 30,000 datasets to really ensure that no-one can ever follow what is going on?
What problems have you come to in your design just using one file and a reference? |
|
Back to top |
|
|
Pete Wilson
Active Member
Joined: 31 Dec 2009 Posts: 592 Location: London
|
|
|
|
I would assume a separate entry within the same ESDS for each individual teller, otherwise.....time fa coffee |
|
Back to top |
|
|
dejunzhu
Active User
Joined: 08 May 2008 Posts: 390 Location: China
|
|
|
|
Bill Woodger wrote: |
There'd be TIOT size to consider as well, even if it were possible to get anywhere close to it.
|
I intend to save transaction runlog for each teller into a specific ESDS file, and these files are not meant to be processed by batch jobs, but just for reading when necessary.
As there would be over 30,000tellers, so, over 30,000 ESDS files should be defined in CICS...
Why do I want to save runlog of each teller into one file? If I don't choose this way, for massive transactions , ONE file will be too large for developers to read when problem occurs.
If there is a better solution, please advise. thanks. |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8700 Location: Dubuque, Iowa, USA
|
|
|
|
Quote: |
As there would be over 30,000tellers, so, over 30,000 ESDS files should be defined in CICS... |
Since this is not possible (see my quote from the IBM manual on Jan 10, 2013), there will be a better solution -- that is, a solution that will actually work since your proposed solution is not possible. Define one file per region, or one file per branch, but don't expect to define more than 30,000 files to a CICS region since that will not happen -- period. |
|
Back to top |
|
|
Bill Woodger
Moderator Emeritus
Joined: 09 Mar 2011 Posts: 7309 Location: Inside the Matrix
|
|
|
|
From your system design there will be a natural split that can be made for these log files. It will not be an individual level, it is also unlikely to be "everything jammed in one". Somewhere in between you will find the point where the log files will give you the most benefit. If those logs have no particular relevant content beyond the technical detail, then put the split at a level where the number of datasets involved can still be managed by humans, and nowhere near approaching any limits, and then write some stuff to give you the detailed information you need.
You will not have "developers" nosing around in Production log files (I hope). If you do, prepare to have your Audit department jump down your throats. If they don't, expect all types of scandal and corruption and incompetence with your data generally. If your system is not Auditable, then it will fall apart. If it is Auditable, then you don't consider doing things this way.
How you can continue on your original route having been shown it was not even possible, I don't know. |
|
Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006 Posts: 19243 Location: Inside the Matrix
|
|
|
|
Hello,
Many of us have been following this effort for multiple years.
If/when this application ever goes live with the full compliment of users and data, we should prepare for the deluge of problem questions . . .
d |
|
Back to top |
|
|
Gary McDowell
Active User
Joined: 15 Oct 2012 Posts: 139 Location: USA
|
|
|
|
Quote: |
I'm concerning about whether this will give impact to CICS performance? |
Yes, it will cripple CICS. It will also cost the designer of this project his/her job. The person defining the 30,000 ESDS files will be happy. Let's see about 500-hours - yea, good small gig for a contract programmer. |
|
Back to top |
|
|
Bill O'Boyle
CICS Moderator
Joined: 14 Jan 2008 Posts: 2501 Location: Atlanta, Georgia, USA
|
|
|
|
Your TIOT draws 16-Bit storage from z/OS. For a TIOT with 30,000 files (which has been explained to you that this is not possible), you'd been playing with fire as you've also reduced the amount of DSA (16-Bit CICS storage) who also draws real storage from z/OS.
Conclusion: I don't believe you'd be able to start a region with such a huge amount of 16-Bit storage being taken from z/OS as well as a only a fraction of necessary shortage allocated to CICS/DSA. Remember, there are still many CICS Internal Modules, which require below-the-line storage. You'd wind up with an S80A abend and a U1800 (and no, that's not a submarine).
You need to get a group of savvy technicians together, draw pictures, order a couple of pizzas, submit opinions and keep doing this until you have a better plan.
Otherwise, you may want to consider getting your CV updated and circulated just prior to the attempted (bad idea) implementation and your all but inevitable demise. |
|
Back to top |
|
|
Anuj Dhawan
Superior Member
Joined: 22 Apr 2006 Posts: 6248 Location: Mumbai, India
|
|
|
|
Bill O'Boyle wrote: |
a U1800 (and no, that's not a submarine). |
See, I knew there would be someone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...! |
|
Back to top |
|
|
dejunzhu
Active User
Joined: 08 May 2008 Posts: 390 Location: China
|
|
|
|
Bill O'Boyle wrote: |
Your TIOT draws 16-Bit storage from z/OS. For a TIOT with 30,000 files (which has been explained to you that this is not possible), you'd been playing with fire as you've also reduced the amount of DSA (16-Bit CICS storage) who also draws real storage from z/OS.
Conclusion: I don't believe you'd be able to start a region with such a huge amount of 16-Bit storage being taken from z/OS as well as a only a fraction of necessary shortage allocated to CICS/DSA. Remember, there are still many CICS Internal Modules, which require below-the-line storage. You'd wind up with an S80A abend and a U1800 (and no, that's not a submarine).
You need to get a group of savvy technicians together, draw pictures, order a couple of pizzas, submit opinions and keep doing this until you have a better plan.
Otherwise, you may want to consider getting your CV updated and circulated just prior to the attempted (bad idea) implementation and your all but inevitable demise. |
sorry, but what is 'TIOT'? I googled, but no expected result returned. |
|
Back to top |
|
|
dejunzhu
Active User
Joined: 08 May 2008 Posts: 390 Location: China
|
|
|
|
Anuj Dhawan wrote: |
Bill O'Boyle wrote: |
a U1800 (and no, that's not a submarine). |
See, I knew there would be someone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...! |
I cannot get a clue on the connection between the topic and your comment...
What's your point? |
|
Back to top |
|
|
Nic Clouston
Global Moderator
Joined: 10 May 2007 Posts: 2454 Location: Hampshire, UK
|
|
|
|
TIOT - loads of references if you google TIOT IBM including what TIOT is an acronym for on the results page.
Regarding:
Quote: |
a U1800 (and no, that's not a submarine).
See, I knew there would be soeone who'd agree -- I told my land-lord that RENT is a compiler option for COBOL, but...! |
that is some joking so you can ignore it (but not the U1800 - that is a real abend) |
|
Back to top |
|
|
Pete Wilson
Active Member
Joined: 31 Dec 2009 Posts: 592 Location: London
|
|
|
|
Task I/O Table (aka (TIOT)
For every dataset you add to a job or started task, and for every volume that the dataset(s) reside on there's ~4kb of storage taken from the TIOT assigned to your job or task. The TIOT is limited in size depending on Z/OS level, so trying to add 30k files to your CICS region would blow up your TIOT well before it gets near 30k, let alone 10k files. I think max TIOT is around 64kb up until I think Z/OS 1.12 or 1.13 when XTIOT became available and extended the capacity of TIOT.
For the sake of your reputation look for a way of storing this data in as few datasets as technically possible. It doubt it will be a problem for you even if these files get quite large. |
|
Back to top |
|
|
Anuj Dhawan
Superior Member
Joined: 22 Apr 2006 Posts: 6248 Location: Mumbai, India
|
|
|
|
Thanks Nic.
dejunzhu - please ignore my comment, it was for Bill, not for you. |
|
Back to top |
|
|
Garry Carroll
Senior Member
Joined: 08 May 2006 Posts: 1205 Location: Dublin, Ireland
|
|
|
|
Why not include your teller-ids in the log records, have one huge ESDS to contain all these log records and use your SORT product in batch to extract the records for the teller-id(s) you're interested in?
Garry. |
|
Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006 Posts: 19243 Location: Inside the Matrix
|
|
|
|
Hello,
Quote: |
sorry, but what is 'TIOT'? I googled, but no expected result returned. |
What did you expect? I got many hits . . .
Try searching for TIOT IBM. Or TASK INPUT OUTPUT TABLE.
Quote: |
I cannot get a clue on the connection between the topic and your comment...
What's your point? |
This was a bit of humor. What everyone is telling you is that this is a simply awful approach.
These kiinds of questions and misunderstanding ("cannot get a clue") demonstrate a considerable lack of technical depth. |
|
Back to top |
|
|
|