Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

File Contention Ideas (Batch & Fileaid/File Manager)
Goto page 1, 2  Next
 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> SYNCSORT
View previous topic :: :: View next topic  
Author Message
jpdeshai

New User


Joined: 24 Jun 2007
Posts: 57
Location: US

PostPosted: Sat Mar 22, 2014 3:29 am    Post subject: File Contention Ideas (Batch & Fileaid/File Manager)
Reply with quote

Hi,

Need some advise/ideas on below issue.
During batch process window, if someone is holding a file in FileAid/FMgr the jobs get abended due to contention.

Trying to find a way to scan thru the list of file contenstions (Ex: Starting ABCD.SYS.*) and USER IDs which are holding the files. This information can be used to free the files before starting the batch.

Appreciate any ideas!!

Thanks & Regards,
DJ
Back to top
View user's profile Send private message

Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Sat Mar 22, 2014 4:39 am    Post subject:
Reply with quote

You can see more here,

http://www.ibmmainframes.com/about53352.html
Back to top
View user's profile Send private message
Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Sat Mar 22, 2014 5:40 am    Post subject:
Reply with quote

Control the EDIT access to individuals RACF ID's and create a one time job to do so. and then set a negative dependency between each other.
Back to top
View user's profile Send private message
steve-myers

Active User


Joined: 30 Nov 2013
Posts: 461
Location: The Universe

PostPosted: Sat Mar 22, 2014 8:10 am    Post subject: Re: File Contention Ideas (Batch & Fileaid/File Manager)
Reply with quote

jpdeshai wrote:
... During batch process window, if someone is holding a file in FileAid/FMgr the jobs get abended due to contention.
  • If there is a data set usage problem, one of the jobs is delayed. If it is canceled, it is being done manually by operators.
  • While I hate to advertise any CA product, the CA-MIM product will notify a TSO user holding a data set required by a batch job.
  • While a scheduler could, in theory, detect a TSO user or another batch job holding a data set required for a batch job it wants to submit, in practice this is not possible; the scheduler would have to know, in detail, the data sets required for the batch job.
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2422
Location: Netherlands, Amstelveen

PostPosted: Sat Mar 22, 2014 2:30 pm    Post subject:
Reply with quote

The billion euro question is :

why are production datasets in use by FileAid?

I wouldnt want my financial data being processed by a company like this.
Back to top
View user's profile Send private message
dick scherrer

Site Director


Joined: 23 Nov 2006
Posts: 19270
Location: Inside the Matrix

PostPosted: Sun Mar 23, 2014 7:52 am    Post subject:
Reply with quote

Hello,

Quote:
•If there is a data set usage problem, one of the jobs is delayed. If it is canceled, it is being done manually by operators.
Or possibly by an Automation process that is triggered by the message to prevent this. However I believe the "holder" should be terminated, not the production job trying to allocate the dataset.

As Peter mentions, why are production dataset being "held" by FileAid?
Back to top
View user's profile Send private message
Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Sun Mar 23, 2014 1:55 pm    Post subject:
Reply with quote

It need not necessary to be production datasets, so it could be for test regions and mock up files.
Back to top
View user's profile Send private message
PeterHolland

Global Moderator


Joined: 27 Oct 2009
Posts: 2422
Location: Netherlands, Amstelveen

PostPosted: Sun Mar 23, 2014 2:27 pm    Post subject: Reply to: File Contention Ideas (Batch & Fileaid/File Ma
Reply with quote

Rohit, you could be right. About that I couldnt care less, in bad test environments everybody is bumping into each other.
In the good ones, this problem wouldnt probably exist. In production it
is forbidden. At least that is my almost 40 year experience.
Back to top
View user's profile Send private message
jpdeshai

New User


Joined: 24 Jun 2007
Posts: 57
Location: US

PostPosted: Sun Mar 23, 2014 3:18 pm    Post subject:
Reply with quote

It can be for production or test region...
Most of the times people forget batch window and they just keep browsing the files or they leave the session active go home which takes some time to close.
Any of these May cause batch issues.Ian just thinking of running an utility and send out an email so that they come out before batch.that's my idea.
Back to top
View user's profile Send private message
jpdeshai

New User


Joined: 24 Jun 2007
Posts: 57
Location: US

PostPosted: Sun Mar 23, 2014 3:20 pm    Post subject:
Reply with quote

Some kind of Rexx tool similar ISGECMON
Back to top
View user's profile Send private message
Nic Clouston

Global Moderator


Joined: 10 May 2007
Posts: 1716
Location: UK

PostPosted: Sun Mar 23, 2014 4:51 pm    Post subject: Reply to: File Contention Ideas (Batch & Fileaid/File Ma
Reply with quote

Remove access to production data from all but production IDs. If people need to see a production dataset they can ask for a job to be scheduled that will copy the dataset, after management sign-off, - possibly into a dasd pool that gets emptied every day.

Also, anyone leaving for the day and not terminating their session should themselves be terminated as a securty risk.
Back to top
View user's profile Send private message
Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Sun Mar 23, 2014 8:37 pm    Post subject:
Reply with quote

Peter, Right, I agree.

You may look here,

http://ibmmainframes.com/about54914.html

However, why does developers and testers have access to production and mock up file's? And even if it is required it must be given for a day with proper approvals. If this is not in place then none of us or any tool can help you to what you are trying to achieve here.

only production support people can have access to all the files pertaining to all the applications they are supporting.

Also, let's assume you have some tool which lets user know to free some datasets before batch starts and what if again someone locks it during batch window ? How would you control this?
Back to top
View user's profile Send private message
Terry Heinze

JCL Moderator


Joined: 14 Jul 2008
Posts: 1238
Location: Richfield, MN, USA

PostPosted: Mon Mar 24, 2014 7:18 pm    Post subject:
Reply with quote

PeterHolland wrote:
The billion euro question is :

why are production datasets in use by FileAid?

I wouldnt want my financial data being processed by a company like this.
Some shops allow File-AID batch programs in the production JCL. That's one possibility.
Back to top
View user's profile Send private message
enrico-sorichetti

Global Moderator


Joined: 14 Mar 2007
Posts: 10202
Location: italy

PostPosted: Mon Mar 24, 2014 7:23 pm    Post subject: Reply to: File Contention Ideas (Batch & Fileaid/File Ma
Reply with quote

Quote:
Some shops allow File-AID batch programs in the production JCL. That's one possibility.

not a problem with that,
but then there should be NO CONTENTION, unless the job scheduling was FUBAR
Back to top
View user's profile Send private message
Ed Goodman

Active Member


Joined: 08 Jun 2011
Posts: 556
Location: USA

PostPosted: Mon Mar 24, 2014 8:49 pm    Post subject:
Reply with quote

Our backups need exclusive access. Even if someone at the help desk is browsing a database, it messes up batch.

Another problem we've had is long running test jobs with production load libraries concatenated. That messes with the pre-promote backups.

We WERE having trouble with long running data extracts from production, but it finally got to the point where they had to forbid those. They just make a frequent copy of the databases to a read-only set and we have to use those.
Back to top
View user's profile Send private message
Ed Goodman

Active Member


Joined: 08 Jun 2011
Posts: 556
Location: USA

PostPosted: Mon Mar 24, 2014 8:52 pm    Post subject:
Reply with quote

Sorry...to answer the original question...I used a program out on the CBT tape called 'whohas' that runs an enqueue scan on datasets. I made wrappers for it and it comes in very handy for preventing trouble like this.

For our test batches, a batch version checks for people in the database, and ends with a condition code 8 if it finds anyone. We can then ask them to get out and rerun the job. Once it finishes ok, the rest of the batch keeps going. This has saved a LOT of batch backouts and broken schedules.

Are you looking for something like that? I still have the source code!
Back to top
View user's profile Send private message
jpdeshai

New User


Joined: 24 Jun 2007
Posts: 57
Location: US

PostPosted: Tue Mar 25, 2014 8:10 am    Post subject:
Reply with quote

Hi Ed Goodman,

Yes, I am looking similar to that. Could you be kind enough to share the code?

There are lot of reasons why we have access. I just need some utility which I can run before my batch starts and find out if any file is locked. (Is it 100% proof? may not be!!! but upto somelevel icon_smile.gif)
Back to top
View user's profile Send private message
steve-myers

Active User


Joined: 30 Nov 2013
Posts: 461
Location: The Universe

PostPosted: Tue Mar 25, 2014 9:15 am    Post subject:
Reply with quote

jpdeshai wrote:
... There are lot of reasons why we have access. I just need some utility which I can run before my batch starts and find out if any file is locked. (Is it 100% proof? may not be!!! but upto somelevel icon_smile.gif)
No, it is not 100% "proof." The allocation may be a fraction of a second after the scan was performed.
Back to top
View user's profile Send private message
Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Tue Mar 25, 2014 10:54 am    Post subject:
Reply with quote

You may also wants to look at

http://pic.dhe.ibm.com/infocenter/zos/v1r12/index.jsp?topic=%2Fcom.ibm.zos.r12.f54pc00%2Fsnitb.htm

Also, it looks like your shop does look secured the way you are described accesses given to individuals and these tools may give you ID's to let them come out of the file but there is no assurance of having great success over contention.
Back to top
View user's profile Send private message
Rohit Umarjikar

Senior Member


Joined: 21 Sep 2010
Posts: 1610
Location: NY,USA

PostPosted: Tue Mar 25, 2014 11:51 am    Post subject:
Reply with quote

I meant..
Quote:

Also, it looks like your shop does NOT look secured the way you are described accesses given to individuals and these tools may give you ID's to let them come out of the file but there is no assurance of having great success over contention.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> SYNCSORT All times are GMT + 6 Hours
Goto page 1, 2  Next
Page 1 of 2

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Add PD field from 2nd file to PD in 1st Sushant Garje DFSORT/ICETOOL 6 Thu Dec 01, 2016 4:32 pm
No new posts How does a called pgm know if its cal... Graeme Westerman COBOL Programming 4 Tue Nov 29, 2016 9:25 pm
No new posts File Aid to File Manager conversion murali3955 IBM Tools 4 Thu Nov 24, 2016 3:41 pm
No new posts How to convert the VBM file to VB or... Sulabh Agrawal JCL & VSAM 4 Fri Nov 18, 2016 1:04 pm
No new posts CICS Roll back partially - Need to re... dwijadas CICS 4 Wed Nov 16, 2016 4:30 pm


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us