Optimization Using Batch Pipes

pradeeph · New User Joined: 10 Nov 2006 Posts: 7

Hi,

I've a job with 4 steps. Each step feeds the subsequent step. We are planing to split the job into 4 different jobs(1 job for each step) and put 3 batch pipes between them. This will enable us to run the 4 steps in parallel hence reduce the time taken.

Could anyone help me out with the optimization techniques to be used in batchpipes between these jobs. Any material related to this would also help.

expat · Posted: Wed Aug 25, 2010 1:41 pm

The IBM website will almost certainly have all of the documentation that you require.

Also, does the job contain any sort steps.

dick scherrer · Posted: Wed Aug 25, 2010 7:27 pm

Hello,

Suggest you run the steps serially.

I believe you will find more problems than solutions doing this. . .

If you believe some elapsed time savings is needed, suggest the processes be changed to use less resources & take less time.

If someone has found a "solution" and is searching for a requirement, the time would be much better spend elsewhere. . .

pradeeph · New User Joined: 10 Nov 2006 Posts: 7

@Expat: Yes it has 3 sort steps and then a program.

expat · Posted: Fri Aug 27, 2010 11:22 am

Then batch pipes will be a complete waste of time.

How can you pass a sorted file from program to program until every last record has been processed by the sort step.

Also, I may be wrong but I believe that SORT will not write out any records until SORTIN has been fully processed, so the subsequent steps MUST wait until the conclusion of the preceeding sort steps.

Take a look at other ways to optimise this process.

pradeeph · New User Joined: 10 Nov 2006 Posts: 7

Thank you.