I've a job with 4 steps. Each step feeds the subsequent step. We are planing to split the job into 4 different jobs(1 job for each step) and put 3 batch pipes between them. This will enable us to run the 4 steps in parallel hence reduce the time taken.
Could anyone help me out with the optimization techniques to be used in batchpipes between these jobs. Any material related to this would also help.