Performace in Extracting & Loading the Data

satyender · Posted: Sat Aug 09, 2008 3:48 am

Hi all,

At our shop, we need to extract(Unload) the data from production need to load in the test environment. (refreshment process). The thing is to unload few tables have abundant data about 760 million of rows and they are taking lot of time to extract or unload the data. Thats the reason, production services asks us to cancel or insists not to run the jobs in production. Had it been individual table we would have taken from the latest imagecopies, but sometimes we use joins or subqueries to unload the data. My question is, Is there any suggestions from your side to unload the data as fast as we can, like using the CLASS parameters TIME parameters or any other suggestions, so that the job should go fine without abending and should complete with in 1-3 hrs.

Thanks in advance to all.

***If you feel my question is not appropriate pls excuse me**

dick scherrer · Posted: Sat Aug 09, 2008 8:50 am

Hello,

This a decision for your management. If your process is one they choose to support, they will make additonal resources available or remove the time constraint because it is inconvenient to other processes.

The CLASS and TIME parameters almost certainly will not provide what you need. Actually, processing 700million+ rows with joins and subqueries may not be reasonable in a 1-3 hour window. How was this time figured?

You may need a production-size copy to work with for some amount of time. Then you could restore an image copy and not interfere with the production system.

As i mentoned before, this is a decison for your management.

satyender · Posted: Mon Aug 11, 2008 9:08 pm

Thanks dick scherrer a lot for ur suggestions.

dick scherrer · Posted: Mon Aug 11, 2008 9:40 pm

You're welcome - good luck

We would be interested to hear the outcome.

d

satyender · Posted: Mon Aug 11, 2008 11:52 pm

sure..I am working on that only.
I will update once i come out with an answer.