View previous topic :: View next topic
|
Author |
Message |
vasanthz
Global Moderator
Joined: 28 Aug 2007 Posts: 1742 Location: Tirupur, India
|
|
|
|
Hi,
The tricks on the "SMART DFSORT TRICKS" document were really helpful. Thanks for putting all of them together.
I have a question regarding the Merging done using the splicing technique.
I have a requirement to merge two really big files. The merge condition is based on 2 key fields.
The two input files have roughly 5 fields and record length of 300 to 400.
For merging we have three options in our shop.
1) Using DB2 tables and then merging together using queries. And then write them to an external file.
2) Reading them into SAS databases and then merging using DATA step and then writing to external file.
3) Using DFsort merging technique.
Could you please tell me which technique is better so that the CPU usage is less.
Also could you please tell me which technique is optimum for ultilising less temp work space.
Also if it is not confidential.... "who wrote "SMART DFSORT TRICKS e-book???" |
|
Back to top |
|
|
Frank Yaeger
DFSORT Developer
Joined: 15 Feb 2005 Posts: 7129 Location: San Jose, CA
|
|
|
|
Quote: |
The tricks on the "SMART DFSORT TRICKS" document were really helpful. Thanks for putting all of them together |
You're welcome. I'm glad you find it helpful.
Quote: |
who wrote "SMART DFSORT TRICKS e-book???" |
I wrote that paper as well as the other papers (Ask Professor Sort, Beyond Sorting, etc) on the DFSORT website. Kolusu and others contributed some of the "Smart DFSORT Tricks".
Quote: |
Could you please tell me which technique is better so that the CPU usage is less.
Also could you please tell me which technique is optimum for ultilising less temp work space. |
The only way to find out for sure is to try all three techniques using your specific requirements and data, and compare the results. Anything else is just speculation. |
|
Back to top |
|
|
vasanthz
Global Moderator
Joined: 28 Aug 2007 Posts: 1742 Location: Tirupur, India
|
|
|
|
Thanks Frank,
Actually I did not know the technique to measure the CPU usage in the three techniques as I have only basic knowledge on DB2 and SAS.
I will try them out with and see wat happens.
Have not heard about Ask Professor Sort, Beyond Sorting. They sound interesting..will try them out.. |
|
Back to top |
|
|
|