Portal | Manuals | References | Downloads | Info | Programs | JCLs | Mainframe wiki | Quick Ref
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Profile Log in to check your private messages Log in
 
Generating test Data by Recursive SQL

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DB2
View previous topic :: :: View next topic  
Author Message
Jimy Carol

New User


Joined: 31 Aug 2012
Posts: 25
Location: Australia

PostPosted: Thu Dec 26, 2013 3:00 pm    Post subject: Generating test Data by Recursive SQL
Reply with quote

Hello ,

I need to create massive test data for a DB2 table (more than 1 billion) with 5 columns . Is using a recursive SQL is good idea . I heard that it should not used for generating huge data. Could someone guide me as the pros and cons of using recursive SQL to genrate test data , here is the sql i am trying to use :

WITH NUMBERS (LEVEL, NEXTONE) AS
(
SELECT 1, 1
FROM SYSIBM.SYSDUMMY1
UNION ALL
SELECT LEVEL +1, LEVEL +1
FROM NUMBERS
WHERE LEVEL < 1000000
)
SELECT NEXTONE
FROM NUMBERS
ORDER BY NEXTONE


Regards
carol
Back to top
View user's profile Send private message

Bill Woodger

DFSORT Moderator


Joined: 09 Mar 2011
Posts: 7314

PostPosted: Thu Dec 26, 2013 3:41 pm    Post subject: Reply to: Generating test Data by Recursive SQL
Reply with quote

You've been posting long enough to know to use the Code tags.

Doing anything billions of times requires doing it cpu-efficiently, not source-code-efficiently. Create your data outside DB2 (SORT, IEBDG, a program) and stuff it in (not a technical expression) en masse.

Might cost you an hour of your time doing it, but will save many hours babysitting the process itself.
Back to top
View user's profile Send private message
GuyC

Senior Member


Joined: 11 Aug 2009
Posts: 1281
Location: Belgium

PostPosted: Thu Dec 26, 2013 5:30 pm    Post subject:
Reply with quote

Problem with recursive SQL or any SQL generating huge temp data is that it consumes memory or DSNDB07 space. not to mention CPU-cycles.

IEBDG + LOAD like Bill suggested

or ...
Its been a while since I tried this, but I believe you can get the same result with an sensitive dynamic cursor :
*UNTESTED*
poulate the table with a 1000 rows.
Code:

alter tablespace mytablespace not logged
open mycursor sensitive dynamic cursor for select keycolumn, datacolumn from mytable
fetch into :mykey, :mydata
perform until sqlcode <> 0 or :mykey > 100000
    insert into mytable :mykey + 1000, :mydata
    fetch into :mykey, :mydata
end-perform
close cursor
alter tablespace mytablespace logged
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> DB2 All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts JCL to send email along with formated... wik123 JCL & VSAM 5 Thu Aug 09, 2018 9:48 am
No new posts Send data from a CICS TS program to M... spiThingy CICS 2 Wed Aug 08, 2018 8:58 am
This topic is locked: you cannot edit posts or make replies. Data Sets are files. Please stop str... jasorn JCL & VSAM 11 Wed Aug 08, 2018 1:55 am
No new posts AFP duplex page containing variable data jose angel santamaria IBM Tools 0 Wed Jul 18, 2018 12:35 pm
No new posts Utility to list Data Set Information Auryn JCL & VSAM 4 Tue Jul 17, 2018 5:03 pm

Facebook
Back to Top
 
Job Vacancies | Forum Rules | Bookmarks | Subscriptions | FAQ | Polls | Contact Us