View previous topic :: View next topic
|
Author |
Message |
Ricardo Moreira
New User
Joined: 20 Apr 2007 Posts: 16 Location: Brasil
|
|
|
|
I need a job that:
1 - Reads a file
2 - Split this read file in two or more files, using a few conditions
3 - With limit of records specified, for example 1000...
Actually, this file was created on tape because it has more than 40 million records... And I need to split it up by some kind of conditions.... By the way, this could be done in only one step ?
And another thing, when I try to copy this file to disk as its too big DASD gives an error, It shouldnt be alocating new volumes for the file ? Or do you think this was limited by the operator to avoid users creat files too big on DASD?
tks |
|
Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008 Posts: 8697 Location: Dubuque, Iowa, USA
|
|
|
|
Quote: |
It shouldnt be alocating new volumes for the file ? |
As many volumes as you told the system to use, but no more. What is the record length? How are you attempting to allocate the file on disk?
Most importantly, have you talked to your site support group since the storage management policies vary by site and only someone AT YOUR SITE will know the limits for your site? |
|
Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006 Posts: 19244 Location: Inside the Matrix
|
|
|
|
Hello,
Keep in mind that if you split the tape file (which was too big for dasd) into multiple dasd datasets, the full amount of space (plus a small bit more) will still be needed.
If the original file required too much space, you should get permission to use the same amount even if allocated differently. . .
It may be possible to split the file in one step. You need to post the rules for splitting the file. You do not want to split the large file into sub-files of 1000 records. . . If you split this into files of 1 million records each, that will still be 40 files to manage. . . |
|
Back to top |
|
|
Ricardo Moreira
New User
Joined: 20 Apr 2007 Posts: 16 Location: Brasil
|
|
|
|
Hi,
My conditions are:
Reads this file from the tape, chosing by pos (1:10 'C') = "0103561207", and for this for this condition ("0103561207") I just need a few rows, like 1000, and I would like to put the result rows in file1, and a second condition "0203561207" writing to file2.
I tried to reach Operation Suppport, but they cant help on that, they only say that when I make a copy from a file even if is too big, volumes should be alocated by it self. |
|
Back to top |
|
|
Frank Yaeger
DFSORT Developer
Joined: 15 Feb 2005 Posts: 7129 Location: San Jose, CA
|
|
|
|
It's still not clear what you want to do. Your explanation of the "condition" for splitting the file is very confusing. You need to do a better job of explaining the "rules" for getting from input to output before anyone can help you. Do you only need output file1 and output file2, or do you need more output files?
DFSORT has lots of ways to split files (SPLIT1R, STARTREC, ENDREC, SAVE, etc) but which one you would use depends on what you're trying to do exactly. |
|
Back to top |
|
|
|