I'm having a problem where it appears ICETOOL can successfully handle a small file but not a large one. The issue does not seem to be the data itself because I can take an input file of a few hundred lines that is processed successfully, then double the size of the file by repeating every row, and then the resulting file runs ok also. I can repeat this process and eventually the sort stops working.
ICE650I 0 VISIT http://www.ibm.com/storage/dfsort FOR ICETOOL PAPERS, EXAMPLES AND MORE
ICE632I 0 SOURCE FOR ICETOOL STATEMENTS: TOOLIN
ICE630I 0 MODE IN EFFECT: STOP
DISPLAY FROM(SORTIN) LIST(SORTOUT) BLANK -
TITLE('TRACKING REPORT OF UNRESOLVED DUPLICATES') DATE PAGE -
HEADER('DUPLED KEY') ON(1,25,CH) -
HEADER('UNRESOLVED SINCE') ON(27,8,ZD,E'9999/99/99')
ICE643I 0 WIDTH OF REPORT IS 0121 BYTES
ICE627I 0 DFSORT CALL 0001 FOR COPY FROM SORTIN TO E35 EXIT COMPLETED
ICE603I 0 INFORMATION PRINTED IN SORTOUT DATA SET
ICE628I 0 RECORD COUNT: 000000000003936
ICE602I 0 OPERATION RETURN CODE: 00
ICE650I 0 VISIT http://www.ibm.com/storage/dfsort FOR ICETOOL PAPERS, EXAMPLES AND MORE
ICE632I 0 SOURCE FOR ICETOOL STATEMENTS: TOOLIN
ICE630I 0 MODE IN EFFECT: STOP
DISPLAY FROM(SORTIN) LIST(SORTOUT) BLANK -
TITLE('TRACKING REPORT OF UNRESOLVED DUPLICATES') DATE PAGE -
HEADER('DUPLED KEY') ON(1,25,CH) -
HEADER('UNRESOLVED SINCE') ON(27,8,ZD,E'9999/99/99')
ICE643I 0 WIDTH OF REPORT IS 0121 BYTES
ICE627I 0 DFSORT CALL 0001 FOR COPY FROM SORTIN TO E35 EXIT COMPLETED
ICE603I 0 INFORMATION PRINTED IN SORTOUT DATA SET
ICE628I 0 RECORD COUNT: 000000000003936
ICE602I 0 OPERATION RETURN CODE: 00
Any thoughts on what the issue is here? The answer may be painfully obvious to some here but to me it is just... painful.
As you can see I'm not processing a giant file here, it is only about 4,000 lines. But the output is totally empty, as opposed to the nice result I get when the input file is smaller:
Code:
TRACKING REPORT OF UNRESOLVED DUPLICATES 12/01/14 - 1 -
You should avoid using ddnames reserved for ICETOOL and DFSORT in
ICETOOL operands (FROM, TO, LIST, DISCARD, WRITE ). In general, you
should also avoid supplying DD statements with ddnames reserved for
DFSORT when using ICETOOL because doing so can cause unpredictable
results. Specifically:
...
- SYSIN, SORTCNTL, SORTIN, SORTOUT, SORTINnn, and xxxxINnn (where xxxx
is specified in a USING operand) should not be used as ddnames in
ICETOOL operators nor supplied as DD statements.