IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

how to delete duplicate records from a flat file


IBM Mainframe Forums -> DFSORT/ICETOOL
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
shan

New User


Joined: 10 Aug 2006
Posts: 7

PostPosted: Thu Aug 10, 2006 6:52 pm
Reply with quote

pls help me out
Back to top
View user's profile Send private message
cpuhawg

Active User


Joined: 14 Jun 2006
Posts: 331
Location: Jacksonville, FL

PostPosted: Thu Aug 10, 2006 7:11 pm
Reply with quote

Using a basic sort:

Code:

//SORT    EXEC PGM=SORT                             
//SORTIN   DD DSN=INPUT.FILE,DISP=SHR               
//SORTOUT  DD DSN=OUTPUT.FILE,                     
//          DISP=(NEW,CATLG),                       
//          UNIT=SYSDA,SPACE=(TRK,(60,15),RLSE),   
//          DCB=(RECFM=??,LRECL=???,BLKSIZE=0)     
//SYSOUT   DD SYSOUT=*                             
//SYSIN    DD *                                     
  SORT FIELDS=(2,5,CH,A)                             
  SUM FIELDS=NONE                                   


Your SORT field defines the duplicate field of the records. The 2 would represent the starting position of the duplicate field and the 5 would represent the length. Your duplicates will be gone and the SORTOUT file will contain the remainder of the records. Make sure your DCB on SORTOUT are valued correctly.
Back to top
View user's profile Send private message
Frank Yaeger

DFSORT Developer


Joined: 15 Feb 2005
Posts: 7129
Location: San Jose, CA

PostPosted: Thu Aug 10, 2006 9:19 pm
Reply with quote

Alternatively, you can use this DFSORT/ICETOOL job:

Code:

//S1 EXEC PGM=ICETOOL
//TOOLMSG DD SYSOUT=*
//DFSMSG DD SYSOUT=*
//IN DD DSN=...   input file
//OUT DD DSN=...  output file
//TOOLIN DD *
SELECT FROM(IN) TO(OUT) ON(p,m,f) FIRST


p,m,f is the starting position, length and format of the field you want to use to determine duplicates.

You can also use SELECT for many other types of operations involving duplicates (e.g. LAST, FIRSTDUP, LASTDUP, ALLDUPS, NODUPS, etc). See the following for more information on SELECT:

publibz.boulder.ibm.com/cgi-bin/bookmgr_OS390/BOOKS/ICE1CA20/6.11?DT=20060615185603
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> DFSORT/ICETOOL

 


Similar Topics
Topic Forum Replies
No new posts Compare 2 files and retrive records f... DFSORT/ICETOOL 3
No new posts Compare 2 files(F1 & F2) and writ... JCL & VSAM 8
No new posts FTP VB File from Mainframe retaining ... JCL & VSAM 8
No new posts Extract the file name from another fi... DFSORT/ICETOOL 6
No new posts How to split large record length file... DFSORT/ICETOOL 10
Search our Forums:

Back to Top