Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Profile Log in to check your private messages Log in
 
Comparing very large datasets with about 20 million records

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF
View previous topic :: :: View next topic  
Author Message
morpheus007

New User


Joined: 27 Dec 2005
Posts: 58

PostPosted: Fri Mar 16, 2007 9:56 am    Post subject: Comparing very large datasets with about 20 million records
Reply with quote

We have a requirement to compare 2 very large flat files with about 20 million records in each.If I use the 3.13 TSO standard compare option would there be any problems.Is 3.13 equipped to handle large files.
Kindly let me know.
Back to top
View user's profile Send private message

guptae

Moderator


Joined: 14 Oct 2005
Posts: 1187
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:00 am    Post subject:
Reply with quote

Hi There,

You can run dfsort for this.
Back to top
View user's profile Send private message
murmohk1

Senior Member


Joined: 29 Jun 2006
Posts: 1439
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:02 am    Post subject:
Reply with quote

Or use filemaster/fileaid compare option (in batch mode).
Back to top
View user's profile Send private message
morpheus007

New User


Joined: 27 Dec 2005
Posts: 58

PostPosted: Fri Mar 16, 2007 10:07 am    Post subject:
Reply with quote

Thanks for both the responses.

I do see a compare option in our File handling tool.I will try that out.

With regards to the SORT we use Syncsort.Kindly let me know if there is any Sort card for Syncsort that could be used in this case.
Back to top
View user's profile Send private message
murmohk1

Senior Member


Joined: 29 Jun 2006
Posts: 1439
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:22 am    Post subject:
Reply with quote

You have a similar post at the link -


http://ibmmainframes.com/viewtopic.php?t=138&highlight=trick
Back to top
View user's profile Send private message
guptae

Moderator


Joined: 14 Oct 2005
Posts: 1187
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:25 am    Post subject:
Reply with quote

Hi There,

Please check out this post to find match & unmatch record using syncsort

http://ibmmainframes.com/viewtopic.php?t=15955&highlight=
Back to top
View user's profile Send private message
raak

Active User


Joined: 23 May 2006
Posts: 166
Location: chennai

PostPosted: Fri Mar 16, 2007 3:10 pm    Post subject:
Reply with quote

hey

If u have COMPAREX in ur shop, u can use that also to compare

Tru this...

//COMPARE EXEC PGM=COMPAREX
//SYSPRINT DD SYSOUT=Q
//OUTPUTDD OUTPUT PRMODE=PAGE,PAGEDEF=ONEUPO,FORMDEF=ONEUPO
//SYSUT1 DD DSN=TEST.PS.FILE1,
// DISP=SHR
//SYSUT2 DD DSN=TEST.PS.FILE2,
// DISP=SHR
//SYSIN DD *
CONTINUE
FORMAT=16
DASH=C'-'
CASE=MIXED
/*
Back to top
View user's profile Send private message
Phrzby Phil

Active Member


Joined: 31 Oct 2006
Posts: 965
Location: Richmond, Virginia

PostPosted: Fri Mar 16, 2007 5:22 pm    Post subject:
Reply with quote

3.13 has a batch option.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Join records from 2 files with No Dup... Poha Eater DFSORT/ICETOOL 21 Sun Aug 27, 2017 10:35 pm
No new posts REXX to get the all datasets name parasmalik20 CLIST & REXX 5 Tue Jul 18, 2017 9:10 pm
No new posts XML Parse for large file muralikrishnan_new COBOL Programming 3 Mon Jun 12, 2017 12:50 pm
No new posts Check if any Detail records and extra... V S Amarendra Reddy SYNCSORT 19 Mon May 08, 2017 8:54 pm
This topic is locked: you cannot edit posts or make replies. SDSF multiple spool datasets extracte... PJAlarcon CLIST & REXX 1 Fri Apr 21, 2017 10:50 pm

Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us