Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Comparing very large datasets with about 20 million records

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF
View previous topic :: :: View next topic  
Author Message
morpheus007

New User


Joined: 27 Dec 2005
Posts: 58

PostPosted: Fri Mar 16, 2007 9:56 am    Post subject: Comparing very large datasets with about 20 million records
Reply with quote

We have a requirement to compare 2 very large flat files with about 20 million records in each.If I use the 3.13 TSO standard compare option would there be any problems.Is 3.13 equipped to handle large files.
Kindly let me know.
Back to top
View user's profile Send private message

guptae

Moderator


Joined: 14 Oct 2005
Posts: 1187
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:00 am    Post subject:
Reply with quote

Hi There,

You can run dfsort for this.
Back to top
View user's profile Send private message
murmohk1

Senior Member


Joined: 29 Jun 2006
Posts: 1439
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:02 am    Post subject:
Reply with quote

Or use filemaster/fileaid compare option (in batch mode).
Back to top
View user's profile Send private message
morpheus007

New User


Joined: 27 Dec 2005
Posts: 58

PostPosted: Fri Mar 16, 2007 10:07 am    Post subject:
Reply with quote

Thanks for both the responses.

I do see a compare option in our File handling tool.I will try that out.

With regards to the SORT we use Syncsort.Kindly let me know if there is any Sort card for Syncsort that could be used in this case.
Back to top
View user's profile Send private message
murmohk1

Senior Member


Joined: 29 Jun 2006
Posts: 1439
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:22 am    Post subject:
Reply with quote

You have a similar post at the link -


http://ibmmainframes.com/viewtopic.php?t=138&highlight=trick
Back to top
View user's profile Send private message
guptae

Moderator


Joined: 14 Oct 2005
Posts: 1187
Location: Bangalore,India

PostPosted: Fri Mar 16, 2007 10:25 am    Post subject:
Reply with quote

Hi There,

Please check out this post to find match & unmatch record using syncsort

http://ibmmainframes.com/viewtopic.php?t=15955&highlight=
Back to top
View user's profile Send private message
raak

Active User


Joined: 23 May 2006
Posts: 166
Location: chennai

PostPosted: Fri Mar 16, 2007 3:10 pm    Post subject:
Reply with quote

hey

If u have COMPAREX in ur shop, u can use that also to compare

Tru this...

//COMPARE EXEC PGM=COMPAREX
//SYSPRINT DD SYSOUT=Q
//OUTPUTDD OUTPUT PRMODE=PAGE,PAGEDEF=ONEUPO,FORMDEF=ONEUPO
//SYSUT1 DD DSN=TEST.PS.FILE1,
// DISP=SHR
//SYSUT2 DD DSN=TEST.PS.FILE2,
// DISP=SHR
//SYSIN DD *
CONTINUE
FORMAT=16
DASH=C'-'
CASE=MIXED
/*
Back to top
View user's profile Send private message
Phrzby Phil

Active Member


Joined: 31 Oct 2006
Posts: 962
Location: Richmond, Virginia

PostPosted: Fri Mar 16, 2007 5:22 pm    Post subject:
Reply with quote

3.13 has a batch option.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> TSO/ISPF All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Join giving more records than expected Danielle.Filteau SYNCSORT 2 Thu Mar 09, 2017 3:28 am
No new posts TSO or command line utility to genera... kishpra JCL & VSAM 3 Thu Mar 09, 2017 1:11 am
No new posts Extract set of records matching on ac... bhaskar_kanteti DFSORT/ICETOOL 3 Mon Mar 06, 2017 7:19 am
No new posts Inserting records based on conditions vickey_dw DFSORT/ICETOOL 9 Wed Feb 22, 2017 1:33 pm
No new posts To Merge mutliple records into a sing... anandgbe DFSORT/ICETOOL 6 Wed Feb 22, 2017 8:49 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us