IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

Need Inputs: for generic program(s)


IBM Mainframe Forums -> COBOL Programming
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
rocky_balboa

New User


Joined: 24 Mar 2010
Posts: 61
Location: Cape of Good Hope

PostPosted: Tue Feb 04, 2014 1:43 pm
Reply with quote

Hi

We have a batch system where we are onboarding data from different other systems. The steps that we have are :
1. A specific program(s) for the given source system for data validation and transformation in a standard layout.
2. Process the records in the standard layout. Viz. processing+inserting into tables for subsequent web display and reporting
Till now we had specific programs for each source system and each source system had its own vagaries. Some send a single file others multiple files, some send true delta others send partial delta.
For clarity, partial delta means that the source system just knows that something has changed in it but does not know what the change is. We find out the change in our process.
The last system which we on boarded had partial delta and multiple files. I designed the process using VSAM as a master files. I had considered DB2 as well but found VSAM better in performance for our requirements. The other factors were flexibility in design/coding as column addition/deletion would have required DBAs who have their own ETC.
Given this background, I want to create a generic program(s) (DB2/VSAM/PS) to onboard any systems’ data. The assumptions are:
• There would be only one i/p file
• The i/p data can be true delta/partial delta full load( This would be in case if the i/p record count is not significant)

Any inputs/suggestions would help me come up with a better design and avoiding pitfalls would be great. Let me know in case you need any clarification.

Thanks
Rocky
Back to top
View user's profile Send private message
sureshpathi10

Active User


Joined: 03 May 2010
Posts: 154
Location: Kuala Lumpur

PostPosted: Tue Feb 04, 2014 4:15 pm
Reply with quote

I guess, you've figured out everything.

Considering your given scenario, I've a single suggestion that might increase your performance.

For the 1st Step
Quote:
1. A specific program(s) for the given source system for data validation and transformation in a standard layout.


You can use SORT utility instead of a COBOL program (if the validation can be done in SORT).
Back to top
View user's profile Send private message
rocky_balboa

New User


Joined: 24 Mar 2010
Posts: 61
Location: Cape of Good Hope

PostPosted: Tue Feb 04, 2014 5:08 pm
Reply with quote

Additional information :

The data load happens in parts

1) The historical data load where in all the eligible data is on boarded
2) Subsequently daily delta feeds are received to update data for relevant records.

All this happens through the programs of the first stage.( Validation and transformation.

It is also assumed that each record also has an unique identifier for historical as well as delta updates.

I am not concerned about validation part here but the delta calculation in terms of efficiency and flexiblity for both the i/p file layout and the program design.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> COBOL Programming

 


Similar Topics
Topic Forum Replies
No new posts Using API Gateway from CICS program CICS 0
No new posts DB2 Event passed to the Application P... DB2 1
No new posts How to pass the PARM value to my targ... COBOL Programming 8
No new posts REXX code to expand copybook in a cob... CLIST & REXX 2
No new posts EZT program to build a flat file with... All Other Mainframe Topics 9
Search our Forums:

Back to Top