Portal | Manuals | References | Downloads | Info | Programs | JCLs | Master the Mainframes
IBM Mainframe Computers Forums Index
 
Register
 
IBM Mainframe Computers Forums Index Mainframe: Search IBM Mainframe Forum: FAQ Memberlist Usergroups Profile Log in to check your private messages Log in
 

 

Need Inputs: for generic program(s)

 
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> COBOL Programming
View previous topic :: :: View next topic  
Author Message
rocky_balboa

New User


Joined: 24 Mar 2010
Posts: 61
Location: Cape of Good Hope

PostPosted: Tue Feb 04, 2014 1:43 pm    Post subject: Need Inputs: for generic program(s)
Reply with quote

Hi

We have a batch system where we are onboarding data from different other systems. The steps that we have are :
1. A specific program(s) for the given source system for data validation and transformation in a standard layout.
2. Process the records in the standard layout. Viz. processing+inserting into tables for subsequent web display and reporting
Till now we had specific programs for each source system and each source system had its own vagaries. Some send a single file others multiple files, some send true delta others send partial delta.
For clarity, partial delta means that the source system just knows that something has changed in it but does not know what the change is. We find out the change in our process.
The last system which we on boarded had partial delta and multiple files. I designed the process using VSAM as a master files. I had considered DB2 as well but found VSAM better in performance for our requirements. The other factors were flexibility in design/coding as column addition/deletion would have required DBAs who have their own ETC.
Given this background, I want to create a generic program(s) (DB2/VSAM/PS) to onboard any systems’ data. The assumptions are:
• There would be only one i/p file
• The i/p data can be true delta/partial delta full load( This would be in case if the i/p record count is not significant)

Any inputs/suggestions would help me come up with a better design and avoiding pitfalls would be great. Let me know in case you need any clarification.

Thanks
Rocky
Back to top
View user's profile Send private message

sureshpathi10

Active User


Joined: 03 May 2010
Posts: 154
Location: Kuala Lumpur

PostPosted: Tue Feb 04, 2014 4:15 pm    Post subject:
Reply with quote

I guess, you've figured out everything.

Considering your given scenario, I've a single suggestion that might increase your performance.

For the 1st Step
Quote:
1. A specific program(s) for the given source system for data validation and transformation in a standard layout.


You can use SORT utility instead of a COBOL program (if the validation can be done in SORT).
Back to top
View user's profile Send private message
rocky_balboa

New User


Joined: 24 Mar 2010
Posts: 61
Location: Cape of Good Hope

PostPosted: Tue Feb 04, 2014 5:08 pm    Post subject:
Reply with quote

Additional information :

The data load happens in parts

1) The historical data load where in all the eligible data is on boarded
2) Subsequently daily delta feeds are received to update data for relevant records.

All this happens through the programs of the first stage.( Validation and transformation.

It is also assumed that each record also has an unique identifier for historical as well as delta updates.

I am not concerned about validation part here but the delta calculation in terms of efficiency and flexiblity for both the i/p file layout and the program design.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic    IBMMAINFRAMES.com Support Forums -> COBOL Programming All times are GMT + 6 Hours
Page 1 of 1

 

Search our Forum:

Similar Topics
Topic Author Forum Replies Posted
No new posts Read two inputs and write into output... murali.andaluri DFSORT/ICETOOL 5 Wed Jul 26, 2017 7:35 pm
No new posts Writing a file using online program grvtomar PL/I & Assembler 3 Fri Jun 30, 2017 1:06 pm
No new posts pre-compiler for program in an HFS Pedro DB2 0 Fri Jun 23, 2017 11:13 pm
No new posts Compiling program in endeavor for tra... RALAKKAL Compuware & Other Tools 4 Mon Jun 05, 2017 8:27 pm
No new posts COBOL DB2 program - zIIP eligible vasanthz COBOL Programming 7 Wed May 31, 2017 5:12 am


Facebook
Back to Top
 
Mainframe Wiki | Forum Rules | Bookmarks | Subscriptions | FAQ | Tutorials | Contact Us