|
View previous topic :: View next topic
|
| Author |
Message |
callmeavi14
New User
Joined: 18 Jan 2010
Posts: 3
Location: India
|
|
|
|
Hi All,
As per my requirement i have to write some transaction data to DB2 table. As i cant give explicit commit or rollback. I am thinking to write the data to either MQ or Flat file and later using a batch job will upload to the DB2 table.
Can anyone suggest which will be better in case of High Volume Real time data? Approx i will be receiving 3 Million records a day. |
|
| Back to top |
|
 |
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Hello,
Why the concern about commit/rollback? 3 million INSERTs in a singoe batch process is probably not going to perform acceptably.
Will the received records be in a format that can be directly loaded into the table or do they need to be pre-processed to become loadable?
Can all of the data be loaded at one time or should the data be put into the table as it is received?
How will this data be received? |
|
| Back to top |
|
|
callmeavi14
New User
Joined: 18 Jan 2010
Posts: 3
Location: India
|
|
|
|
Hi,
The 3 million records are not going to come in a single go. Its the total volume expected by end of day. The application which is going to process the records is triggered every 30 secs. i need to update the audit database for successful/unsuccessful processing of each record.
Since the application doesn't have any explicit commit/rollback. So if a transaction is unsuccessful if i directly update the Audit database, it will be rolled back. Hence considering either MQ or flat file to store the info and later on applying to the database. |
|
| Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Hello,
Does this job run every 30 seconds n batch?
I'm still not clear on where the records "come from". . . How are these presented to the mainframe? |
|
| Back to top |
|
|
|
|
