How to track incoming input files that trigger a job?

shreya19 · New User Joined: 13 Mar 2014 Posts: 34 Location: USA

I have around 100 files received each day.
A job is triggered when a file is received, processes it and deletes the input file. The output of the job is available in SAR.

Now, I have to track if all the files are received each day. What can be the simplest way to do this?
The files received are not the same every day.

what I Thought is: As soon as the file is received, trigger job runs - to add a step in this to copy the input file name to a PS. Repeat this for each file (appending file names to the same PS).
Manually create a list of file and compare the PS with this.
Issues faced: 1. since the file list is not same for each day, how to check what day is today? In order to compare the PS with that particular day's list.
2. Since the file is deleted by the trigger job, there would be difficulty testing.

Any simpler approach?

Abid Hasan · New User Joined: 25 Mar 2013 Posts: 88 Location: India

Hello,

Going by the solution you already have:
a. The point where the file is received, can be enhanced to write the received file name to a dataset (which will be written in DISP MOD, so each file name will be appended to the last one)
b. I am assuming you have a check-point at which you know for sure that 'all 100 or so' files are received, at this point, execute a simple REXX which would:
1. Calculate the day of the week
2. Compare your earlier created dataset with the list against 'that' day's file list which can be pre-saved in another dataset or a PDS member- your choice.

I remember working on a similar solution in my last engagement; we had NDM there, so getting list of files received on a given day into a PS file, was a simple task. In case you have a similar setup, then it can be done without much effort - provided you have an identifiable list of files that you're expecting on a given day.

Hope this helps.

Willy Jensen · Posted: Thu Feb 25, 2016 7:16 pm

1. Add a step to the triggered job, add date in front of the file name in your flat file, in a format suitable for sorting and filtering.
2. Generate a list of expected files, also with date at the front.
3. Use a compare program i.e. ISPF SUPERC to outline differences.

Terry Heinze · Posted: Thu Feb 25, 2016 8:41 pm

I'd try Willy's solution but in step 1 I'd write to a VSAM file with a key consisting of current date and dataset name. I might include a sequence number as part of the key in case 2 files of the same name arrived on the same day.

shreya19 · New User Joined: 13 Mar 2014 Posts: 34 Location: USA

Thanks everyone for the replies!

Abid, we use NDM too. Was there a different approach used by you for file received via NDM? If yes, please suggest

Abid Hasan · New User Joined: 25 Mar 2013 Posts: 88 Location: India

Hello Shreya,

shreya19 · New User Joined: 13 Mar 2014 Posts: 34 Location: USA

Thanks Abdul! This helps a lot. This is very simple approach and gives a good direction to proceed.