Copy selective data from various files into one output file

santoshks0611 · New User Joined: 18 Apr 2013 Posts: 10 Location: India

Hi,

I need to copy selective columns from 7 input files to a single output file. All the seven input files contains data from the same table but split in seven different files. Hence I have first merged the 7 files. Then using INREC for the columns required. But the job is taking a lot of time. Can anybody help to do this task faster.

My input file layout is
Company id Pic X(2)
Policy id Pic X(10)
Upd-User-Id Pic X(8)
Timestamp Pic X(26)
.
.
.
.
.
Agent-d Pic X(10)
.
.
.
.

Thanks a ton!

Anuj Dhawan · Posted: Wed May 08, 2013 10:25 am

You need to define "a lot of time" a little better - are you talking about CPU or elapsed time?

Why do you have seven different files for the data from same table? If they all have different data (may be because of different SELECT and WHERE) -- possibly, you can have seven different SORT-Jobs and then merge the outputs of SORT-Jobs, no?

Pandora-Box · Posted: Wed May 08, 2013 10:27 am

If the seven files contain data of the same fields and in same order then you dont need to merge the input

Just concatenate all the 7 files and sort and select the fields required

santoshks0611 · New User Joined: 18 Apr 2013 Posts: 10 Location: India

Hi, Thanks for the reply.
Yes the job is taking much CPU time. Initially i got SB37 abend. But when I increased the size of the output merged file, it got resolved. Actually I do not need all the data of the merged file but still I had to allocate lot of size for merged file. Hence I wanted to know if is possible to do this task without merging.

All the files have same data, but from different regions. So all the files contain similar data. Thanks.

Pandora-Box · Posted: Wed May 08, 2013 10:34 am

Yes it is possible to select the needed fields without Merge

santoshks0611 · New User Joined: 18 Apr 2013 Posts: 10 Location: India

Hi Pandora-Box, Thanks for the reply.

Could you please tell me which command can be used here. How to Concatenate, sort and select only required fields. Thanks.

Pandora-Box · Posted: Wed May 08, 2013 10:44 am

I would suggest you to read the manuals

And Look for INCLUDE COND to select the fields needed by providing the position & SORT FIELDS to sort the fields in th order you need by providing position

expat · Posted: Wed May 08, 2013 1:31 pm

Well NO

You have given us absolutely zero useful information to even begin to suggest any halpful advice.

santoshks0611 · New User Joined: 18 Apr 2013 Posts: 10 Location: India

Hi, Ok. Here is an example of what i need.

expat · Posted: Wed May 08, 2013 2:52 pm

OK, so we can look at the output and work out for ourselves exactly what it is that YOU want,
and the rules that select the correct data that YOU know about, but we don't.

You may have to wait a while for any help as I believe that psychic day is Friday this week
Oh but wait ....... I think I feel a column identification coming through

dick scherrer · Posted: Thu May 09, 2013 12:00 am

Hello,

Suggest you post the JCL and sort control statements you are currently using.

It would be most helpful if you post the "rules" for getting from the inout to the output.

I believe all you need is a simple COPY concatenating the input datasets, but cannot be sure until you clarify.