|
View previous topic :: View next topic
|
| Author |
Message |
Charles Wolters
New User
Joined: 30 Mar 2011
Posts: 48
Location: United States
|
|
|
|
I have a huge SAS data set (over 27 million records) on mainframe. Here are the steps I undertook to ultimately get the SAS data set on my PC.
1. Created SAS transport file on mainframe using PROC CPORT.
2. Used PKZIP utility in a batch job to compress SAS transport file
3. Used the Reflections FTP tool (by ATTACHMATE) to transfer zipped data set to my PC. Set the transfer method to binary.
4. Used the Microsoft Extraction Wizard to unzip the transferred data set.
The attempt to unzip the data was unsuccessful. I first called SAS tech support and they had no knowledge of PKZIP but said that for the transfer of a SAS transport file (unzipped) the transfer method should have been binary (which it was).
I called PKZIP technical support and they could find no problems with my program statements. I did specify BINARY as to the type of data set being compressed and they thought that appropriate. They were not familiar with the Reflections FTP tool and suggested I do the FTP in a batch job.
I called ATTACHMATE tech support and they don't have any knowledge of PKZIP but they are still looking into the problem.
Does anyone have any insight on what needs to be done so that my data set can be successfully unzipped? I would be happy to send code from any of the steps if it would aid in finding a solution but every step executed successfully (except the last). I used the "Drop and Drag" approach for the Reflections FTP but did not save the script generated by the tool. I did see the statement "Transmission Successful" .
Charles Wolters |
|
| Back to top |
|
 |
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Hello,
| Quote: |
| The attempt to unzip the data was unsuccessful. |
How was this "unsuccessful"? Posting "it didn't work" is basically lost time. . . If someone is to be able to help, you have to provide whatever disgnostic info is available.
Might there be insufficient space on the target system?
What happens if you only process the first few % of the file? The last few % of the file? Do these de-compress successfully? What happens if you transfer a small amount via the the COMMAND prompt ftp (rather than the Reflections tool)? Can you successfully decompress the file on the same system it was compressed? |
|
| Back to top |
|
|
Charles Wolters
New User
Joined: 30 Mar 2011
Posts: 48
Location: United States
|
|
|
|
Yes, I think trying the process with a smaller number of records would be a good step. The error message box from the Extraction tool is very terse and the real problem might be insufficient space as you point out.
I have set up the FTP batch program and am now checking with the PC technicians to see that a connection on my PC will be open before I submit.
Trying to unzip the SAS transport file on the mainframe, using a SAS procedure to transform the SAS transport file to a SAS data set and seeing if that is successful would be a worthwhile endeavor. Since the SAS guys know nothing about PKZIP and the PKZIP guys don't know any SAS something could turn up.
I will keep you posted on the results of your suggestions.
Charles |
|
| Back to top |
|
|
dick scherrer
Moderator Emeritus
Joined: 23 Nov 2006
Posts: 19244
Location: Inside the Matrix
|
|
|
|
Good luck - someone will usually be here if there discoveries to talk about 
d |
|
| Back to top |
|
|
superk
Global Moderator
Joined: 26 Apr 2004
Posts: 4652
Location: Raleigh, NC, USA
|
|
|
|
| PKZIP is extremely sensitive to extraneous data within a zip archive file. What did you use for the RECFM/LRECL of your zip dataset? |
|
| Back to top |
|
|
Robert Sample
Global Moderator
Joined: 06 Jun 2008
Posts: 8697
Location: Dubuque, Iowa, USA
|
|
|
|
| Why the zip? Why not just transfer the SAS transport file? |
|
| Back to top |
|
|
PeterHolland
Global Moderator
Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen
|
|
|
|
| Why not use on the pc side PKWARE unzip, instead of Microsoft Extraction Wizard. My guess is that MEW uses another zip algoritm, and mainly is used for zipped folders. |
|
| Back to top |
|
|
Charles Wolters
New User
Joined: 30 Mar 2011
Posts: 48
Location: United States
|
|
|
|
For block size I specified 27,998 but I did not specify a RECFM parameter. When I went back to the PKZIP manual, I found that the default RECFM was U for undefined. The documentation states that when the RECFM is U the blocksize parameter is ignored. Do you believe this will create problems?
Charles |
|
| Back to top |
|
|
PeterHolland
Global Moderator
Joined: 27 Oct 2009
Posts: 2481
Location: Netherlands, Amstelveen
|
|
|
|
| Of course. On pc's the OS's dont use RECFM or LRECL or whatever. |
|
| Back to top |
|
|
superk
Global Moderator
Joined: 26 Apr 2004
Posts: 4652
Location: Raleigh, NC, USA
|
|
|
|
| I'd suggest RECFM=VB and an LRECL of 32760. |
|
| Back to top |
|
|
|
|
