IBM Mainframe Forum Index
 
Log In
 
IBM Mainframe Forum Index Mainframe: Search IBM Mainframe Forum: FAQ Register
 

Transfer TB of data from Mainframe to x86 platform / Azure


IBM Mainframe Forums -> All Other Mainframe Topics
Post new topic   Reply to topic
View previous topic :: View next topic  
Author Message
A_programmers

New User


Joined: 24 Mar 2010
Posts: 19
Location: USA

PostPosted: Fri Mar 18, 2022 5:13 pm
Reply with quote

Dear Friends,

We have requirement to send 100 TB+ data from Mainframe to Azure Cloud storage (Or even Windows Server will work). Migrated Data on cloud storage (after EBCDIC to ASCII conversion) will be used for reporting purpose. I have tried sftp to transfer files from Mainframe to Azure blob however performance is very slow i.e. 2 GB data movement is taking 20 minutes. Both Mainframe and Azure are currently present in same US region.

Any advice on how to migrate huge data from Mainframe to x86 platform / Azure / AWS ?

Thanks
John
Back to top
View user's profile Send private message
Robert Sample

Global Moderator


Joined: 06 Jun 2008
Posts: 8624
Location: Dubuque, Iowa, USA

PostPosted: Fri Mar 18, 2022 7:03 pm
Reply with quote

2 GB in 20 minutes is about 1.6+ megabytes per second -- not slow but not especially fast. You might want to contract with IBM or some other company to do the data migration for you; they have tools that can speed up the transfer. If nothing else, talk to your systems people and see what can be done to optimize the transfer speed.
Back to top
View user's profile Send private message
A_programmers

New User


Joined: 24 Mar 2010
Posts: 19
Location: USA

PostPosted: Sun Mar 20, 2022 9:41 am
Reply with quote

Thanks Robert for your comments. Due to budget constraints; I thought of exploring in house options and then if nothing works I will involve 3rd party. Regarding optimization; I made sure that target storage is near to Mainframe, tried with multiple buffer size to get the sweet spot buffer size and used SSD storage in target. I will explore further options on Mainframe and will also get in touch with Mainframe admin.
Back to top
View user's profile Send private message
View previous topic :: :: View next topic  
Post new topic   Reply to topic View Bookmarks
All times are GMT + 6 Hours
Forum Index -> All Other Mainframe Topics

 


Similar Topics
Topic Forum Replies
No new posts Setting CA7 user variable from data s... CA Products 7
No new posts pass data as symbolic parameter from ... CLIST & REXX 2
No new posts How to display the leading zeros of a... DB2 5
No new posts Extract all the TWS scheduler informa... IBM Tools 1
No new posts Decompress data from JMR log file Compuware & Other Tools 4
Search our Forums:

Back to Top