|
Home > Archive > Unix administration > February 2004 > need ideas send very large directory with "sparse files" over LAN efficientl
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
need ideas send very large directory with "sparse files" over LAN efficientl
|
|
| Son Eu 2004-02-15, 7:34 am |
| Hi,
Have a big clearcase directory containing i want to move over the lan,
ideally with "cpio" or Solaris "ufsdump/ufsrestore", or GNU tar,
because it contains "sparse files" inside.
Have some doubts here when "dd"ing the thing over a unix pipe, need
conv=something ?.
Also like something like:
some_backup_command | (rsh remote_machine ¨cd some_dir;
some_restore_command")
What is the most efficient way?
Any help appreciated,
TIA,
Javier C.
Madrid (Spain)
| |
| Thomas Glanzmann 2004-02-15, 9:34 am |
| Hi son,
> Have a big clearcase directory containing i want to move over the lan,
> ideally with "cpio" or Solaris "ufsdump/ufsrestore", or GNU tar,
> because it contains "sparse files" inside.
go for rsync over ssh.
Thomas
| |
| Joerg Schilling 2004-02-15, 9:33 pm |
| In article <15c26c5c.0402151249.3eda5d65@posting.google.com>,
Son Eu <son_eu_carallo@yahoo.es> wrote:
>Hi,
>
>Have a big clearcase directory containing i want to move over the lan,
>ideally with "cpio" or Solaris "ufsdump/ufsrestore", or GNU tar,
>because it contains "sparse files" inside.
CPIO doesn't handle sparse files at all.
GNU tar is realtively slow with sparse files.
Star is up to 4x faster than GNU tar when archiving sparse files.
It could be even faster if Sun would again add support
for reading the hole lists.
>Have some doubts here when "dd"ing the thing over a unix pipe, need
>conv=something ?.
>
>Also like something like:
>some_backup_command | (rsh remote_machine ¨cd some_dir;
>some_restore_command")
>
>What is the most efficient way?
star always implies the -B option if you let it read archives from stdin.
--
EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin
js@cs.tu-berlin.de (uni) If you don't have iso-8859-1
schilling@fokus.fraunhofer.de (work) chars I am J"org Schilling
URL: http://www.fokus.fraunhofer.de/usr/schilling ftp://ftp.berlios.de/pub/schily
| |
|
|
| vkkwebmail@yahspamoos.com 2004-02-16, 2:38 am |
| In comp.unix.solaris Joerg Schilling <js@cs.tu-berlin.de> wrote:
> If you believe that using ssh is fast, then rsync must be slow......
That depends on the type of encryption you're using. Use blowfish
if you want encryption, enable compression also. If you don't
need encryption, then do it in the clear (only your password/auth will
be encrypted)
I've used rsync over ssh for terabytes of data and my bottleneck
was always the fact that my source host had mounted the data over
NFS. And these were systems which I had done a bit of NFS performance
tuning on already.
rsync also allowed me to do check sums on each file copied over which
was a nice way to know that my data maintained it's integrity.
|
|
|
|
|