Unix administration - backing up a website

This is Interesting: Free IT Magazines  
Home > Archive > Unix administration > November 2007 > backing up a website





You are viewing an archived Text-only version of the thread. To view this thread in it's original format and/or if you want to reply to this thread please [click here]

Author backing up a website
droid

2007-11-05, 1:28 pm

I'm trying to backup up my website using wget.

wget -mirror -w 3 -p -P $HOME/MyWebBak ftp://username:password@ftp.mydomain.com

This produces $HOME/MyWebBak/index.html very quickly - too quickly.

When I point my browser to $HOME/MyWebBak/index.html, it appears to be
a mirror immage of my website filesystem, but the files have no
content.

Is wget the tool I should be using for a modest ( <5GB) website?

If yes, what should my command line be?

If no, what OSS software should I turn to (using OpenSUSE 10.2, KDE)?

Sylvain Robitaille

2007-11-05, 1:28 pm

droid wrote:

> Is wget the tool I should be using for a modest ( <5GB) website?


Ssh access ("scp -r ...." or "ssh ${remote} tar ...") would certainly
be preferable, but I know that not all web service providers accomodate
Ssh access.

If you're backing up by recursive ftp, I think you'll probably have
better success with ncftp ("ncftpget", specifically).

I hope that helps ...

--
----------------------------------------------------------------------
Sylvain Robitaille syl@alcor.concordia.ca

Systems and Network analyst Concordia University
Instructional & Information Technology Montreal, Quebec, Canada
----------------------------------------------------------------------
droid

2007-11-05, 1:28 pm

On Nov 5, 12:29 pm, Sylvain Robitaille <s...@alcor.concordia.ca>
wrote:
> droid wrote:
>
> Ssh access ("scp -r ...." or "ssh ${remote} tar ...") would certainly
> be preferable, but I know that not all web service providers accomodate
> Ssh access.
>
> If you're backing up by recursive ftp, I think you'll probably have
> better success with ncftp ("ncftpget", specifically).
>
> I hope that helps ...
>


GoDaddy doesn't permit ssh on shared hosted accounts. Also, if I ftp
in with Konqueror and try to copy a directory (I assume it uses
mget) ,
it stops with a "too many connections" error.

I hadn't heard of ncftp, I'll have a look at it. Many sources advise
wget,
but I'm sure I'm not using it right.

Dave Hinz

2007-11-05, 7:25 pm

On Mon, 05 Nov 2007 17:45:13 -0000, droid <jshowalter@gmail.com> wrote:
>
> GoDaddy doesn't permit ssh on shared hosted accounts. Also, if I ftp
> in with Konqueror and try to copy a directory (I assume it uses
> mget) ,
> it stops with a "too many connections" error.


I had that problem with dotster, switched over to dreamhost. If you
want a discount I can send you a referral code.

> I hadn't heard of ncftp, I'll have a look at it. Many sources advise
> wget,
> but I'm sure I'm not using it right.


didn't read the whole thread but, did you try wget -r ?

Dave

Michael Heiming

2007-11-06, 7:46 am

In comp.unix.admin Dave Hinz <DaveHinz@gmail.com>:
> On Mon, 05 Nov 2007 17:45:13 -0000, droid <jshowalter@gmail.com> wrote:


[vbcol=seagreen]
> I had that problem with dotster, switched over to dreamhost. If you
> want a discount I can send you a referral code.


[vbcol=seagreen]
> didn't read the whole thread but, did you try wget -r ?


w3mir and lftp also have excellent http mirror capabilities.

--
Michael Heiming (X-PGP-Sig > GPG-Key ID: EDD27B94)
mail: echo zvpunry@urvzvat.qr | PERL -pe 'y/a-z/n-za-m/'
#bofh excuse 432: Borg nanites have infested the server
Jim Showalter

2007-11-09, 1:23 pm

Dave Hinz wrote:
>
> I had that problem with dotster, switched over to dreamhost. If you
> want a discount I can send you a referral code.
>


Please do. I checked them out at http://www.dreamhost.com/hosting.html
and they sound awesome!

>
> didn't read the whole thread but, did you try wget -r ?
>


Yes, it seems to be working fine with -r. But everyone is advising
against wget, recommending ncft (or ncftpget), w3mir, lftp and FTPsync
instead.


droid
--
Command, n.:
Statement presented by a human and accepted by a computer in
such a manner as to make the human feel as if he is in control.
Sponsored Links






Free braindumps | Software forum | Database administration forum

Copyright 2003 - 2008 webservertalk.com