Debian Developers - apt-proxy v2 and rsync

Author

apt-proxy v2 and rsync

Ian Bruce

2004-10-26, 2:47 am

Can anyone explain why rsync is no longer considered an appropriate
method for fetching Packages files? It's the only mechanism I'm aware of
that makes "apt-get update" over a 56Kb/s connection complete in a
reasonable length of time. Am I missing something?

Begin forwarded message:

Date: Thu, 7 Oct 2004 07:10:28 -0700
From: Ian Bruce <ian_bruce@fastmail.fm>
To: <halls@debian.org>, <otavio@debian.org>
Subject: apt-proxy v2 and rsync

I was distressed to read the following in the documentation for the new
apt-proxy:

- rsync is not officially supported.

It can work with rsync and some LD_PRELOAD hack, although it has
not been tested for a while, and the shared library is not
included in the .deb package.

If someone convinces me that it is still usefull in the current
situation I may give another chance to rsync backends.

- '+' prefix or equivalent functionality is not supported.

This was specially usefull for rsyncing uncompressed Packages
files, which are not anymore available.

'rsyncpackages' config option was supposed to fill the gap, but
in the current situation, someone will have to convince me that
it is still usefull.

I don't understand why the utility of rsync for fetching Packages files
is in question. For anyone with a dialup internet connection, waiting to
download ten megabytes of compressed Packages files every time they do
an "apt-get update" is unacceptable. The rsync option solved this
problem.

I spent some time tracking down a bug in the old version to make this
work properly:

http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=166305

I'll have to go on using it if the new version won't support rsync.

Now that gzip has the "--rsyncable" option, wouldn't it be feasible to
rsync against compressed Packages files rather than having to keep the
uncompressed ones around for this purpose?

Unless I'm missing some important development ("current situation"?),
the rsync method for Packages files is still as important as it ever
was. Please reconsider your decision to drop support for this feature.
Not everyone has a high-speed internet connection.

-- Ian Bruce

--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

Adrian 'Dagurashibanipal' von Bidder

2004-10-28, 7:49 am

Marco d'Itri

2004-10-28, 5:52 pm

On Oct 26, Ian Bruce <ian_bruce@fastmail.fm> wrote:

> Can anyone explain why rsync is no longer considered an appropriate
> method for fetching Packages files? It's the only mechanism I'm aware of
Because it's hard on servers, for a start.

--
ciao, |
Marco | [8782 diFcw3LT7Erlw]

Marcelo E. Magallon

2004-10-28, 8:47 pm

On Thu, Oct 28, 2004 at 01:54:54PM +0200, Adrian 'Dagurashibanipal' von Bidder wrote:
> IIRC the problem is that rsync is quite CPU-heavy on the servers, so
> while the mirrors have the (network) resources to feed downloads to
> 100s of users, they don't have the (CPU) resources for a few dozen
> rsyncs.

And shouldn't this be left as a decision for the mirror administrators?
It's not like setting up a mirror _automatically_ allows rsync access
to it, isn't it?

Marcelo

--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org

Rob Weir

2004-10-29, 2:49 am

On Tue, Oct 26, 2004 at 12:20:19AM -0700, Ian Bruce said
> Now that gzip has the "--rsyncable" option, wouldn't it be feasible to
> rsync against compressed Packages files rather than having to keep the
> uncompressed ones around for this purpose?

You have to explicitly enable this option, which is not currently done.

-rob

--
Words of the day: strategic jihad argus airframe Sears Tower BLU-114/B

--
To UNSUBSCRIBE, email to debian-devel-REQUEST@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org