|
Home > Archive > Debian Developers > February 2004 > Debian Standard Mirror configuration (was: apt experimental breaks w/ webcaching)
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
Debian Standard Mirror configuration (was: apt experimental breaks w/ webcaching)
|
|
| Marc Haber 2004-02-28, 3:33 pm |
| On Fri, 2 Jan 2004 09:49:46 -0800, Matt Zimmerman <mdz@debian.org>
wrote:
>It would be great if the mirrors would supply explicit Expires headers,
>since they know when they will be next synched.
With our mechanisms' compexity increasing, properly configuring a
mirror has become increasingly difficult. Some client programs behave
unexpectedly when returning the default MIME types for .tar.gz files,
it is recommended to rsync packages without deletion, then rsync
Packages/Release file and finally rsync packages again with deletion
to always deliver consistent package pools, and now Debian mirrors
have to especially cater to create appropriate Expires: headers.
What is desperately needed is a Debian-mirror HOWTO, including
configuration snippets and mirror scripts, since even our official
mirrors seem to get it wrong.
Greetings
Marc
--=20
-------------------------------------- !! No courtesy copies, please !! =
-----
Marc Haber | " Questions are the | Mailadresse im =
Header
Karlsruhe, Germany | Beginning of Wisdom " | Fon: *49 721 966 32=
15
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fax: *49 721 966 31=
29
--
To UNSUBSCRIBE, email to debian-devel-request@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
| |
| Goswin von Brederlow 2004-02-28, 3:33 pm |
| Marc Haber <mh+debian-devel@zugschlus.de> writes:
> On Fri, 2 Jan 2004 09:49:46 -0800, Matt Zimmerman <mdz@debian.org>
> wrote:
>
> With our mechanisms' compexity increasing, properly configuring a
> mirror has become increasingly difficult. Some client programs behave
> unexpectedly when returning the default MIME types for .tar.gz files,
> it is recommended to rsync packages without deletion, then rsync
> Packages/Release file and finally rsync packages again with deletion
> to always deliver consistent package pools, and now Debian mirrors
> have to especially cater to create appropriate Expires: headers.
>
> What is desperately needed is a Debian-mirror HOWTO, including
> configuration snippets and mirror scripts, since even our official
> mirrors seem to get it wrong.
>
> Greetings
> Marc
Debmirror (>>20040228), i.e. the rewritten one, defaults to
downloading the Release/Packages/Sources files into a temp dir, then
update the packages and only after that move the metafiles in place.
That, till now missing feature, anoyed me often enough too.
As for the expire headers setting expire for /dists to say 1h
while keeping /pool to a week or month should work.
On the same note, is there a way to tell apt-get to ignore the cache
and enforce fetching files (like shift-reload in a browser)? Could
apt-get detect the need for it (e.g. always force fetch Release and
force the rest when they don't match)?
MfG
Goswin
--
To UNSUBSCRIBE, email to debian-devel-request@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
| |
| Peter Palfrader 2004-02-28, 4:33 pm |
| On Sat, 28 Feb 2004, Goswin von Brederlow wrote:
> On the same note, is there a way to tell apt-get to ignore the cache
> and enforce fetching files (like shift-reload in a browser)? Could
> apt-get detect the need for it (e.g. always force fetch Release and
> force the rest when they don't match)?
mdz was tracking a bug the other day, with apt-get and proxies. He then
concluded that it would be best to always do requests with max-age=0,
thus always forcing a revalidate. This should be enough for everybody.
| |
| Matt Zimmerman 2004-02-28, 5:33 pm |
| On Sat, Feb 28, 2004 at 08:30:07PM +0100, Marc Haber wrote:
> to always deliver consistent package pools, and now Debian mirrors
> have to especially cater to create appropriate Expires: headers.
They don't have to; everything should work fine without it. It would just
make some optimizations possible as far as caching.
--
- mdz
--
To UNSUBSCRIBE, email to debian-devel-request@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
| |
| Marc Haber 2004-02-28, 5:33 pm |
| On 28 Feb 2004 20:53:38 +0100, Goswin von Brederlow
<brederlo@informatik.uni-tuebingen.de> wrote:
>Debmirror (>>20040228), i.e. the rewritten one, defaults to
>downloading the Release/Packages/Sources files into a temp dir, then
>update the packages and only after that move the metafiles in place.
>That, till now missing feature, anoyed me often enough too.
However, this needs to be documented since most Debian mirrors out
there are run by non-debianists, so we can't rely on them using "our"
scripts.
>As for the expire headers setting expire for /dists to say 1h
>while keeping /pool to a week or month should work.
Stupid question: How do I configure that with apache? Is it just
dropping an 'ExpiresDefault "now plus 1 hour"' into
debian/dists/.htaccess, or am I too naive here?
Greetings
Marc
--=20
-------------------------------------- !! No courtesy copies, please !! =
-----
Marc Haber | " Questions are the | Mailadresse im =
Header
Karlsruhe, Germany | Beginning of Wisdom " | Fon: *49 721 966 32=
15
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fax: *49 721 966 31=
29
--
To UNSUBSCRIBE, email to debian-devel-request@lists.debian.org
with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
|
|
|
|
|