|
Home > Archive > Squid > April 2004 > [squid-users] squid tries to rebuild cache but fails...
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
[squid-users] squid tries to rebuild cache but fails...
|
|
| Hanno.Wagner@boerse-stuttgart.de 2004-04-29, 6:54 pm |
| Hi,
I have here a Netra-machine with Solaris 8 and 1GB RAM. This machine is=
serving as mailhost/mailscan-machine and Webproxy. Today,squid stopped
because it claimed not to have enough storage space to store and it tri=
ed
to rebuild the store database. But even when there is enough storage sp=
ace
and inodes available, it still crashes:
[..]
root@host# tail -f /opt/sfw/squid/var/logs/cache.log
2004/04/27 12:30:59| Starting Squid Cache version 2.5.STABLE2-20030411 =
for
sparc-sun-solaris2.9...
2004/04/27 12:30:59| Process ID 11178
2004/04/27 12:30:59| With 1024 file descriptors available
2004/04/27 12:30:59| DNS Socket created at 0.0.0.0, port 59790, FD 5
2004/04/27 12:30:59| Adding nameserver 212.121.128.10 from /etc/resolv.=
conf
2004/04/27 12:30:59| Adding nameserver 212.121.128.11 from /etc/resolv.=
conf
2004/04/27 12:30:59| Unlinkd pipe opened on FD 10
2004/04/27 12:30:59| Swap maxSize 18432000 KB, estimated 1417846 object=
s
2004/04/27 12:30:59| Target number of buckets: 70892
2004/04/27 12:30:59| Using 131072 Store buckets
2004/04/27 12:30:59| Max Mem size: 131072 KB
2004/04/27 12:30:59| Max Swap size: 18432000 KB
2004/04/27 12:30:59| Store logging disabled
2004/04/27 12:30:59| Rebuilding storage in /cache (DIRTY)
2004/04/27 12:30:59| Using Least Load store dir selection
2004/04/27 12:30:59| Set Current Directory to /opt/sfw/squid/var/logs
2004/04/27 12:30:59| Loaded Icons.
2004/04/27 12:30:59| Accepting HTTP connections at 0.0.0.0, port 8080, =
FD
11.
2004/04/27 12:30:59| Accepting ICP messages at 0.0.0.0, port 3130, FD 1=
2.
2004/04/27 12:30:59| WCCP Disabled.
2004/04/27 12:30:59| Ready to serve requests.
2004/04/27 12:31:00| Store rebuilding is 0.2% complete
2004/04/27 12:31:15| Store rebuilding is 17.4% complete
2004/04/27 12:31:32| Store rebuilding is 22.0% complete
2004/04/27 12:31:48| Store rebuilding is 23.2% complete
2004/04/27 12:32:03| Store rebuilding is 38.1% complete
Apr 27 12:32:16 boe-stvw-p2 squid[11178]: [ID 702911 local4.alert] Writ=
e
failure -- check your disk space and cache.log
2004/04/27 12:32:16| diskHandleWrite: FD 8: disk write error: (28) No s=
pace
left on device
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.5.STABLE2-20030411): Terminated abnormally.
CPU Usage: 38.110 seconds =3D 20.550 user + 17.560 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
2004/04/27 12:32:19| Starting Squid Cache version 2.5.STABLE2-20030411 =
for
sparc-sun-solaris2.9...
2004/04/27 12:32:19| Process ID 11194
2004/04/27 12:32:19| With 1024 file descriptors available
2004/04/27 12:32:19| DNS Socket created at 0.0.0.0, port 59791, FD 5
2004/04/27 12:32:19| Adding nameserver 212.121.128.10 from /etc/resolv.=
conf
2004/04/27 12:32:19| Adding nameserver 212.121.128.11 from /etc/resolv.=
conf
2004/04/27 12:32:19| Unlinkd pipe opened on FD 10
2004/04/27 12:32:19| Swap maxSize 18432000 KB, estimated 1417846 object=
s
2004/04/27 12:32:19| Target number of buckets: 70892
2004/04/27 12:32:19| Using 131072 Store buckets
2004/04/27 12:32:19| Max Mem size: 131072 KB
2004/04/27 12:32:19| Max Swap size: 18432000 KB
2004/04/27 12:32:19| Store logging disabled
2004/04/27 12:32:19| Rebuilding storage in /cache (DIRTY)
2004/04/27 12:32:19| Using Least Load store dir selection
2004/04/27 12:32:19| Set Current Directory to /opt/sfw/squid/var/logs
2004/04/27 12:32:19| Loaded Icons.
2004/04/27 12:32:19| Accepting HTTP connections at 0.0.0.0, port 8080, =
FD
11.
2004/04/27 12:32:19| Accepting ICP messages at 0.0.0.0, port 3130, FD 1=
2.
2004/04/27 12:32:19| WCCP Disabled.
2004/04/27 12:32:19| Ready to serve requests.
2004/04/27 12:32:20| Store rebuilding is 0.2% complete
2004/04/27 12:32:35| Store rebuilding is 19.1% complete
2004/04/27 12:32:39| Preparing for shutdown after 109 requests
2004/04/27 12:32:39| Waiting 30 seconds for active connections to finis=
h
2004/04/27 12:32:39| FD 11 Closing HTTP connection
2004/04/27 12:32:50| Store rebuilding is 36.2% complete
Apr 27 12:32:56 boe-stvw-p2 squid[11194]: [ID 702911 local4.alert] Writ=
e
failure -- check your disk space and cache.log
2004/04/27 12:32:56| diskHandleWrite: FD 8: disk write error: (28) No s=
pace
left on device
FATAL: Write failure -- check your disk space and cache.log
Squid Cache (Version 2.5.STABLE2-20030411): Terminated abnormally.
CPU Usage: 33.610 seconds =3D 18.620 user + 14.990 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
2004/04/27 12:33:27| Starting Squid Cache version 2.5.STABLE2-20030411 =
for
sparc-sun-solaris2.9...
2004/04/27 12:33:27| Process ID 11239
2004/04/27 12:33:27| With 1024 file descriptors available
2004/04/27 12:33:27| DNS Socket created at 0.0.0.0, port 59792, FD 5
2004/04/27 12:33:27| Adding nameserver 212.121.128.10 from /etc/resolv.=
conf
2004/04/27 12:33:27| Adding nameserver 212.121.128.11 from /etc/resolv.=
conf
2004/04/27 12:33:27| Unlinkd pipe opened on FD 10
2004/04/27 12:33:27| Swap maxSize 18432000 KB, estimated 1417846 object=
s
2004/04/27 12:33:27| Target number of buckets: 70892
2004/04/27 12:33:27| Using 131072 Store buckets
2004/04/27 12:33:27| Max Mem size: 131072 KB
2004/04/27 12:33:27| Max Swap size: 18432000 KB
2004/04/27 12:33:27| Store logging disabled
2004/04/27 12:33:27| Rebuilding storage in /cache (DIRTY)
2004/04/27 12:33:27| Using Least Load store dir selection
2004/04/27 12:33:27| Set Current Directory to /opt/sfw/squid/var/logs
2004/04/27 12:33:27| Loaded Icons.
2004/04/27 12:33:27| Accepting HTTP connections at 0.0.0.0, port 8080, =
FD
11.
2004/04/27 12:33:27| Accepting ICP messages at 0.0.0.0, port 3130, FD 1=
2.
2004/04/27 12:33:27| WCCP Disabled.
[..]
as you can see, it tries to restart everytime.
[..]
root@host# uname -a
SunOS boe-stvw-p2 5.8 Generic_108528-27 sun4u sparc SUNW,UltraAX-i2
root@host# df -o i
df: operation not applicable for FSType fd
df: operation not applicable for FSType mntfs
df: operation not applicable for FSType nfs
df: operation not applicable for FSType proc
df: operation not applicable for FSType tmpfs
Filesystem iused ifree %iused Mounted on
/dev/md/dsk/d10 4568 367144 1% /
/dev/md/dsk/d30 45367 466633 9% /usr
/dev/md/dsk/d40 19357 460643 4% /var
/dev/md/dsk/d60 1592287 935713 63% /cache
/dev/md/dsk/d50 25493 318571 7% /opt
root@host# df -k
Filesystem kbytes used avail capacity Mounted on
/dev/md/dsk/d10 1487071 1421933 5656 100% /
/dev/md/dsk/d30 4130982 1009143 3080530 25% /usr
/proc 0 0 0 0% /proc
fd 0 0 0 0% /dev/fd
mnttab 0 0 0 0% /etc/mnttab
/dev/md/dsk/d40 3916782 476513 3401102 13% /var
swap 6841480 24 6841456 1% /var/run
swap 6856384 14928 6841456 1% /tmp
/dev/md/dsk/d60 20587657 16174440 4207341 80% /cache
/dev/md/dsk/d50 2055463 1147450 846350 58% /opt
[..]
as you can see, there is nearly no space anymore on /. This is already
fixed (more than 160Mbyte now free), but squid still crashes at the sam=
e
moment (store rebuilding).
I have here the squid.conf with all comments and emtpy lines taken out:=
[..]
root@host# grep -v ^# squid.conf|more
http_port 8080
hierarchy_stoplist cgi-bin ?
acl QUERY urlpath_regex cgi-bin \?
no_cache deny QUERY
cache_mem 128 MB
cache_swap_low 90
cache_swap_high 95
maximum_object_size 8192 KB
minimum_object_size 0 KB
maximum_object_size_in_memory 32 KB
ipcache_size 2048
ipcache_low 90
ipcache_high 95
fqdncache_size 2048
cache_replacement_policy lru
memory_replacement_policy lru
cache_dir ufs /cache 18000 32 256
cache_access_log /opt/sfw/squid/var/logs/access.log
cache_access_log /opt/sfw/squid/var/logs/access.log
cache_log /opt/sfw/squid/var/logs/cache.log
cache_store_log none
pid_filename /opt/sfw/squid/var/logs/squid.pid
debug_options ALL,1
auth_param basic children 5
auth_param basic realm Squid proxy-caching web server
auth_param basic credentialsttl 2 hours
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern . 60 40% 43200
quick_abort_pct 95
acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8
acl SSL_ports port 443 563
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 563 # https, snews
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
http_access allow all
http_access deny all
http_reply_access allow all
icp_access allow all
logfile_rotate 10
coredump_dir /opt/sfw/squid/var/logs
ie_refresh on
[..]
I first thought that squid tries to write somewhere on the root-Filesys=
tem
and there is not enough space. Unfortunately, I get the same error even=
when I freed some space.
Can you give me some hints where to check for enough space or to see wh=
at
really is wrong here?
Mit freundlichen Gr=FC=DFen,
Hanno Wagner
--
Hanno Wagner - Unix-C/S-Systemadministrator
Boerse Stuttgart AG
Email: Hanno.Wagner@boerse-stuttgart.de Tel: +49-711-222 985-569
Diese E-Mail enth=E4lt vertrauliche oder rechtlich gesch=FCtzte Informa=
tionen.
Wenn Sie nicht der beabsichtigte Empf=E4nger sind, informieren Sie bitt=
e
sofort den Absender und l=F6schen Sie diese E-Mail. Das unbefugte Kopie=
ren
dieser E-Mail oder die unbefugte Weitergabe der enthaltenen Information=
en
ist nicht gestattet.
The information contained in this message is confidential or protected =
by
law. If you are not the intended recipient, please contact the sender a=
nd
delete this message. Any unauthorised copying of this message or
unauthorised distribution of the information contained herein is
prohibited.
=
| |
| unixware 2004-04-29, 6:54 pm |
| diskHandleWrite: FD 8: disk write error: (28) No
space
left on device
what is location of swap.state file
i think your patition or hard drive is getting full
Regards
> I have here a Netra-machine with Solaris 8 and 1GB
> RAM. This machine is
> serving as mailhost/mailscan-machine and Webproxy.
> Today,squid stopped
> because it claimed not to have enough storage space
> to store and it tried
> to rebuild the store database. But even when there
> is enough storage space
> and inodes available, it still crashes:
>
> [..]
> root@host# tail -f /opt/sfw/squid/var/logs/cache.log
>
> 2004/04/27 12:30:59| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:30:59| Process ID 11178
> 2004/04/27 12:30:59| With 1024 file descriptors
> available
> 2004/04/27 12:30:59| DNS Socket created at 0.0.0.0,
> port 59790, FD 5
> 2004/04/27 12:30:59| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:30:59| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:30:59| Unlinkd pipe opened on FD 10
> 2004/04/27 12:30:59| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:30:59| Target number of buckets: 70892
> 2004/04/27 12:30:59| Using 131072 Store buckets
> 2004/04/27 12:30:59| Max Mem size: 131072 KB
> 2004/04/27 12:30:59| Max Swap size: 18432000 KB
> 2004/04/27 12:30:59| Store logging disabled
> 2004/04/27 12:30:59| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:30:59| Using Least Load store dir
> selection
> 2004/04/27 12:30:59| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:30:59| Loaded Icons.
> 2004/04/27 12:30:59| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:30:59| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:30:59| WCCP Disabled.
> 2004/04/27 12:30:59| Ready to serve requests.
> 2004/04/27 12:31:00| Store rebuilding is 0.2%
> complete
> 2004/04/27 12:31:15| Store rebuilding is 17.4%
> complete
> 2004/04/27 12:31:32| Store rebuilding is 22.0%
> complete
> 2004/04/27 12:31:48| Store rebuilding is 23.2%
> complete
> 2004/04/27 12:32:03| Store rebuilding is 38.1%
> complete
> Apr 27 12:32:16 boe-stvw-p2 squid[11178]: [ID 702911
> local4.alert] Write
> failure -- check your disk space and cache.log
> 2004/04/27 12:32:16| diskHandleWrite: FD 8: disk
> write error: (28) No space
> left on device
> FATAL: Write failure -- check your disk space and
> cache.log
> Squid Cache (Version 2.5.STABLE2-20030411):
> Terminated abnormally.
> CPU Usage: 38.110 seconds = 20.550 user + 17.560 sys
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 0
> 2004/04/27 12:32:19| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:32:19| Process ID 11194
> 2004/04/27 12:32:19| With 1024 file descriptors
> available
> 2004/04/27 12:32:19| DNS Socket created at 0.0.0.0,
> port 59791, FD 5
> 2004/04/27 12:32:19| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:32:19| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:32:19| Unlinkd pipe opened on FD 10
> 2004/04/27 12:32:19| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:32:19| Target number of buckets: 70892
> 2004/04/27 12:32:19| Using 131072 Store buckets
> 2004/04/27 12:32:19| Max Mem size: 131072 KB
> 2004/04/27 12:32:19| Max Swap size: 18432000 KB
> 2004/04/27 12:32:19| Store logging disabled
> 2004/04/27 12:32:19| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:32:19| Using Least Load store dir
> selection
> 2004/04/27 12:32:19| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:32:19| Loaded Icons.
> 2004/04/27 12:32:19| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:32:19| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:32:19| WCCP Disabled.
> 2004/04/27 12:32:19| Ready to serve requests.
> 2004/04/27 12:32:20| Store rebuilding is 0.2%
> complete
> 2004/04/27 12:32:35| Store rebuilding is 19.1%
> complete
> 2004/04/27 12:32:39| Preparing for shutdown after
> 109 requests
> 2004/04/27 12:32:39| Waiting 30 seconds for active
> connections to finish
> 2004/04/27 12:32:39| FD 11 Closing HTTP connection
> 2004/04/27 12:32:50| Store rebuilding is 36.2%
> complete
> Apr 27 12:32:56 boe-stvw-p2 squid[11194]: [ID 702911
> local4.alert] Write
> failure -- check your disk space and cache.log
> 2004/04/27 12:32:56| diskHandleWrite: FD 8: disk
> write error: (28) No space
> left on device
> FATAL: Write failure -- check your disk space and
> cache.log
> Squid Cache (Version 2.5.STABLE2-20030411):
> Terminated abnormally.
> CPU Usage: 33.610 seconds = 18.620 user + 14.990 sys
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 0
> 2004/04/27 12:33:27| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:33:27| Process ID 11239
> 2004/04/27 12:33:27| With 1024 file descriptors
> available
> 2004/04/27 12:33:27| DNS Socket created at 0.0.0.0,
> port 59792, FD 5
> 2004/04/27 12:33:27| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:33:27| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:33:27| Unlinkd pipe opened on FD 10
> 2004/04/27 12:33:27| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:33:27| Target number of buckets: 70892
> 2004/04/27 12:33:27| Using 131072 Store buckets
> 2004/04/27 12:33:27| Max Mem size: 131072 KB
> 2004/04/27 12:33:27| Max Swap size: 18432000 KB
> 2004/04/27 12:33:27| Store logging disabled
> 2004/04/27 12:33:27| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:33:27| Using Least Load store dir
> selection
> 2004/04/27 12:33:27| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:33:27| Loaded Icons.
> 2004/04/27 12:33:27| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:33:27| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:33:27| WCCP Disabled.
> [..]
>
> as you can see, it tries to restart everytime.
>
>
> [..]
> root@host# uname -a
> SunOS boe-stvw-p2 5.8 Generic_108528-27 sun4u sparc
> SUNW,UltraAX-i2
>
> root@host# df -o i
> df: operation not applicable for FSType fd
> df: operation not applicable for FSType mntfs
> df: operation not applicable for FSType nfs
> df: operation not applicable for FSType proc
> df: operation not applicable for FSType tmpfs
> Filesystem iused ifree %iused
> Mounted on
> /dev/md/dsk/d10 4568 367144 1% /
> /dev/md/dsk/d30 45367 466633 9% /usr
> /dev/md/dsk/d40 19357 460643 4% /var
> /dev/md/dsk/d60 1592287 935713 63% /cache
> /dev/md/dsk/d50 25493 318571 7% /opt
>
>
> root@host# df -k
> Filesystem kbytes used avail
> capacity Mounted on
> /dev/md/dsk/d10 1487071 1421933 5656 100%
> /
> /dev/md/dsk/d30 4130982 1009143 3080530 25%
> /usr
> /proc 0 0 0 0%
> /proc
> fd 0 0 0 0%
> /dev/fd
> mnttab 0 0 0 0%
> /etc/mnttab
>
=== message truncated ===
__________________________________
Do you Yahoo!?
Win a $20,000 Career Makeover at Yahoo! HotJobs
http://hotjobs.sweepstakes.yahoo.com/careermakeover
| |
| Hanno.Wagner@boerse-stuttgart.de 2004-04-29, 6:54 pm |
|
Hi,
> diskHandleWrite: FD 8: disk write error: (28) No
> space left on device
> what is location of swap.state file
> i think your patition or hard drive is getting full
that was my first guess too. But:
[..]
root@host# grep cache_dir /opt/sfw/squid/etc/squid.conf
cache_dir ufs /cache 18000 32 256
root@host:/# ls -lart /cache
[..]
drwxr-xr-x 258 nobody nogroup 3584 Apr 28 2003 1E
drwxr-xr-x 258 nobody nogroup 3584 Apr 28 2003 1F
drwx------ 2 nobody nogroup 8192 Apr 25 2003 lost+found
-rw-r--r-- 1 nobody nobody 80447952 Apr 26 14:59 swap.state
-rw-r--r-- 1 nobody nobody 5786400 Apr 27 13:29 swap.state.new
root@host:/cache# df -k .
Filesystem kbytes used avail capacity Mounted on
/dev/md/dsk/d60 20587657 16144992 4236789 80% /cache
[..]
So, there is enough space on the disk itself, we are far away from
the 2gb-limit (in case this may jump in), but still squid claims not
to have enough space...
any more suggestions?
Ciao, Hanno
--
| |
| Henrik Nordstrom 2004-04-29, 6:54 pm |
| On Tue, 27 Apr 2004 Hanno.Wagner@boerse-stuttgart.de wrote:
> Hi,
>
> I have here a Netra-machine with Solaris 8 and 1GB RAM. This machine is
> serving as mailhost/mailscan-machine and Webproxy. Today,squid stopped
> because it claimed not to have enough storage space to store and it tried
> to rebuild the store database.
Make sure it is not running into a 2GB file size limit on any of the log
files..
Also on Solaris situation can be worse if the filesytem is not tuned to
optimize for space. The problem is that df includes block fragments in the
free space report, but for writes to larger files (>3KB or so) to succeed
there needs to be full blocks available, not only fragments. A cache that
has been running for some time with high usage of the filesystem with the
filesystem tuned for "optimize for speed" can cause quite servere free
block fragmentation as web traffic typically coinsists of very many small
files.. To detect if this is the case you can use dd
dd if=/dev/zero of=somefile
if this stops early while there still is lots of free space reported by df
and ulimit -a does not say filesize is limited then your filesystem free
space is most likely too fragmented to be useable. It helps reducing the
cache size, but you may need to first delete some content to get Squid
running again.
Regards
Henrik
| |
| Angela Burrell 2004-04-29, 6:54 pm |
|
Check your log files.
I was surprised that my /var/log/messages and /var/log/syslog, also
/var/log/kernel/info were several hundreds of MB and were taking all the
space on my 3.3 GB partition.
try this command
du -s /var/log
to see how much space is /var/log using up.
-----Original Message-----
From: unixware [mailto:datareactor@yahoo.com]
Sent: Tuesday, April 27, 2004 8:01 AM
To: Hanno.Wagner@boerse-stuttgart.de; squid-users@squid-cache.org
Subject: Re: [squid-users] squid tries to rebuild cache but fails...
diskHandleWrite: FD 8: disk write error: (28) No
space
left on device
what is location of swap.state file
i think your patition or hard drive is getting full
Regards
> I have here a Netra-machine with Solaris 8 and 1GB
> RAM. This machine is
> serving as mailhost/mailscan-machine and Webproxy.
> Today,squid stopped
> because it claimed not to have enough storage space
> to store and it tried
> to rebuild the store database. But even when there
> is enough storage space
> and inodes available, it still crashes:
>
> [..]
> root@host# tail -f /opt/sfw/squid/var/logs/cache.log
>
> 2004/04/27 12:30:59| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:30:59| Process ID 11178
> 2004/04/27 12:30:59| With 1024 file descriptors
> available
> 2004/04/27 12:30:59| DNS Socket created at 0.0.0.0,
> port 59790, FD 5
> 2004/04/27 12:30:59| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:30:59| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:30:59| Unlinkd pipe opened on FD 10
> 2004/04/27 12:30:59| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:30:59| Target number of buckets: 70892
> 2004/04/27 12:30:59| Using 131072 Store buckets
> 2004/04/27 12:30:59| Max Mem size: 131072 KB
> 2004/04/27 12:30:59| Max Swap size: 18432000 KB
> 2004/04/27 12:30:59| Store logging disabled
> 2004/04/27 12:30:59| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:30:59| Using Least Load store dir
> selection
> 2004/04/27 12:30:59| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:30:59| Loaded Icons.
> 2004/04/27 12:30:59| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:30:59| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:30:59| WCCP Disabled.
> 2004/04/27 12:30:59| Ready to serve requests.
> 2004/04/27 12:31:00| Store rebuilding is 0.2%
> complete
> 2004/04/27 12:31:15| Store rebuilding is 17.4%
> complete
> 2004/04/27 12:31:32| Store rebuilding is 22.0%
> complete
> 2004/04/27 12:31:48| Store rebuilding is 23.2%
> complete
> 2004/04/27 12:32:03| Store rebuilding is 38.1%
> complete
> Apr 27 12:32:16 boe-stvw-p2 squid[11178]: [ID 702911
> local4.alert] Write
> failure -- check your disk space and cache.log
> 2004/04/27 12:32:16| diskHandleWrite: FD 8: disk
> write error: (28) No space
> left on device
> FATAL: Write failure -- check your disk space and
> cache.log
> Squid Cache (Version 2.5.STABLE2-20030411):
> Terminated abnormally.
> CPU Usage: 38.110 seconds = 20.550 user + 17.560 sys
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 0
> 2004/04/27 12:32:19| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:32:19| Process ID 11194
> 2004/04/27 12:32:19| With 1024 file descriptors
> available
> 2004/04/27 12:32:19| DNS Socket created at 0.0.0.0,
> port 59791, FD 5
> 2004/04/27 12:32:19| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:32:19| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:32:19| Unlinkd pipe opened on FD 10
> 2004/04/27 12:32:19| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:32:19| Target number of buckets: 70892
> 2004/04/27 12:32:19| Using 131072 Store buckets
> 2004/04/27 12:32:19| Max Mem size: 131072 KB
> 2004/04/27 12:32:19| Max Swap size: 18432000 KB
> 2004/04/27 12:32:19| Store logging disabled
> 2004/04/27 12:32:19| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:32:19| Using Least Load store dir
> selection
> 2004/04/27 12:32:19| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:32:19| Loaded Icons.
> 2004/04/27 12:32:19| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:32:19| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:32:19| WCCP Disabled.
> 2004/04/27 12:32:19| Ready to serve requests.
> 2004/04/27 12:32:20| Store rebuilding is 0.2%
> complete
> 2004/04/27 12:32:35| Store rebuilding is 19.1%
> complete
> 2004/04/27 12:32:39| Preparing for shutdown after
> 109 requests
> 2004/04/27 12:32:39| Waiting 30 seconds for active
> connections to finish
> 2004/04/27 12:32:39| FD 11 Closing HTTP connection
> 2004/04/27 12:32:50| Store rebuilding is 36.2%
> complete
> Apr 27 12:32:56 boe-stvw-p2 squid[11194]: [ID 702911
> local4.alert] Write
> failure -- check your disk space and cache.log
> 2004/04/27 12:32:56| diskHandleWrite: FD 8: disk
> write error: (28) No space
> left on device
> FATAL: Write failure -- check your disk space and
> cache.log
> Squid Cache (Version 2.5.STABLE2-20030411):
> Terminated abnormally.
> CPU Usage: 33.610 seconds = 18.620 user + 14.990 sys
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 0
> 2004/04/27 12:33:27| Starting Squid Cache version
> 2.5.STABLE2-20030411 for
> sparc-sun-solaris2.9...
> 2004/04/27 12:33:27| Process ID 11239
> 2004/04/27 12:33:27| With 1024 file descriptors
> available
> 2004/04/27 12:33:27| DNS Socket created at 0.0.0.0,
> port 59792, FD 5
> 2004/04/27 12:33:27| Adding nameserver
> 212.121.128.10 from /etc/resolv.conf
> 2004/04/27 12:33:27| Adding nameserver
> 212.121.128.11 from /etc/resolv.conf
> 2004/04/27 12:33:27| Unlinkd pipe opened on FD 10
> 2004/04/27 12:33:27| Swap maxSize 18432000 KB,
> estimated 1417846 objects
> 2004/04/27 12:33:27| Target number of buckets: 70892
> 2004/04/27 12:33:27| Using 131072 Store buckets
> 2004/04/27 12:33:27| Max Mem size: 131072 KB
> 2004/04/27 12:33:27| Max Swap size: 18432000 KB
> 2004/04/27 12:33:27| Store logging disabled
> 2004/04/27 12:33:27| Rebuilding storage in /cache
> (DIRTY)
> 2004/04/27 12:33:27| Using Least Load store dir
> selection
> 2004/04/27 12:33:27| Set Current Directory to
> /opt/sfw/squid/var/logs
> 2004/04/27 12:33:27| Loaded Icons.
> 2004/04/27 12:33:27| Accepting HTTP connections at
> 0.0.0.0, port 8080, FD
> 11.
> 2004/04/27 12:33:27| Accepting ICP messages at
> 0.0.0.0, port 3130, FD 12.
> 2004/04/27 12:33:27| WCCP Disabled.
> [..]
>
> as you can see, it tries to restart everytime.
>
>
> [..]
> root@host# uname -a
> SunOS boe-stvw-p2 5.8 Generic_108528-27 sun4u sparc
> SUNW,UltraAX-i2
>
> root@host# df -o i
> df: operation not applicable for FSType fd
> df: operation not applicable for FSType mntfs
> df: operation not applicable for FSType nfs
> df: operation not applicable for FSType proc
> df: operation not applicable for FSType tmpfs
> Filesystem iused ifree %iused
> Mounted on
> /dev/md/dsk/d10 4568 367144 1% /
> /dev/md/dsk/d30 45367 466633 9% /usr
> /dev/md/dsk/d40 19357 460643 4% /var
> /dev/md/dsk/d60 1592287 935713 63% /cache
> /dev/md/dsk/d50 25493 318571 7% /opt
>
>
> root@host# df -k
> Filesystem kbytes used avail
> capacity Mounted on
> /dev/md/dsk/d10 1487071 1421933 5656 100%
> /
> /dev/md/dsk/d30 4130982 1009143 3080530 25%
> /usr
> /proc 0 0 0 0%
> /proc
> fd 0 0 0 0%
> /dev/fd
> mnttab 0 0 0 0%
> /etc/mnttab
>
=== message truncated ===
__________________________________
Do you Yahoo!?
Win a $20,000 Career Makeover at Yahoo! HotJobs
http://hotjobs.sweepstakes.yahoo.com/careermakeover
|
|
|
|
|