Сегодня утром нагнулся файло-почтовый сервер с RAID-5 на FreeBSD 5.4. Файловая система не смогла корректно замонтироваться и сервер ждал меня на работе загруженным в SINGLE MODE с "UNEXPECTED SOFT UPDATE INCONSISTENCY".
1. Сервер почему-то был перезагружен дважды, хотя никто его тронуть не мог, ключи от серверной лишь у меня.
2. Стали появляться странные сообщения такого вида:Sep 18 10:32:23 netgenic named[411]: /usr/src/lib/bind/isc/../../../contrib/bind9/lib/isc/unix/socket.c:1115: unexpected error:
Sep 18 10:32:23 netgenic named[411]: internal_send: 208.254.3.166#53: Network is down
и в /var/log/messages
Sep 18 10:43:57 netgenic last message repeated 3 times
Sep 18 10:43:57 netgenic named[411]: client 195.14.56.67#1031: error sending response: not enough free resources
Sep 18 10:43:57 netgenic named[411]: client 195.14.56.67#1034: error sending response: not enough free resources
Sep 18 10:43:57 netgenic named[411]: client 195.14.56.67#1031: error sending response: not enough free resources
Никаких обновлений или перекомпиляций ядра не выполнялось, сервер просто работал и перестал. Прошу помощи! Что обозначают сообщения по пункту 2? Что могло произойти с сервером?
Ниже привожу cat /var/log/messages
Sep 18 08:40:53 netgenic named[404]: client 213.167.34.186#56396: update 'group.ru/IN' denied
Sep 18 08:44:43 netgenic named[404]: client 194.186.186.123#4489: update 'pac.ru/IN' denied
Sep 18 09:05:37 netgenic syslogd: kernel boot file is /boot/kernel/kernel
Sep 18 09:05:37 netgenic kernel: Copyright (c) 1992-2005 The FreeBSD Project.
Sep 18 09:05:37 netgenic kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Sep 18 09:05:37 netgenic kernel: The Regents of the University of California. All rights reserved.
Sep 18 09:05:37 netgenic kernel: FreeBSD 5.4-STABLE #1: Thu Sep 22 11:52:32 MSD 2005
Sep 18 09:05:37 netgenic kernel: sergey@ng-new.pac.ru:/usr/src/sys/i386/compile/NETGENIC
Sep 18 09:05:37 netgenic kernel: ACPI APIC Table: <PTLTD APIC >
Sep 18 09:05:37 netgenic kernel: Timecounter "i8254" frequency 1193182 Hz quality 0
Sep 18 09:05:37 netgenic kernel: CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz 686-class CPU)
Sep 18 09:05:37 netgenic kernel: Origin = "GenuineIntel" Id = 0xf41 Stepping = 1
Sep 18 09:05:37 netgenic kernel: Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE
2,SS,HTT,TM,PBE>
Sep 18 09:05:37 netgenic kernel: Hyperthreading: 2 logical CPUs
Sep 18 09:05:37 netgenic kernel: real memory = 2146893824 (2047 MB)
Sep 18 09:05:37 netgenic kernel: avail memory = 2099630080 (2002 MB)
Sep 18 09:05:37 netgenic kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
Sep 18 09:05:37 netgenic kernel: cpu0 (BSP): APIC ID: 0
Sep 18 09:05:37 netgenic kernel: cpu1 (AP): APIC ID: 1
Sep 18 09:05:37 netgenic kernel: cpu2 (AP): APIC ID: 6
Sep 18 09:05:37 netgenic kernel: cpu3 (AP): APIC ID: 7
Sep 18 09:05:37 netgenic kernel: ioapic0 <Version 2.0> irqs 0-23 on motherboard
Sep 18 09:05:37 netgenic kernel: ioapic1 <Version 2.0> irqs 24-47 on motherboard
Sep 18 09:05:37 netgenic kernel: ioapic2 <Version 2.0> irqs 48-71 on motherboard
Sep 18 09:05:37 netgenic kernel: ioapic3 <Version 2.0> irqs 72-95 on motherboard
Sep 18 09:05:37 netgenic kernel: ioapic4 <Version 2.0> irqs 96-119 on motherboard
Sep 18 09:05:37 netgenic kernel: npx0: <math processor> on motherboard
Sep 18 09:05:37 netgenic kernel: npx0: INT 16 interface
Sep 18 09:05:37 netgenic kernel: acpi0: <PTLTD RSDT> on motherboard
Sep 18 09:05:37 netgenic kernel: acpi0: Power Button (fixed)
Sep 18 09:05:37 netgenic kernel: Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
Sep 18 09:05:37 netgenic kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
Sep 18 09:05:37 netgenic kernel: cpu0: <ACPI CPU> on acpi0
Sep 18 09:05:37 netgenic kernel: cpu1: <ACPI CPU> on acpi0
Sep 18 09:05:37 netgenic kernel: cpu2: <ACPI CPU> on acpi0
Sep 18 09:05:37 netgenic kernel: cpu3: <ACPI CPU> on acpi0
Sep 18 09:05:37 netgenic kernel: pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
Sep 18 09:05:37 netgenic kernel: pci0: <ACPI PCI bus> on pcib0
Sep 18 09:05:37 netgenic kernel: pci0: <unknown> at device 0.1 (no driver attached)
Sep 18 09:05:37 netgenic kernel: pcib1: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
Sep 18 09:05:37 netgenic kernel: pci1: <ACPI PCI bus> on pcib1
Sep 18 09:05:37 netgenic kernel: pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
.................... #сокращение
Sep 18 09:05:37 netgenic kernel: acd0: CDROM <CD-224E/1.9A> at ata1-master PIO4
Sep 18 09:05:37 netgenic kernel: amrd0: <LSILogic MegaRAID logical drive> on amr0
Sep 18 09:05:37 netgenic kernel: amrd0: 132000MB (270336000 sectors) RAID 5 (optimal)
Sep 18 09:05:37 netgenic kernel: amrd1: <LSILogic MegaRAID logical drive> on amr0
Sep 18 09:05:37 netgenic kernel: amrd1: 8006MB (16396288 sectors) RAID 5 (optimal)
Sep 18 09:05:37 netgenic kernel: amrd2: <LSILogic MegaRAID logical drive> on amr0
Sep 18 09:05:37 netgenic kernel: amrd2: 140006MB (286732288 sectors) RAID 5 (optimal)
Sep 18 09:05:37 netgenic kernel: ses0 at amr0 bus 0 target 6 lun 0
Sep 18 09:05:37 netgenic kernel: ses0: <SUPER GEM318 0> Fixed Processor SCSI-2 device
Sep 18 09:05:37 netgenic kernel: ses0: SAF-TE Compliant Device
Sep 18 09:05:37 netgenic kernel: SMP: AP CPU #2 Launched!
Sep 18 09:05:37 netgenic kernel: SMP: AP CPU #1 Launched!
Sep 18 09:05:37 netgenic kernel: SMP: AP CPU #3 Launched!
Sep 18 09:05:37 netgenic kernel: Mounting root from ufs:/dev/amrd0s1a
Sep 18 09:05:37 netgenic kernel: WARNING: / was not properly dismounted
Sep 18 09:05:37 netgenic kernel: WARNING: /tmp was not properly dismounted
Sep 18 09:05:37 netgenic kernel: /tmp: mount pending error: blocks 0 files 2
Sep 18 09:05:37 netgenic kernel: WARNING: /usr was not properly dismounted
Sep 18 09:05:37 netgenic kernel: /usr: mount pending error: blocks 36 files 1
Sep 18 09:05:37 netgenic kernel: WARNING: /var was not properly dismounted
Sep 18 09:05:37 netgenic kernel: /var: mount pending error: blocks 3396 files 203
Sep 18 09:05:37 netgenic kernel: WARNING: /mnt/belmax was not properly dismounted
Sep 18 09:05:37 netgenic kernel: WARNING: /mnt/soft was not properly dismounted
Sep 18 09:05:38 netgenic named[412]: starting BIND 9.3.1 -u bind -t /var/named
Sep 18 09:05:38 netgenic named[412]: zone 'ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:05:38 netgenic named[412]: zone '_msdcs.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:05:38 netgenic named[412]: zone '_sites.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:05:38 netgenic named[412]: zone '_tcp.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:05:38 netgenic named[412]: zone '_udp.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:05:38 netgenic named[412]: command channel listening on 127.0.0.1#953
Sep 18 09:05:38 netgenic kernel: em0: Link is up 100 Mbps Full Duplex
Sep 18 09:05:38 netgenic named[412]: running
Sep 18 09:08:35 netgenic syslogd: kernel boot file is /boot/kernel/kernel
b
Sep 18 09:08:35 netgenic kernel: Copyright (c) 1992-2005 The FreeBSD Project.
Sep 18 09:08:35 netgenic kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Sep 18 09:08:35 netgenic kernel: The Regents of the University of California. All rights reserved.
Sep 18 09:08:35 netgenic kernel: FreeBSD 5.4-STABLE #1: Thu Sep 22 11:52:32 MSD 2005
Sep 18 09:08:35 netgenic kernel: sergey@ng-new.pac.ru:/usr/src/sys/i386/compile/NETGENIC
Sep 18 09:08:35 netgenic kernel: ACPI APIC Table: <PTLTD APIC >
Sep 18 09:08:35 netgenic kernel: Timecounter "i8254" frequency 1193182 Hz quality 0
Sep 18 09:08:35 netgenic kernel: CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz 686-class CPU)
Sep 18 09:08:35 netgenic kernel: Origin = "GenuineIntel" Id = 0xf41 Stepping = 1
Sep 18 09:08:35 netgenic kernel: Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE
2,SS,HTT,TM,PBE>
Sep 18 09:08:35 netgenic kernel: Hyperthreading: 2 logical CPUs
Sep 18 09:08:35 netgenic kernel: real memory = 2146893824 (2047 MB)
Sep 18 09:08:35 netgenic kernel: avail memory = 2099630080 (2002 MB)
Sep 18 09:08:35 netgenic kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
Sep 18 09:08:35 netgenic kernel: cpu0 (BSP): APIC ID: 0
Sep 18 09:08:35 netgenic kernel: cpu1 (AP): APIC ID: 1
Sep 18 09:08:35 netgenic kernel: cpu2 (AP): APIC ID: 6
Sep 18 09:08:35 netgenic kernel: cpu3 (AP): APIC ID: 7
Sep 18 09:08:35 netgenic kernel: ioapic0 <Version 2.0> irqs 0-23 on motherboard
Sep 18 09:08:35 netgenic kernel: ioapic1 <Version 2.0> irqs 24-47 on motherboard
Sep 18 09:08:35 netgenic kernel: ioapic2 <Version 2.0> irqs 48-71 on motherboard
Sep 18 09:08:35 netgenic kernel: ioapic3 <Version 2.0> irqs 72-95 on motherboard
Sep 18 09:08:35 netgenic kernel: ioapic4 <Version 2.0> irqs 96-119 on motherboard
Sep 18 09:08:35 netgenic kernel: npx0: <math processor> on motherboard
Sep 18 09:08:35 netgenic kernel: npx0: INT 16 interface
Sep 18 09:08:35 netgenic kernel: acpi0: <PTLTD RSDT> on motherboard
Sep 18 09:08:35 netgenic kernel: acpi0: Power Button (fixed)
Sep 18 09:08:35 netgenic kernel: Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
Sep 18 09:08:35 netgenic kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
Sep 18 09:08:35 netgenic kernel: cpu0: <ACPI CPU> on acpi0
Sep 18 09:08:35 netgenic kernel: cpu1: <ACPI CPU> on acpi0
Sep 18 09:08:35 netgenic kernel: cpu2: <ACPI CPU> on acpi0
Sep 18 09:08:35 netgenic kernel: cpu3: <ACPI CPU> on acpi0
.................... #сокращение
Sep 18 09:08:35 netgenic kernel: Mounting root from ufs:/dev/amrd0s1a
Sep 18 09:08:35 netgenic kernel: WARNING: / was not properly dismounted
Sep 18 09:08:35 netgenic kernel: WARNING: /tmp was not properly dismounted
Sep 18 09:08:35 netgenic kernel: /tmp: mount pending error: blocks 16 files 6
Sep 18 09:08:35 netgenic kernel: WARNING: /usr was not properly dismounted
Sep 18 09:08:35 netgenic kernel: WARNING: /var was not properly dismounted
Sep 18 09:08:35 netgenic kernel: /var: mount pending error: blocks 112 files 38
Sep 18 09:08:35 netgenic kernel: WARNING: /mnt/belmax was not properly dismounted
Sep 18 09:08:35 netgenic kernel: WARNING: /mnt/soft was not properly dismounted
Sep 18 09:08:36 netgenic named[388]: starting BIND 9.3.1 -u bind -t /var/named
Sep 18 09:08:36 netgenic named[388]: zone 'ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:08:36 netgenic named[388]: zone '_msdcs.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:08:36 netgenic named[388]: zone '_sites.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:08:36 netgenic named[388]: zone '_tcp.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:08:36 netgenic named[388]: zone '_udp.ivory.pac.ru' allows updates by IP address, which is insecure
Sep 18 09:08:36 netgenic named[388]: command channel listening on 127.0.0.1#953
Sep 18 09:08:36 netgenic named[388]: running
Sep 18 09:08:37 netgenic kernel: em0: Link is up 100 Mbps Full Duplex
Sep 18 09:08:52 netgenic named[388]: /usr/src/lib/bind/isc/../../../contrib/bind9/lib/isc/unix/socket.c:1115: unexpected error:
Sep 18 09:08:52 netgenic named[388]: internal_send: 192.134.0.49#53: Network is down
Sep 18 09:08:52 netgenic named[388]: /usr/src/lib/bind/isc/../../../contrib/bind9/lib/isc/unix/socket.c:1115: unexpected error:
Sep 18 09:08:52 netgenic named[388]: internal_send: 213.189.225.74#53: Network is down
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: LINK COUNT DIR I=2 OWNER=root MODE=41777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=5632 MTIME=Sep 18 09:09 2006 COUNT 23 SHOULD BE 14 (ADJUSTED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF FILE I=212 OWNER=mysql MODE=140777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=0 MTIME=Aug 11 14:06 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF FILE I=214 OWNER=root MODE=100600
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=0 MTIME=Sep 15 10:37 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF DIR I=141312 OWNER=root MODE=41777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=512 MTIME=Aug 11 13:55 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF DIR I=164864 OWNER=root MODE=41777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=512 MTIME=Aug 11 13:55 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: ZERO LENGTH DIR I=259072 OWNER=root MODE=40755
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=0 MTIME=Sep 18 09:00 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF DIR I=282624 OWNER=root MODE=41777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=512 MTIME=Aug 11 13:55 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: UNREF DIR I=447488 OWNER=root MODE=41777
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: SIZE=512 MTIME=Aug 11 13:55 2006 (CLEARED)
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: Reclaimed: 6 directories, 10 files, 4 fragments
Sep 18 09:10:31 netgenic fsck: /dev/amrd0s1d: 244 files, 3902 used, 2025125 free (149 frags, 253122 blocks, 0.0% fragmentation)
Sep 18 09:11:56 netgenic fsck: /dev/amrd0s1f: PARTIALLY TRUNCATED INODE I=3252405
Sep 18 09:11:56 netgenic fsck: /dev/amrd0s1f: UNEXPECTED SOFT UPDATE INCONSISTENCY; RUN fsck MANUALLY.
Sep 18 10:31:34 netgenic syslogd: kernel boot file is /boot/kernel/kernel
Sep 18 10:31:34 netgenic kernel: Copyright (c) 1992-2005 The FreeBSD Project.
Sep 18 10:31:34 netgenic kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
После fsck -y сервер загрузился, но ошибки bind'a все равно появляются. Прошу помощи.