Date: Fri, 19 Apr 2002 22:40:57 -0300 (ADT) From: "Marc G. Fournier" <scrappy@hub.org> To: freebsd-stable@freebsd.org Subject: 4.5-STABLE panicks ... KVA_PAGES the solution? Or ... ? Message-ID: <20020419223140.B62758-100000@mail1.hub.org>
next in thread | raw e-mail | index | archive | help
Morning ...
I have a server with the following specs from DMESG:
Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.5-STABLE #7: Fri Apr 12 09:20:30 CDT 2002
root@jupiter.hub.org:/usr/obj/usr/src/sys/kernel
Timecounter "i8254" frequency 1193182 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (996.84-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x68a Stepping = 10
Features=0x387fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,PN,MMX,FXSR,SSE>
real memory = 3221225472 (3145728K bytes)
avail memory = 3135082496 (3061604K bytes)
Programming 16 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
Programming 16 pins in IOAPIC #1
FreeBSD/SMP: Multiprocessor motherboard
cpu0 (BSP): apic id: 0, version: 0x00040011, at 0xfee00000
cpu1 (AP): apic id: 1, version: 0x00040011, at 0xfee00000
io0 (APIC): apic id: 4, version: 0x000f0011, at 0xfec00000
io1 (APIC): apic id: 5, version: 0x000f0011, at 0xfec01000
<stuff deleted>
Which crashes on me at around 2am in the morning (either after 24
or 48hrs of uptime, depending on my luck) with the following error:
| panic: vm_map_entry_create: kernel resources exhausted
| mp_lock = 01000001; cpuid = 1; lapic.id = 01000000
| boot() called on cpu#1
Attached at the bottom of this is my current kernel config ...
last night, I ran top on the system and cut-n-paste the results from when
it hung, which look like:
last pid: 84988; load averages: 19.82, 57.35, 44.426 up 0+23:33:12 02:05:00
5021 processes:16 running, 5005 sleeping
CPU states: 8.7% user, 0.0% nice, 24.3% system, 2.2% interrupt, 64.7% idle
Mem: 2320M Active, 211M Inact, 390M Wired, 92M Cache, 199M Buf, 4348K Free
Swap: 3072M Total, 1048M Used, 2024M Free, 34% Inuse, 448K Out
So, I have plenty of swapspace left, lots of idle CPU and a whole whack of processes ...
Someone suggested setting KVA_PAGES higher then the default for
this, but, as this is a production server, and its not something I've ever
played with, I'd like to know what the ramifications are ...
The server has 3Gig of RAM now ... according to opt_global.h,
KVA_PAGES is set to 256 (1G) right now ... but if its 1G by default, how
does a system withi <1G of RAM in it "work"? Or does this limit something
else altogether? I'm not finding any good 'reading material' on this so
far, but from waht I found through a search, it seems that its recommended
to be set to 768(3G) vs 256(1G)?
Now, looking at the LINT file, there appears to be *alot* of
things I could change ... for instance, NSFBUFS ... but how do you
determine what to change? For instance, at a maxusers of 512, NSFBUFS
should be ~8704, and if I've only got 5000 processes running, chances are
I'm still safe at that value, no? But sysctl doesn't show any 'sf_buf'
value, so how do I figure out what I'm using?
Is there a doc on this sort of stuff that I should be reading for
this? Something that talks about kernel tuning for high-load/processes
servers?
Thanks for any help in advance ..
-------------------
machine i386
cpu I686_CPU
ident kernel
maxusers 512
options NMBCLUSTERS=15360
options INET #InterNETworking
options INET6 #IPv6 communications protocols
options FFS #Berkeley Fast Filesystem
options FFS_ROOT #FFS usable as root device [keep this!]
options SOFTUPDATES #Enable FFS soft updates support
options PROCFS #Process filesystem
options COMPAT_43 #Compatible with BSD 4.3 [KEEP THIS!]
options SCSI_DELAY=15000 #Delay (in ms) before probing SCSI
options KTRACE #ktrace(1) support
options SYSVSHM
options SHMMAXPGS=98304
options SHMMAX=(SHMMAXPGS*PAGE_SIZE+1)
options SYSVSEM
options SEMMNI=2048
options SEMMNS=4096
options SYSVMSG #SYSV-style message queues
options P1003_1B #Posix P1003_1B real-time extensions
options _KPOSIX_PRIORITY_SCHEDULING
options ICMP_BANDLIM #Rate limit bad replies
options SMP # Symmetric MultiProcessor Kernel
options APIC_IO # Symmetric (APIC) I/O
device isa
device pci
device scbus # SCSI bus (required)
device da # Direct Access (disks)
device sa # Sequential Access (tape etc)
device cd # CD
device pass # Passthrough device (direct SCSI access)
device amr # AMI MegaRAID
device sym
device atkbdc0 at isa? port IO_KBD
device atkbd0 at atkbdc? irq 1 flags 0x1
device psm0 at atkbdc? irq 12
device vga0 at isa?
pseudo-device splash
device sc0 at isa? flags 0x100
device npx0 at nexus? port IO_NPX irq 13
device sio0 at isa? port IO_COM1 flags 0x10 irq 4
device sio1 at isa? port IO_COM2 irq 3
device miibus # MII bus support
device fxp # Intel EtherExpress PRO/100B (82557, 82558)
pseudo-device loop # Network loopback
pseudo-device ether # Ethernet support
pseudo-device pty 256 # Pseudo-ttys (telnet etc)
pseudo-device gif # IPv6 and IPv4 tunneling
pseudo-device faith 1 # IPv6-to-IPv4 relaying (translation)
pseudo-device bpf #Berkeley packet filter
To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-stable" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20020419223140.B62758-100000>