From owner-freebsd-hackers Tue Feb 20 10:25: 5 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from smtp.nettoll.com (matrix.nettoll.net [212.155.143.61]) by hub.freebsd.org (Postfix) with ESMTP id ACABB37B65D for ; Tue, 20 Feb 2001 10:24:48 -0800 (PST) (envelope-from usebsd@free.fr) Received: by smtp.nettoll.com; Tue, 20 Feb 2001 19:22:20 +0100 (MET) Message-Id: <4.3.0.20010220192222.04fd4100@pop.free.fr> X-Sender: usebsd@pop.free.fr X-Mailer: QUALCOMM Windows Eudora Version 4.3 Date: Tue, 20 Feb 2001 19:24:22 +0100 To: Len Conrad , freebsd-hackers@freebsd.org From: mouss Subject: Re: postfix: No buffer space available In-Reply-To: <5.0.0.25.0.20010220140218.02df9c10@mail.Go2France.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG You might want to try setting net.inet.tcp.sendspace net.inet.tcp.recvspace to larger values. I have these in my /etc/sysctl.conf. regards, mouss At 15:28 20/02/01 +0100, Len Conrad wrote: >Sorry to bother you hackers again, but two submissions to -questions got >no response so it looks like another scaleability issue on you people can >handle : > >================ > >On a very busy postfix relay hub, we're seeing this: > >Feb 19 15:00:16 imgate2 postfix/smtpd[323]: fatal: socket: No buffer >space available > >Feb 19 15:00:17 imgate2 postfix/smtp[684]: fatal: socket: No buffer >space available > >Can we fix this with a systcl write? > >The server already has: > ># sysctl -a | grep maxfile >kern.maxfiles: 16384 >kern.maxfilesperproc: 16384 > >... which fixed "fatal: too many files open" pb for this client last November. > >btw, Wietse Venema himself asked me to be informed of how I manage to >tweak FreeBSD to handle this apparent scaleability issue. > >"sysctl -a" > >gives: > >kern.ostype: FreeBSD >kern.osrelease: 4.1.1-RELEASE >kern.osrevision: 199506 >kern.version: FreeBSD 4.1.1-RELEASE #0: Tue Sep 26 00:46:59 GMT 2000 > jkh@narf.osd.bsdi.com:/usr/src/sys/compile/GENERIC > >kern.maxvnodes: 32525 >kern.maxproc: 532 >kern.maxfiles: 16384 >kern.argmax: 65536 >kern.securelevel: -1 >kern.hostname: imgate2.snip.net >kern.hostid: 0 >kern.clockrate: { hz = 100, tick = 10000, tickadj = 5, profhz = 1024, >stathz = 128 } >kern.posix1version: 199309 >kern.ngroups: 16 >kern.job_control: 1 >kern.saved_ids: 0 >kern.boottime: { sec = 982608649, usec = 136401 } Mon Feb 19 13:50:49 2001 >kern.domainname: >kern.osreldate: 411000 >kern.bootfile: /kernel >kern.maxfilesperproc: 16384 >kern.maxprocperuid: 531 >kern.dumpdev: >kern.ipc.maxsockbuf: 262144 >kern.ipc.sockbuf_waste_factor: 8 >kern.ipc.somaxconn: 128 >kern.ipc.max_linkhdr: 16 >kern.ipc.max_protohdr: 60 >kern.ipc.max_hdr: 76 >kern.ipc.max_datalen: 136 >kern.ipc.nmbclusters: 1024 >kern.ipc.semmap: 30 >kern.ipc.semmni: 10 >kern.ipc.semmns: 60 >kern.ipc.semmnu: 30 >kern.ipc.semmsl: 60 >kern.ipc.semopm: 100 >kern.ipc.semume: 10 >kern.ipc.semusz: 92 >kern.ipc.semvmx: 32767 >kern.ipc.semaem: 16384 >kern.ipc.shmmax: 4194304 >kern.ipc.shmmin: 1 >kern.ipc.shmmni: 96 >kern.ipc.shmseg: 64 >kern.ipc.shmall: 1024 >kern.ipc.shm_use_phys: 0 >kern.ipc.mbuf_wait: 32 >kern.ipc.mbtypes: 460 164 160 0 0 0 0 0 0 0 0 0 0 0 0 0 >kern.ipc.nmbufs: 4096 >kern.ipc.maxsockets: 1064 >kern.dummy: 0 >kern.ps_strings: 3217031152 >kern.usrstack: 3217031168 >kern.logsigexit: 1 >kern.cam.cd.changer.min_busy_seconds: 5 >kern.cam.cd.changer.max_busy_seconds: 15 >kern.fallback_elf_brand: 9 >kern.init_path: /sbin/init:/sbin/oinit:/sbin/init.bak:/stand/sysinstall >kern.module_path: /;/boot/;/modules/ >kern.acct_suspend: 2 >kern.acct_resume: 4 >kern.acct_chkfreq: 15 >kern.timecounter.method: 0 >kern.timecounter.hardware: i8254 >kern.ps_arg_cache_limit: 256 >kern.ps_argsopen: 1 >kern.fast_vfork: 1 >kern.randompid: 0 >kern.ps_showallprocs: 1 >kern.shutdown.poweroff_delay: 5000 >kern.shutdown.kproc_shutdown_wait: 60 >kern.sugid_coredump: 0 >kern.coredump: 1 >kern.corefile: %N.core >kern.quantum: 100000 >kern.ccpu: 1948 >kern.fscale: 2048 >kern.devstat.numdevs: 7 >kern.devstat.generation: 7 >kern.devstat.version: 4 >kern.nselcoll: 60034 >kern.consmute: 0 >kern.filedelay: 30 >kern.dirdelay: 29 >kern.metadelay: 28 >kern.chroot_allow_open_directories: 1 >vm.loadavg: { 0.39 0.43 0.52 } >vm.v_free_min: 886 >vm.v_free_target: 2906 >vm.v_free_reserved: 248 >vm.v_inactive_target: 4359 >vm.v_cache_min: 2906 >vm.v_cache_max: 5812 >vm.v_pageout_free_min: 34 >vm.pageout_algorithm: 0 >vm.swap_enabled: 1 >vm.swap_async_max: 4 >vm.swap_idle_threshold1: 2 >vm.swap_idle_threshold2: 10 >vm.v_free_severe: 567 >vm.stats.sys.v_swtch: 15651300 >vm.stats.sys.v_trap: 1045137 >vm.stats.sys.v_syscall: 53830549 >vm.stats.sys.v_intr: 19460810 >vm.stats.sys.v_soft: 3519936 >vm.stats.vm.v_vm_faults: 610808 >vm.stats.vm.v_cow_faults: 138115 >vm.stats.vm.v_cow_optim: 0 >vm.stats.vm.v_zfod: 310288 >vm.stats.vm.v_ozfod: 309994 >vm.stats.vm.v_swapin: 0 >vm.stats.vm.v_swapout: 0 >vm.stats.vm.v_swappgsin: 0 >vm.stats.vm.v_swappgsout: 0 >vm.stats.vm.v_vnodein: 374 >vm.stats.vm.v_vnodeout: 0 >vm.stats.vm.v_vnodepgsin: 2490 >vm.stats.vm.v_vnodepgsout: 0 >vm.stats.vm.v_intrans: 2 >vm.stats.vm.v_reactivated: 125 >vm.stats.vm.v_pdwakeups: 0 >vm.stats.vm.v_pdpages: 0 >vm.stats.vm.v_dfree: 0 >vm.stats.vm.v_pfree: 355480 >vm.stats.vm.v_tfree: 809980 >vm.stats.vm.v_page_size: 4096 >vm.stats.vm.v_page_count: 127974 >vm.stats.vm.v_free_reserved: 248 >vm.stats.vm.v_free_target: 2906 >vm.stats.vm.v_free_min: 886 >vm.stats.vm.v_free_count: 97173 >vm.stats.vm.v_wire_count: 8879 >vm.stats.vm.v_active_count: 11659 >vm.stats.vm.v_inactive_target: 4359 >vm.stats.vm.v_inactive_count: 10259 >vm.stats.vm.v_cache_count: 4 >vm.stats.vm.v_cache_min: 2906 >vm.stats.vm.v_cache_max: 5812 >vm.stats.vm.v_pageout_free_min: 34 >vm.stats.vm.v_interrupt_free_min: 2 >vm.stats.misc.zero_page_count: 70388 >vm.stats.misc.cnt_prezero: 376460 >vm.max_proc_mmap: 36401 >vm.pageout_stats_max: 2906 >vm.pageout_full_stats_interval: 20 >vm.pageout_stats_interval: 5 >vm.pageout_stats_free_max: 5 >vm.swap_idle_enabled: 0 >vm.defer_swapspace_pageouts: 0 >vm.disable_swapspace_pageouts: 0 >vm.max_page_launder: 32 >vm.zone: >ITEM SIZE LIMIT USED FREE REQUESTS > >PIPE: 160, 0, 36, 66, 1232 >SWAPMETA: 160, 255948, 0, 0, 0 >tcpcb: 544, 1064, 135, 173, 116705 >unpcb: 64, 0, 406, 490, 334655 >ripcb: 192, 1064, 0, 42, 2 >tcpcb: 544, 1064, 0, 0, 0 >udpcb: 192, 1064, 15, 69, 518065 >socket: 192, 1064, 556, 494, 969428 >KNOTE: 64, 0, 13, 115, 515373 >NFSNODE: 320, 0, 0, 0, 0 >NFSMOUNT: 544, 0, 0, 0, 0 >VNODE: 192, 0, 3547, 57, 3547 >NAMEI: 1024, 0, 0, 32, 2582839 >VMSPACE: 192, 0, 158, 226, 6604 >PROC: 416, 0, 162, 181, 6612 >DP fakepg: 64, 0, 0, 0, 0 >PV ENTRY: 28, 368522, 37542, 93519, 2439070 >MAP ENTRY: 48, 0, 1935, 2018, 198503 >KMAP ENTRY: 48, 32121, 800, 93, 2352 >MAP: 108, 0, 7, 3, 7 >VM OBJECT: 96, 0, 3017, 1145, 198323 >vm.zone_kmem_pages: 109 >vm.zone_kmem_kvaspace: 50917376 >vm.zone_kern_pages: 389 >vfs.nfs.nfs_privport: 0 >vfs.nfs.async: 0 >vfs.nfs.commit_blks: 0 >vfs.nfs.commit_miss: 0 >vfs.nfs.realign_test: 0 >vfs.nfs.realign_count: 0 >vfs.nfs.bufpackets: 4 >vfs.nfs.gatherdelay: 10000 >vfs.nfs.gatherdelay_v3: 0 >vfs.nfs.defect: 0 >vfs.nfs.diskless_valid: 0 >vfs.nfs.diskless_rootpath: >vfs.nfs.diskless_swappath: >vfs.nfs.access_cache_timeout: 60 >vfs.nfs.nfsv3_commit_on_close: 0 >vfs.numdirtybuffers: 175 >vfs.hidirtybuffers: 999 >vfs.numfreebuffers: 3743 >vfs.lofreebuffers: 222 >vfs.hifreebuffers: 444 >vfs.runningbufspace: 0 >vfs.maxbufspace: 64192512 >vfs.hibufspace: 63537152 >vfs.lobufspace: 63471616 >vfs.bufspace: 63471616 >vfs.maxbdrun: 64 >vfs.maxmallocbufspace: 3176857 >vfs.bufmallocspace: 906240 >vfs.getnewbufcalls: 256989 >vfs.getnewbufrestarts: 0 >vfs.vmiodirenable: 0 >vfs.bufdefragcnt: 0 >vfs.buffreekvacnt: 0 >vfs.bufreusecnt: 3874 >vfs.cache.numneg: 198 >vfs.cache.numcache: 3175 >vfs.cache.numcalls: 6561612 >vfs.cache.dothits: 41443 >vfs.cache.dotdothits: 4051 >vfs.cache.numchecks: 9809415 >vfs.cache.nummiss: 435273 >vfs.cache.nummisszap: 367588 >vfs.cache.numposzaps: 168979 >vfs.cache.numposhits: 5454779 >vfs.cache.numnegzaps: 2886 >vfs.cache.numneghits: 86613 >vfs.cache.numcwdcalls: 306 >vfs.cache.numcwdfail1: 0 >vfs.cache.numcwdfail2: 0 >vfs.cache.numcwdfail3: 0 >vfs.cache.numcwdfail4: 0 >vfs.cache.numcwdfound: 306 >vfs.cache.numfullpathcalls: 0 >vfs.cache.numfullpathfail1: 0 >vfs.cache.numfullpathfail2: 0 >vfs.cache.numfullpathfail3: 0 >vfs.cache.numfullpathfail4: 0 >vfs.cache.numfullpathfound: 0 >vfs.write_behind: 1 >vfs.reassignbufcalls: 1115698 >vfs.reassignbufloops: 0 >vfs.reassignbufsortgood: 229967 >vfs.reassignbufsortbad: 327979 >vfs.reassignbufmethod: 1 >vfs.timestamp_precision: 0 >vfs.usermount: 0 >vfs.ffs.doreallocblks: 1 >vfs.ffs.doasyncfree: 1 >net.local.stream.sendspace: 8192 >net.local.stream.recvspace: 8192 >net.local.dgram.maxdgram: 2048 >net.local.dgram.recvspace: 4096 >net.local.inflight: 0 >net.inet.ip.portrange.lowfirst: 1023 >net.inet.ip.portrange.lowlast: 600 >net.inet.ip.portrange.first: 1024 >net.inet.ip.portrange.last: 5000 >net.inet.ip.portrange.hifirst: 49152 >net.inet.ip.portrange.hilast: 65535 >net.inet.ip.forwarding: 0 >net.inet.ip.redirect: 1 >net.inet.ip.ttl: 64 >net.inet.ip.rtexpire: 62 >net.inet.ip.rtminexpire: 10 >net.inet.ip.rtmaxcache: 128 >net.inet.ip.sourceroute: 0 >net.inet.ip.intr_queue_maxlen: 50 >net.inet.ip.intr_queue_drops: 0 >net.inet.ip.accept_sourceroute: 0 >net.inet.ip.fastforwarding: 0 >net.inet.ip.keepfaith: 0 >net.inet.ip.gifttl: 30 >net.inet.ip.subnets_are_local: 0 >net.inet.icmp.maskrepl: 0 >net.inet.icmp.icmplim: 200 >net.inet.icmp.drop_redirect: 0 >net.inet.icmp.log_redirect: 0 >net.inet.icmp.bmcastecho: 0 >net.inet.tcp.rfc1323: 0 >net.inet.tcp.rfc1644: 0 >net.inet.tcp.mssdflt: 512 >net.inet.tcp.keepidle: 7200000 >net.inet.tcp.keepintvl: 75000 >net.inet.tcp.sendspace: 16384 >net.inet.tcp.recvspace: 16384 >net.inet.tcp.keepinit: 75000 >net.inet.tcp.delacktime: 100 >net.inet.tcp.v6mssdflt: 1024 >net.inet.tcp.log_in_vain: 0 >net.inet.tcp.blackhole: 0 >net.inet.tcp.delayed_ack: 1 >net.inet.tcp.tcp_lq_overflow: 1 >net.inet.tcp.path_mtu_discovery: 1 >net.inet.tcp.slowstart_flightsize: 1 >net.inet.tcp.local_slowstart_flightsize: 65535 >net.inet.tcp.tcbhashsize: 512 >net.inet.tcp.pcbcount: 135 >net.inet.tcp.msl: 30000 >net.inet.tcp.always_keepalive: 1 >net.inet.udp.checksum: 1 >net.inet.udp.maxdgram: 9216 >net.inet.udp.recvspace: 42080 >net.inet.udp.log_in_vain: 0 >net.inet.udp.blackhole: 0 >net.inet.accf.unloadable: 0 >net.inet.raw.maxdgram: 8192 >net.inet.raw.recvspace: 8192 >net.link.generic.system.ifcount: 11 >net.link.ether.inet.prune_intvl: 300 >net.link.ether.inet.max_age: 1200 >net.link.ether.inet.host_down_time: 20 >net.link.ether.inet.maxtries: 5 >net.link.ether.inet.useloopback: 1 >net.link.ether.inet.proxyall: 0 >net.inet6.ip6.forwarding: 0 >net.inet6.ip6.redirect: 1 >net.inet6.ip6.hlim: 64 >net.inet6.ip6.maxfragpackets: 200 >net.inet6.ip6.accept_rtadv: 0 >net.inet6.ip6.keepfaith: 0 >net.inet6.ip6.log_interval: 5 >net.inet6.ip6.hdrnestlimit: 50 >net.inet6.ip6.dad_count: 1 >net.inet6.ip6.auto_flowlabel: 1 >net.inet6.ip6.defmcasthlim: 1 >net.inet6.ip6.gifhlim: 30 >net.inet6.ip6.kame_version: 20000701/FreeBSD-current >net.inet6.ip6.use_deprecated: 1 >net.inet6.ip6.rr_prune: 5 >net.inet6.ip6.mapped_addr: 1 >net.inet6.ip6.rtexpire: 3600 >net.inet6.ip6.rtminexpire: 10 >net.inet6.ip6.rtmaxcache: 128 >net.inet6.icmp6.rediraccept: 1 >net.inet6.icmp6.redirtimeout: 600 >net.inet6.icmp6.errratelimit: 0 >net.inet6.icmp6.nd6_prune: 1 >net.inet6.icmp6.nd6_delay: 5 >net.inet6.icmp6.nd6_umaxtries: 3 >net.inet6.icmp6.nd6_mmaxtries: 3 >net.inet6.icmp6.nd6_useloopback: 1 >net.inet6.icmp6.nodeinfo: 1 >net.inet6.icmp6.errppslimit: 100 >net.inet6.icmp6.nd6_maxnudhint: 0 >debug.mddebug: 0 >debug.elf_trace: 0 >debug.boothowto: -2147483648 >debug.free_devt: 0 >debug.fdexpand: 13 >debug.sizeof.vnode: 164 >debug.sizeof.proc: 408 >debug.sizeof.specinfo: 76 >debug.sizeof.disklabel: 276 >debug.sizeof.diskslices: 1820 >debug.sizeof.disk: 296 >debug.ttydebug: 0 >debug.nchash: 32767 >debug.ncnegfactor: 16 >debug.numneg: 198 >debug.numcache: 3175 >debug.vfscache: 1 >debug.vnsize: 164 >debug.ncsize: 36 >debug.disablecwd: 0 >debug.disablefullpath: 0 >debug.numvnodes: 3547 >debug.wantfreevnodes: 25 >debug.freevnodes: 1171 >debug.rush_requests: 0 >debug.bpf_bufsize: 4096 >debug.bpf_maxbufsize: 524288 >debug.if_tun_debug: 0 >debug.do_tcpdrain: 1 >debug.ncr_debug: 0 >debug.max_softdeps: 260200 >debug.tickdelay: 2 >debug.blk_limit_push: 0 >debug.ino_limit_push: 0 >debug.blk_limit_hit: 0 >debug.ino_limit_hit: 0 >debug.indir_blk_ptrs: 0 >debug.inode_bitmap: 0 >debug.direct_blk_ptrs: 0 >debug.dir_entry: 0 >debug.dircheck: 0 >hw.machine: i386 >hw.model: Pentium III/Pentium III Xeon/Celeron >hw.ncpu: 1 >hw.byteorder: 1234 >hw.physmem: 533127168 >hw.usermem: 496754688 >hw.pagesize: 4096 >hw.floatingpoint: 1 >hw.machine_arch: i386 >hw.atamodes: >hw.availpages: 129991 >machdep.consdev: { major = 12, minor = 255 } >machdep.adjkerntz: 18000 >machdep.disable_rtc_set: 0 >machdep.wall_cmos_clock: 1 >machdep.an_cache_mcastonly: 0 >machdep.an_cache_iponly: 1 >machdep.do_dump: 1 >machdep.pccard.pcic_resume_reset: 1 >machdep.enable_panic_key: 0 >machdep.apm_suspend_delay: 1 >machdep.apm_standby_delay: 1 >machdep.ispc98: 0 >machdep.msgbuf: >machdep.msgbuf_clear: 0 >machdep.panic_on_nmi: 1 >machdep.i8254_freq: 1193182 >machdep.cs_recv_delay: 570 >machdep.wi_cache_mcastonly: 0 >machdep.wi_cache_iponly: 1 >machdep.conspeed: 9600 >user.cs_path: /usr/bin:/bin:/usr/sbin:/sbin: >user.bc_base_max: 99 >user.bc_dim_max: 2048 >user.bc_scale_max: 99 >user.bc_string_max: 1000 >user.coll_weights_max: 0 >user.expr_nest_max: 32 >user.line_max: 2048 >user.re_dup_max: 255 >user.posix2_version: 199212 >user.posix2_c_bind: 0 >user.posix2_c_dev: 0 >user.posix2_char_term: 0 >user.posix2_fort_dev: 0 >user.posix2_fort_run: 0 >user.posix2_localedef: 0 >user.posix2_sw_dev: 0 >user.posix2_upe: 0 >user.stream_max: 20 >user.tzname_max: 255 >p1003_1b.asynchronous_io: 0 >p1003_1b.mapped_files: 0 >p1003_1b.memlock: 0 >p1003_1b.memlock_range: 0 >p1003_1b.memory_protection: 0 >p1003_1b.message_passing: 0 >p1003_1b.prioritized_io: 0 >p1003_1b.priority_scheduling: 1 >p1003_1b.realtime_signals: 0 >p1003_1b.semaphores: 0 >p1003_1b.fsync: 0 >p1003_1b.shared_memory_objects: 0 >p1003_1b.synchronized_io: 0 >p1003_1b.timers: 0 >p1003_1b.aio_listio_max: 0 >p1003_1b.aio_max: 0 >p1003_1b.aio_prio_delta_max: 0 >p1003_1b.delaytimer_max: 0 >p1003_1b.mq_open_max: 0 >p1003_1b.pagesize: 4096 >p1003_1b.rtsig_max: 0 >p1003_1b.sem_nsems_max: 0 >p1003_1b.sem_value_max: 0 >p1003_1b.sigqueue_max: 0 >p1003_1b.timer_max: 0 >jail.set_hostname_allowed: 1 > > >To Unsubscribe: send mail to majordomo@FreeBSD.org >with "unsubscribe freebsd-hackers" in the body of the message To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message