From owner-freebsd-current@FreeBSD.ORG Fri Sep 21 21:57:22 2007 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1B6BC16A418 for ; Fri, 21 Sep 2007 21:57:22 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.177]) by mx1.freebsd.org (Postfix) with ESMTP id 9279F13C447 for ; Fri, 21 Sep 2007 21:57:21 +0000 (UTC) (envelope-from biancalana@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so1873043pyb for ; Fri, 21 Sep 2007 14:57:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=W4XTmTZcyDqvMwy+OD+Lx4mWuxNkFIRzPEAdaa8RLPY=; b=PcIP7/plPNgaLSd+lr+0GLLruZMTC5+Lc3jW0ZhwYxaxNLMVUJTRngvMA/GO8m5BQoQbbLKQu2M8mKnYwbjKpcrRSZqwPrMcCAw2Wgx8ARtyUPS4p/zCVNu59eP1MZTeGiUq2kV8EpqDZjpZW5ywdB4T86BQIUi5muhSoupOj+Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:mime-version:content-type; b=SwJHpl8qHHH/mLScvSEZD3eZ7gvxa3BpPgKXdcBc3d8/kdOL0mkm4vpyb50dzOmZS+yK5gvb+U/JA5WrZ+ucVBS/bDehFerNcXC7Vo/HzIA9rgAoEkZX1iTRxrfbq8pIqvVxQs1i0qwIPput95+dGp1ymnb18fRfKHfTYdC3Yzw= Received: by 10.65.234.2 with SMTP id l2mr1875744qbr.1190411839753; Fri, 21 Sep 2007 14:57:19 -0700 (PDT) Received: by 10.64.233.13 with HTTP; Fri, 21 Sep 2007 14:57:19 -0700 (PDT) Message-ID: <8e10486b0709211457v7771bd66kf3df5ea45ab0d325@mail.gmail.com> Date: Fri, 21 Sep 2007 18:57:19 -0300 From: "Alexandre Biancalana" To: current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: process size X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2007 21:57:22 -0000 Hi List, I'm trying to copy ~800GB to my new backup server via rsync, but the rsync process die when it's vsz is close to 1G with the following message: # rsync -av 192.168.0.13::root/backup/* . receiving file list ... ERROR: out of memory in make_file rsync error: error allocating core memory buffers (code 22) at util.c(120) [sender=2.6.8] rsync: connection unexpectedly closed (155637057 bytes received so far) [receiver] rsync error: error in rsync protocol data stream (code 12) at io.c(462) [receiver=2.6.9] Here is the last ps -aux line of the process before die: root 856 0.4 68.1 915248 707048 p0 S+ 6:32PM 0:12.51 rsync -av 192.168.0.13::root/backup/* . # limits Resource limits (current): cputime infinity secs filesize infinity kB datasize 4194304 kB stacksize 2097152 kB coredumpsize infinity kB memoryuse infinity kB memorylocked infinity kB maxprocesses 5547 openfiles 11095 sbsize infinity bytes vmemoryuse infinity kB I tried to set insane high values of data and stack: kern.maxdsiz="4294967296" kern.dfldsiz="4294967296" kern.maxssiz="2147483648" vm.kmem_size_max="1073741824" vm.kmem_size="1073741824" This is -CURRENT compiled today with 1GB Ram and ZFS. Am I tuning the wrong values ? Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.0-CURRENT #2: Fri Sep 21 18:06:33 BRT 2007 root@:/usr/obj/usr/src/sys/BACKUP Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz (2409.69-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 Features=0xbfebfbff Features2=0xe3bd AMD Features=0x20100800 AMD Features2=0x1 Logical CPUs per core: 2 usable memory = 1062912000 (1013 MB) avail memory = 1022889984 (975 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0: Changing APIC ID to 2 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 928092806000928 device_attach: est0 attach returned 6 p4tcc0: on cpu0 cpu1: on acpi0 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 928092806000928 device_attach: est1 attach returned 6 p4tcc1: on cpu1 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib2: at device 3.0 on pci0 pci2: on pcib2 arcmsr0: mem 0x44100000-0x44101fff irq 16 at device 0.0 on pci2 ARECA RAID ADAPTER0: Driver Version 1.20.00.14 2007-2-05 ARECA RAID ADAPTER0: FIRMWARE VERSION V1.42 2006-10-13 arcmsr0: [ITHREAD] pcib3: at device 28.0 on pci0 pci3: on pcib3 pcib4: at device 28.4 on pci0 pci4: on pcib4 pcib5: at device 28.5 on pci0 pci5: on pcib5 em0: port 0x1000-0x101f mem 0x44000000-0x4401ffff irq 17 at device 0.0 on pci5 em0: Ethernet address: 00:19:d1:11:f0:6c em0: [FILTER] uhci0: port 0x2080-0x209f irq 23 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0x2060-0x207f irq 19 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0x2040-0x205f irq 18 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb2: on uhci2 usb2: USB revision 1.0 uhub2: on usb2 uhub2: 2 ports with 2 removable, self powered uhci3: port 0x2020-0x203f irq 16 at device 29.3 on pci0 uhci3: [GIANT-LOCKED] uhci3: [ITHREAD] usb3: on uhci3 usb3: USB revision 1.0 uhub3: on usb3 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0x44200400-0x442007ff irq 23 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: on usb4 uhub4: 8 ports with 8 removable, self powered pcib6: at device 30.0 on pci0 pci6: on pcib6 vgapci0: mem 0x40000000-0x43ffffff irq 18 at device 2.0 on pci6 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20b0-0x20bf irq 18 at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] atapci1: port 0x20c8-0x20cf,0x20e4-0x20e7,0x20c0-0x20c7,0x20e0-0x20e3,0x20a0-0x20af mem 0x44200000-0x442003ff irq 19 at device 31.2 on pci0 atapci1: [ITHREAD] atapci1: AHCI Version 01.10 controller with 4 ports detected ata2: on atapci1 ata2: [ITHREAD] ata3: on atapci1 ata3: [ITHREAD] ata4: on atapci1 ata4: [ITHREAD] ata5: on atapci1 ata5: [ITHREAD] pci0: at device 31.3 (no driver attached) fdc0: port 0x3f0-0x3f5,0x3f0 irq 6 drq 2 on acpi0 fdc0: [FILTER] sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ukbd0: on uhub1 kbd2 at ukbd0 Timecounters tick every 1.000 msec Waiting 5 seconds for SCSI devices to settle ad0: 76319MB at ata0-master UDMA100 (probe16:arcmsr0:0:16:0): inquiry data fails comparison at DV1 step SMP: AP CPU #1 Launched! da0 at arcmsr0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 166.666MB/s transfers (83.333MHz DT, offset 32, 16bit) da0: 3814696MB (7812497408 512 byte sectors: 255H 63S/T 486305C) Trying to mount root from ufs:/dev/ad0s1a WARNING: ZFS is considered to be an experimental feature in FreeBSD. ZFS filesystem version 6