From owner-freebsd-xen@FreeBSD.ORG Sun Feb 15 06:54:05 2009 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BF814106564A for ; Sun, 15 Feb 2009 06:54:05 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.238]) by mx1.freebsd.org (Postfix) with ESMTP id 918DE8FC08 for ; Sun, 15 Feb 2009 06:54:05 +0000 (UTC) (envelope-from mat.macy@gmail.com) Received: by rv-out-0506.google.com with SMTP id f6so1286463rvb.43 for ; Sat, 14 Feb 2009 22:54:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=W0AEk9snJurA5DZnsUjoHEp2w0LoAwVTJypg2Gmz3eA=; b=v8+k2C3JJV7inNtZqvaoKT3H9WDdQrsMPEjxp7wtCcr/4cYyaw2UyF7ZNurgWkcCwR u40HGgvuiG8Saq93T4L5YN1wZYVbOwl7K7oqatoTO2o2BHfGf+ADRXaSyfKxmq6riX+v Shz5lw8dLU8mv2dGiEJfXWFWclPOeyJavdu9k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=YKwB5p9WPFBDSSJtCo8U8V0pR0Nsbid6eck2w9ekVyQz7isDrygi1X38I7TZPvfdCE 9wnUbWXJjUZ5H2xvjh3e4Jn+gw0TElZv5rDuLEhCQJQgJeNnv49OJEJBIIWgiZ4YkwoJ VCMkOa1pDn1vsytbtrxCJ/QQZMSSHgdvygD84= MIME-Version: 1.0 Sender: mat.macy@gmail.com Received: by 10.141.48.6 with SMTP id a6mr154894rvk.36.1234680845217; Sat, 14 Feb 2009 22:54:05 -0800 (PST) In-Reply-To: References: <3c1674c90902101130r58c05f07we473c0897fe29481@mail.gmail.com> Date: Sat, 14 Feb 2009 22:54:05 -0800 X-Google-Sender-Auth: eb622a01e4be7a56 Message-ID: <3c1674c90902142254w62aee712j8ae9010361ec5d2a@mail.gmail.com> From: Kip Macy To: Kai Mosebach Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-xen Subject: Re: domU page faults under heavy network load X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Feb 2009 06:54:06 -0000 Is this a recent version of HEAD? I'm not able to reproduce. <...> thru: 1947.346ms at 32.9MB/s ( 27.8MB/s avg) 3.3GB thru: 1946.356ms at 32.9MB/s ( 27.9MB/s avg) 3.4GB thru: 1946.910ms at 32.9MB/s ( 27.9MB/s avg) 3.4GB <...> Maybe some variation in the options? Thanks, Kip On Tue, Feb 10, 2009 at 11:40 AM, Kai Mosebach wrote: > 1024meg > > > On 2/10/09 8:30 PM, "Kip Macy" wrote: > >> How big is the memory allocation to the VM? >> >> Thanks, >> Kip >> >> >> On Tue, Feb 10, 2009 at 7:59 AM, Kai Mosebach wrote: >>> Hi, >>> >>> running r188436M on Xen3.3.1 (Centos5, x86_64). The reason is not to clear >>> but seems related to heavy load on pipes + memory + network? >>> It is repeatable with : >>> >>> bsd8# dd if=/dev/zero | nc otherhost 12345 >>> >>> Fatal trap 12: page fault while in kernel mode >>> cpuid = 0; apic id = 00 >>> fault virtual address = 0xd216dd00 >>> fault code = supervisor read, page not present >>> instruction pointer = 0x21:0xc02e4d40 >>> stack pointer = 0x29:0xc332aba8 >>> frame pointer = 0x29:0xc332abfc >>> code segment = base 0x0, limit 0xfffff, type 0x1b >>> = DPL 1, pres 1, def32 1, gran 1 >>> processor eflags = interrupt enabled, resume, IOPL = 0 >>> current process = 12 (irq137: xn) >>> [thread pid 12 tid 100025 ] >>> Stopped at xlvbd_add+0x2f70: movl 0x900(%edx,%eax,4),%edx >>> db> bt >>> >>> >>> >>> On otherhost i get some stuff (between 19 and 62 MB), after nc closes down >>> eventually >>> >>> otherhost# nc -l 12345 | cpipe -vt -b 65535 >/dev/null >>> ... >>> thru: 108930.791ms at 184.3kB/s ( 184.3kB/s avg) 19.6MB >>> >>> best Kai >>> _______________________________________________ >>> freebsd-xen@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-xen >>> To unsubscribe, send any mail to "freebsd-xen-unsubscribe@freebsd.org" >>> > > > From owner-freebsd-xen@FreeBSD.ORG Mon Feb 16 14:43:13 2009 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A4F1106564A for ; Mon, 16 Feb 2009 14:43:13 +0000 (UTC) (envelope-from gofx-freebsd-xen@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 01FC88FC08 for ; Mon, 16 Feb 2009 14:43:12 +0000 (UTC) (envelope-from gofx-freebsd-xen@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LZ4gg-0002D1-IY for freebsd-xen@freebsd.org; Mon, 16 Feb 2009 14:43:10 +0000 Received: from 217-68-187-100.dynamic.primacom.net ([217.68.187.100]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 16 Feb 2009 14:43:10 +0000 Received: from js by 217-68-187-100.dynamic.primacom.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 16 Feb 2009 14:43:10 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-xen@freebsd.org From: Julian Stecklina Date: Mon, 16 Feb 2009 15:42:58 +0100 Lines: 18 Message-ID: <87skmeqw7h.fsf@tabernacle.lan> References: <877i4d1p46.fsf@tabernacle.localnet> <1233285639.24925.12.camel@phoenix.blechhirn.net> <87ljsokbdn.fsf@tabernacle.localnet> <3c1674c90902042004x299bee3ay7a231a27252e7e55@mail.gmail.com> <8763joeuzz.fsf@tabernacle.localnet> <1233863896.22204.46.camel@phoenix.blechhirn.net> <3c1674c90902051203n338be726rc18ab1f71c513d6c@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 217-68-187-100.dynamic.primacom.net X-Archive: encrypt User-Agent: Gnus/5.101 (Gnus v5.10.10) Cancel-Lock: sha1:dUfDDtecuD0tPNAf10MOQpFsQL0= Sender: news Subject: Re: Time goes backwards X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Feb 2009 14:43:13 -0000 Kip Macy writes: > I will take a closer look. This is clearly a separate issue from the > loss of timer interrupts - I had assumed that they were related. I've seen that you made some changes to the timer code. Is this related to this issue? Btw, VMWare didn't cut it either in building a virtual Xen test box. *bummer* Regards, -- Julian Stecklina Well, take it from an old hand: the only reason it would be easier to program in C is that you can't easily express complex problems in C, so you don't. - Erik Naggum (in comp.lang.lisp) From owner-freebsd-xen@FreeBSD.ORG Tue Feb 17 20:16:41 2009 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A08D106564A for ; Tue, 17 Feb 2009 20:16:41 +0000 (UTC) (envelope-from xen@komadev.de) Received: from zim.freshx.de (zim.freshx.de [83.137.99.113]) by mx1.freebsd.org (Postfix) with ESMTP id AC7E08FC08 for ; Tue, 17 Feb 2009 20:16:40 +0000 (UTC) (envelope-from xen@komadev.de) Received: from localhost (localhost.localdomain [127.0.0.1]) by zim.freshx.de (Postfix) with ESMTP id 3EE3E8C01D5; Tue, 17 Feb 2009 21:16:39 +0100 (CET) X-Virus-Scanned: amavisd-new at zim.freshx.de Received: from zim.freshx.de ([127.0.0.1]) by localhost (zim.freshx.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id P7zvYX-4+Rut; Tue, 17 Feb 2009 21:16:38 +0100 (CET) Received: from zim.freshx.de (zim.freshx.de [192.168.92.113]) by zim.freshx.de (Postfix) with ESMTP id 21BC08C01C2; Tue, 17 Feb 2009 21:16:38 +0100 (CET) Date: Tue, 17 Feb 2009 21:16:38 +0100 (CET) From: xen@komadev.de Sender: kai@freshx.de To: Kip Macy Message-ID: <14830020.49681234901798034.JavaMail.root@zim.freshx.de> In-Reply-To: <13712113.49661234900587705.JavaMail.root@zim.freshx.de> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [129.132.228.92] X-Mailer: Zimbra 5.0.11_GA_2695.RHEL5 (ZimbraWebClient - FF3.0 (Mac)/5.0.11_GA_2695.RHEL5) Cc: freebsd-xen Subject: Re: domU page faults under heavy network load X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Feb 2009 20:16:41 -0000 Hi, in the kernel i disabled: WITNESS WITNESS_SKIPSPIN in /etc/make.conf i enabled DEBUG_FLAGS=-ggdb To make sure that user/kernel are in sync i just rebuilt/installed both. I furthermore tracked down the problem, since it seems to occur only between the dom0 and its domU, but not between the dom0 and a "real" remote host. FreeBSD 8.0-CURRENT #0 r188718: Tue Feb 17 18:29:43 CET 2009 # dd if=/dev/zero bs=1024k| cpipe -vt | nc dom0 12345 thru: 5500.000ms at 23.3kB/s ( 23.3kB/s avg) 128.0kB thru: 3200.000ms at 40.0kB/s ( 29.4kB/s avg) 256.0kB ... thru: 0.000ms at infGB/s ( 398.8kB/s avg) 5.4MB thru: 0.000ms at infGB/s ( 408.1kB/s avg) 5.5MB Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0xd1d9a500 fault code = supervisor read, page not present instruction pointer = 0x21:0xc02e59b0 stack pointer = 0x29:0xc332aba8 frame pointer = 0x29:0xc332abfc code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 1, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (irq137: xn) [thread pid 12 tid 100025 ] Stopped at xlvbd_add+0x2f70: movl 0x900(%edx,%eax,4),%edx Second System (AMD64, CentOS5.2, Xen 3.3.1): .... thru: 0.000ms at infGB/s ( 598.1kB/s avg) 82.9MB thru: 0.000ms at infGB/s ( 599.0kB/s avg) 83.0MB Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0xc433a140 fault code = supervisor read, page not present instruction pointer = 0x21:0xc02db38e stack pointer = 0x29:0xc332ab7c frame pointer = 0x29:0xc332ab84 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 1, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 12 (irq137: xn) [thread pid 12 tid 100025 ] Stopped at gnttab_claim_grant_reference+0x2e: movl 0(%eax,%edx,4),%eax Best Kai PS : Between the dom0 and some random system via Gigabit Ethernet i get only 1/4 of the real machine speed # dd if=/dev/zero bs=1024k | cpipe -vt -b 65535 | nc other 12345 thru: 7003.500ms at 9.1MB/s ( 9.1MB/s avg) 64.0MB thru: 3301.650ms at 19.4MB/s ( 12.4MB/s avg) 128.0MB thru: 1600.800ms at 40.0MB/s ( 16.1MB/s avg) 192.0MB thru: 1800.900ms at 35.5MB/s ( 18.7MB/s avg) 256.0MB thru: 2601.300ms at 24.6MB/s ( 19.6MB/s avg) 320.0MB thru: 1400.700ms at 45.7MB/s ( 21.7MB/s avg) 384.0MB thru: 1200.600ms at 53.3MB/s ( 23.7MB/s avg) 448.0MB thru: 1600.800ms at 40.0MB/s ( 25.0MB/s avg) 512.0MB thru: 1500.750ms at 42.6MB/s ( 26.2MB/s avg) 576.0MB thru: 1900.682ms at 33.7MB/s ( 26.8MB/s avg) 640.0MB thru: 2000.035ms at 32.0MB/s ( 27.2MB/s avg) 704.0MB thru: 2300.000ms at 27.8MB/s ( 27.2MB/s avg) 768.0MB thru: 1700.000ms at 37.6MB/s ( 27.8MB/s avg) 832.0MB ----- "Kip Macy" schrieb: > Is this a recent version of HEAD? I'm not able to reproduce. > > <...> > thru: 1947.346ms at 32.9MB/s ( 27.8MB/s avg) 3.3GB > thru: 1946.356ms at 32.9MB/s ( 27.9MB/s avg) 3.4GB > thru: 1946.910ms at 32.9MB/s ( 27.9MB/s avg) 3.4GB > <...> > > Maybe some variation in the options? > > Thanks, > Kip > > On Tue, Feb 10, 2009 at 11:40 AM, Kai Mosebach wrote: > > 1024meg > > > > > > On 2/10/09 8:30 PM, "Kip Macy" wrote: > > > >> How big is the memory allocation to the VM? > >> > >> Thanks, > >> Kip > >> > >> > >> On Tue, Feb 10, 2009 at 7:59 AM, Kai Mosebach > wrote: > >>> Hi, > >>> > >>> running r188436M on Xen3.3.1 (Centos5, x86_64). The reason is not > to clear > >>> but seems related to heavy load on pipes + memory + network? > >>> It is repeatable with : > >>> > >>> bsd8# dd if=/dev/zero | nc otherhost 12345 > >>> > >>> Fatal trap 12: page fault while in kernel mode > >>> cpuid = 0; apic id = 00 > >>> fault virtual address = 0xd216dd00 > >>> fault code = supervisor read, page not present > >>> instruction pointer = 0x21:0xc02e4d40 > >>> stack pointer = 0x29:0xc332aba8 > >>> frame pointer = 0x29:0xc332abfc > >>> code segment = base 0x0, limit 0xfffff, type 0x1b > >>> = DPL 1, pres 1, def32 1, gran 1 > >>> processor eflags = interrupt enabled, resume, IOPL = 0 > >>> current process = 12 (irq137: xn) > >>> [thread pid 12 tid 100025 ] > >>> Stopped at xlvbd_add+0x2f70: movl > 0x900(%edx,%eax,4),%edx > >>> db> bt > >>> > >>> > >>> > >>> On otherhost i get some stuff (between 19 and 62 MB), after nc > closes down > >>> eventually > >>> > >>> otherhost# nc -l 12345 | cpipe -vt -b 65535 >/dev/null > >>> ... > >>> thru: 108930.791ms at 184.3kB/s ( 184.3kB/s avg) 19.6MB > >>> > >>> best Kai > >>> _______________________________________________ > >>> freebsd-xen@freebsd.org mailing list > >>> http://lists.freebsd.org/mailman/listinfo/freebsd-xen > >>> To unsubscribe, send any mail to > "freebsd-xen-unsubscribe@freebsd.org" > >>> > > > > > >