From owner-freebsd-current@FreeBSD.ORG Wed Jun 22 02:41:39 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 562981065689 for ; Wed, 22 Jun 2011 02:41:39 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pz0-f54.google.com (mail-pz0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id 270BC8FC1E for ; Wed, 22 Jun 2011 02:41:38 +0000 (UTC) Received: by pzk27 with SMTP id 27so319369pzk.13 for ; Tue, 21 Jun 2011 19:41:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:date:to:cc:subject:message-id:reply-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; bh=OzPYYhm1WVLcWu0zmApK3QOw+MlzKQbHtMCU7Yo2f0I=; b=UgLKECf2PCtr49zTVbPZ+XwmTZ4xXXYgzoWlanCyH1NM+umNUvC0Z8DPy+cZHyec8Q wdNzhIQ+6rj85eynS3ZYvyc6TyqAiCbwu+RLYvvEAUPbcNifqh5tLRn/kmcwTkxw3sv3 e8txGkXaAhtmVX6yQbmBtPbJpfBe0nasS8X/Q= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=vI2YZ2T7vAgVi/+dbiCv9sFbdG0Eg3rEklcfweTqh9eEtktp1k1bCJxK8nw4/NXL3e sKs/msPAvqMfQynCle369/DUWYi7yOak/3oos6ihIn+4OfdH4pXnuWf3ea5yAgXm4Kes TnCER6jmpKf69ATKfl+Jmstvpnc3yxxWAh3Mk= Received: by 10.68.29.230 with SMTP id n6mr58519pbh.130.1308710498512; Tue, 21 Jun 2011 19:41:38 -0700 (PDT) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id v6sm94506pbh.38.2011.06.21.19.41.35 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 21 Jun 2011 19:41:36 -0700 (PDT) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Tue, 21 Jun 2011 19:41:46 -0700 From: YongHyeon PYUN Date: Tue, 21 Jun 2011 19:41:46 -0700 To: David Schultz Message-ID: <20110622024146.GD9503@michelle.cdnetworks.com> References: <20110527014043.GE18312@michelle.cdnetworks.com> <20110605182357.GA2373@zim.MIT.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110605182357.GA2373@zim.MIT.EDU> User-Agent: Mutt/1.4.2.3i Cc: freebsd-current@freebsd.org Subject: Re: CFT: msk(4) 64bit DMA support X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jun 2011 02:41:39 -0000 On Sun, Jun 05, 2011 at 02:23:57PM -0400, David Schultz wrote: > 85;95;0cOn Thu, May 26, 2011, YongHyeon PYUN wrote: > > Here is a patch that implements 64bit DMA on msk(4). If you use > > msk(4) on a system that has more than 4GB memory, please try the > > patch at the following URL and let me know whether it works or not. > > You need latest msk(4) in HEAD to apply the patch. > > http://people.freebsd.org/~yongari/msk/msk.64bit.dma.diff > > > > Previously msk(4) may have used bounce buffers on systems that have > > more than 4GB memory. You can verify whether msk(4) is using bounce > > buffers by checking the output of "sysctl hw.busdma". For instance, > > hw.busdma.zone0.total_bounced counter would increase while network > > operation is in progress. If patch above works you wouldn't see > > the counter change anymore and it would also enhance network > > performance since it wouldn't have to copy from or to bounce > > buffers. > Sorry for late reply. > After applying this patch, I still see total_bounced increasing: > hw.busdma.zone0.total_bounced: 441 > Hmm, I guess it could be caused by other drivers in the system. Can you verify whether all other drivers in the system use 64bit DMA? I think just testing msk(4) with netperf/iperf will make it clear (i.e. no disk access). > Note that I have MSI disabled to work around some issues with the > card becoming wedged: > hw.pci.enable_msix=0 > hw.pci.enable_msi=0 > MSI has nothing to do with 64bit DMA. > Possibly relevant bits of dmesg: > > FreeBSD 9.0-CURRENT #4 r222717M: Sun Jun 5 12:27:07 EDT 2011 > CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz (3000.06-MHz K8-class CPU) > Origin = "GenuineIntel" Id = 0x10676 Family = 6 Model = 17 Stepping = 6 > Features=0xbfebfbff > Features2=0x8e3fd > AMD Features=0x20100800 > AMD Features2=0x1 > TSC: P-state invariant, performance statistics > real memory = 8589934592 (8192 MB) > avail memory = 8246677504 (7864 MB) > Event timer "LAPIC" quality 400 > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > FreeBSD/SMP: 1 package(s) x 2 core(s) > ioapic0: Changing APIC ID to 4 > ioapic0 irqs 0-23 on motherboard > mskc0: port 0xae00-0xaeff mem 0xfdefc000-0xfdefffff irq 17 at device 0.0 on pci4 > msk0: on mskc0 > msk0: Ethernet address: 00:01:29:a3:3c:a3 > miibus0: on msk0 > e1000phy0: PHY 0 on miibus0 > e1000phy0: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow > msk0: link state changed to UP