From owner-freebsd-net@freebsd.org Wed Oct 21 18:29:19 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A9D6A1A7A0 for ; Wed, 21 Oct 2015 18:29:19 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail-wi0-x22b.google.com (mail-wi0-x22b.google.com [IPv6:2a00:1450:400c:c05::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E18E115F9 for ; Wed, 21 Oct 2015 18:29:18 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by wicll6 with SMTP id ll6so103598942wic.0 for ; Wed, 21 Oct 2015 11:29:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sippysoft_com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=MXOZl1V1oCB7mgb7MHKxVMwvXyWWINsCwjbD7Syf7Cs=; b=fgCmn+i83gnR8Ru7fz092IYQUklyPdPPe3JCfx+/urXhpw5mMrmoYsK3pTms+Q49Co s0rL0o4kspp+fisTO76Z/rFd2bLHKQM6epeYZq8OO8Kcat5pMH5/jIjUd0E6nq0om5hb tNY80xHwiybC2C2sgIZ6iEf85HXYfh1SPLb1xWxwjwo2WCO8K9LRF8O+Zmad8SaJK1wo m4TVyrd5VLH905e5RGGufEiANYmmKh29N1RTVCu4FLevHGqIhmo7MVxl+x/RavTo5K8J 8UI0beiWpw/4Q6b3e6WVvOuEdEc2R/s7Jy5axexV+fzev+jOpwJzBBL9oXCZ/TiG3XRS vKGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=MXOZl1V1oCB7mgb7MHKxVMwvXyWWINsCwjbD7Syf7Cs=; b=FSA3tRGdHLKtbHduN4WQ52Hp71yGRnorX1MuM1I3ZOf79Cm4Ru95kkuj8c3X+VZAlp n96h4PffGnMXXAcf0jmToAkYt8Ut8G4AZLJzEQji5ayumH/m0nG8Co7sqqrDOvAl9b50 vX/gRZXnplpQ5ru4vgHfA/3LiQjqzg3k5Sm5qHQ7bCdDsML8eJ6Ve+MT/dtwvxO8IGF1 lSyp6Sf7aCocHLiH6DGCRM/YigwEbnRVPhxV1c8fMjwGyAtntPxoCAevdYYRWdav5qdz yT3TmU9L8PcJGxX7vYpchWi7is2ZgRfQVRWOb9XmuI0zA5CDLJPJqkcoYWrpxf1suwRC aJ1A== X-Gm-Message-State: ALoCoQniyY/jPMtpvs08xyPPX/7Q+J3zwplB6/x7MOm7D5ZYoNBj2Aa4bNLOqIJ7Epym7oOgCQ2t MIME-Version: 1.0 X-Received: by 10.194.222.227 with SMTP id qp3mr14337874wjc.36.1445452157208; Wed, 21 Oct 2015 11:29:17 -0700 (PDT) Received: by 10.27.11.228 with HTTP; Wed, 21 Oct 2015 11:29:17 -0700 (PDT) In-Reply-To: <2050066.YiOUntKNB6@ralph.baldwin.cx> References: <1608354.LQmTMSsd5C@ralph.baldwin.cx> <2050066.YiOUntKNB6@ralph.baldwin.cx> Date: Wed, 21 Oct 2015 11:29:17 -0700 Message-ID: Subject: Re: Some MSI are not routed correctly From: Maxim Sobolev To: John Baldwin Cc: FreeBSD Net Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Oct 2015 18:29:19 -0000 Yes, I do. However, please note that for some reason they are not using nearly as much CPU time as the other 4 for some reason. 11 root -92 - 0K 1104K WAIT 3 95.3H 28.96% intr{irq267: igb0:que} 11 root -92 - 0K 1104K WAIT 1 95.5H 24.41% intr{irq265: igb0:que} 11 root -92 - 0K 1104K CPU2 2 95.2H 23.73% intr{irq266: igb0:que} 11 root -92 - 0K 1104K WAIT 0 95.2H 23.05% intr{irq264: igb0:que} 11 root -92 - 0K 1104K WAIT 6 286:37 1.12% intr{irq271: igb1:que} 11 root -92 - 0K 1104K WAIT 7 278:05 1.12% intr{irq272: igb1:que} 11 root -92 - 0K 1104K WAIT 5 284:26 1.07% intr{irq270: igb1:que} 11 root -92 - 0K 1104K WAIT 4 290:41 0.98% intr{irq269: igb1:que} CPU 0: 0.0% user, 0.0% nice, 0.9% system, 24.9% interrupt, 74.2% idle CPU 1: 0.5% user, 0.0% nice, 0.0% system, 26.3% interrupt, 73.2% idle CPU 2: 0.0% user, 0.0% nice, 1.4% system, 25.4% interrupt, 73.2% idle CPU 3: 0.0% user, 0.0% nice, 0.5% system, 23.9% interrupt, 75.6% idle CPU 4: 0.9% user, 0.0% nice, 2.3% system, 2.3% interrupt, 94.4% idle CPU 5: 1.4% user, 0.0% nice, 4.2% system, 4.2% interrupt, 90.1% idle CPU 6: 1.4% user, 0.0% nice, 3.8% system, 1.4% interrupt, 93.4% idle CPU 7: 2.8% user, 0.0% nice, 0.0% system, 3.8% interrupt, 93.4% idle 34263 igb0:que 0 32308 igb0:que 1 35022 igb0:que 2 34593 igb0:que 3 14931 igb1:que 0 13059 igb1:que 1 12971 igb1:que 2 13032 igb1:que 3 So I guess interrupts are routed correctly after all, but for some reason driver takes some 5 times less time to process it on cpus 4-7 (per-interrupt). Weird. On Wed, Oct 21, 2015 at 10:41 AM, John Baldwin wrote: > On Tuesday, October 20, 2015 06:31:47 PM Maxim Sobolev wrote: > > Here you go: > > > > $ sudo procstat -S 11 > > PID TID COMM TDNAME CPU CSID CPU MASK > > 11 100082 intr irq269: igb1:que 4 1 4 > > 11 100084 intr irq270: igb1:que 5 1 5 > > 11 100086 intr irq271: igb1:que 6 1 6 > > 11 100088 intr irq272: igb1:que 7 1 7 > > These are clearly what you want, and you can see that the last CPU they > ran on is the CPU you want as well. If you run 'top -SHz' do you see > the threads running on other CPUs? > > -- > John Baldwin > > -- Maksym Sobolyev Sippy Software, Inc. Internet Telephony (VoIP) Experts Tel (Canada): +1-778-783-0474 Tel (Toll-Free): +1-855-747-7779 Fax: +1-866-857-6942 Web: http://www.sippysoft.com MSN: sales@sippysoft.com Skype: SippySoft