From nobody Sun Aug 24 05:32:05 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4c8jHC1zcMz65MB4 for ; Sun, 24 Aug 2025 05:32:23 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-qt1-x82f.google.com (mail-qt1-x82f.google.com [IPv6:2607:f8b0:4864:20::82f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4c8jHB4khlz3hTm for ; Sun, 24 Aug 2025 05:32:22 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qt1-x82f.google.com with SMTP id d75a77b69052e-4b109912545so42124281cf.0 for ; Sat, 23 Aug 2025 22:32:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; t=1756013537; x=1756618337; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=qiiMXKmsyziEb4Ahxztj5NW26otNjv6YN7o/gnNcvaQ=; b=Wv8C+6NQsmxFpevUry6WYOIC/KyE166hpHk0VJCweg+4ZJMC5s27v57eKGLvftNxNd AabkuME+W3PgQBUCgvyGpKccGfriFa7b8eSQS4ydAU9lPQLttqaLp27zA0aaYnwsyd9o TSBq80I169cQU3vSU/KXg9w05AiH5Up12+R1Y= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1756013537; x=1756618337; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=qiiMXKmsyziEb4Ahxztj5NW26otNjv6YN7o/gnNcvaQ=; b=pQlCwXn7bC1xlXtfjdeSQwzqej83ZpvhAlFxwULT0w6TXxoQGwt7YcrUHO5c+4fsiY 960Gko+I6ZACp+Y4/m900dA5yjd6qBcgIpfeP5LVHM8Rrc/mTZDPu0hjwldauTl+L/S8 FGpqZLP8iFVyNM33IlvBQnIa0nQMU+NBDdJfOLmp6wr9+8tCFY+gOuyrhmzApcf/7WME /5mP//GT8M4V9mXoG4tmrjBQ9BrJmJGidrBRTWGDuAIqMMrXnNQxT4Qfvjkrieow+m9+ t8E5hrCJr8ZNhuAOrzx+HrJgFVmQAhYdpEtPTz8GENq4yOzKnqMy8VzfGZMwQUb60zFn rwwg== X-Forwarded-Encrypted: i=1; AJvYcCVo4ienlxYCNW0378LVaay1dUn1E29vTUCEwbsRsatP5M+g5eOSizZ2obMq7NF78dfhKjdMSjMuFpQfzg==@freebsd.org X-Gm-Message-State: AOJu0Yw7lW9dSpbr15xLsfgJelxy53CQ5gklAhpDKBPkwQe5iJqUgWxw hOy8K0VpsJStPaek+IT9J6/FE68Kya1Nxe06Z6c9/+opKR4UCw7iBqBSB2fRDWQFXb3tEXDCMbw u7Pu5yte60MU3lFIt2CVW+a//QEASvfYjaiy+qKLX X-Gm-Gg: ASbGncsGs+4m+BWjS3Fgux3RgCU64NTJwjgeFQGrCzWO4uELfuF6ojmMRJT0v85foEo vZ1la7LPG69hhdKyTxPepQ6JBv+Y6noWRk/WoK91FvQDFMxGQpa6sz+HagI/Fmp/5i9yvhJGAPt w9LFEhl9doPA4FHxDpM1V482GXRwg9kUQc2qOF9zBmjjt/oppQZT23EecLF1HjEERM22S/uHhN0 ra15cBVFabajYWzdEA= X-Google-Smtp-Source: AGHT+IF3VRc3ZpykXyf2LIqbTDHxCOsEuxCud4RLdIEEh1eukWAvpzwPsnxqZmTR5Rvr8GRWeBv6efNBUygGgt08t3k= X-Received: by 2002:a05:622a:1214:b0:4b0:8e21:fd63 with SMTP id d75a77b69052e-4b2aaa05c3cmr82989991cf.15.1756013536658; Sat, 23 Aug 2025 22:32:16 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <6HcKz3OxJSnjZdoCr4I0mksk9RemKJflHVgnkYI8-FydM4mDDldzTm8qthQ0iJCftaETOVeQFde4fz5i1703B8Gd2ZBvPmBwF_MMnhuJ8VM=@brokenco.de> <7f463f6f-3a6e-47db-aab8-7817cc6192a5@denninger.net> In-Reply-To: From: Kevin Bowling Date: Sat, 23 Aug 2025 22:32:05 -0700 X-Gm-Features: Ac12FXxOhN7pRThNparUHUO4UpTUeg8_bSWAML-YFY3s9sNwz3yhs0qZDzUqjGA Message-ID: Subject: Re: Intermittent failure of routing/gateway with ix(4) (x86_64) To: R Tyler Croy Cc: Karl Denninger , freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4c8jHB4khlz3hTm On Sat, Aug 23, 2025 at 6:32=E2=80=AFPM R Tyler Croy w= rote: > > (replies inline) > > > On Saturday, August 23rd, 2025 at 6:24 PM, Karl Denninger wrote: > > > > > > What physical hardware is on that driver? > > > > > I have a box here with two ix interfaces in it that is my edge router a= nd beat the SNOT out of it without problems. This is what the boot messages= are for them in my machine here: > > > These are both identical 10GigE NICs, from dmesg > > ix0: mem 0xe0400000-0xe05fffff,0xe0600000-0xe0603fff = irq 18 at device 0.0 on pci1 > ix0: Using 2048 TX descriptors and 2048 RX descriptors > ix0: Using 2 RX queues 2 TX queues > ix0: Using MSI-X interrupts with 3 vectors > ix0: allocated for 2 queues > ix0: allocated for 2 rx queues > ix0: Ethernet address: a0:36:9f:38:44:a8 > ix0: PCI Express Bus: Speed 5.0GT/s Width x8 > ix0: fw 4.2.0 nvm 4.03.0 eTrack 0x8000037c > ix0: netmap queues/slots: TX 2/2048, RX 2/2048 ix is generally regarded as stable as others have stated. It would be helpful to see 'sysctl dev.ix' after a stall, and maybe a clean one prior to it. On X540 I'd pay some attention to thermals, the PHY generates a real amount of heat. > > System: FreeBSD 14.2-RELEASE-p4 > > When I was chasing that arpresolve warning I saw in the console, I did se= e some discussion like this (https://be-virtual.net/pfsense-arpresolve-cant= -allocate-llinfo-for-x-x-x-x-on-emx/) about funky routers on the other end = of the link causing trouble. Since this is a newer fiber rollout from my lo= cal ISP (Sonic) I wouldn't be surprised if there was something funky happen= ing there. Since the LAN-side routing goes haywire, I'm thinking that's a r= ed herring. > > > > Cheers >