From nobody Sat Aug 30 17:44:30 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4cDjFX2w5gz65sfB for ; Sat, 30 Aug 2025 17:44:48 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-qk1-x735.google.com (mail-qk1-x735.google.com [IPv6:2607:f8b0:4864:20::735]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4cDjFW59c3z3nS0 for ; Sat, 30 Aug 2025 17:44:47 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qk1-x735.google.com with SMTP id af79cd13be357-7e86faa158fso326177585a.1 for ; Sat, 30 Aug 2025 10:44:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; t=1756575882; x=1757180682; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=8gkycm7WwTKwMeONgZ6X2YaEBewkT8mLSnCqwjhHpfA=; b=tISQa1v4mg87yJWM5jI/PTwFrNT4mvTWMwpTlb9IXUaHKVZs+spaNDcV4b1/mbMICx eoSMhcAgceR5mfYHzJJAkS8F0426ixDMguDFsXgWyB6mx8bUboRt3JV2LCj0VuCjg8ZL kcrSgd427+nBqItX3igYOLQHqb+jam/6emhPk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1756575882; x=1757180682; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=8gkycm7WwTKwMeONgZ6X2YaEBewkT8mLSnCqwjhHpfA=; b=d+OlAiolh665l0U+dukJuC4d5O6lxBOmiVibbg9SKex9uAH15heF27BA9HjdtCfi/9 uMND+ju7Y8o2eZgX7ZuMEWoKC40/RK9Q7mPVze4hJUcJwfBpjTOSC5rMlItLmS56Gngi DnZ7cTEgR8dlHSUvoRRas51252Q0oWwfkZIpoQiZHEi6mn1IjbjGSzrkPU+il1+6Hezj tihzmiAn7XEW2kUjjBe9H98OUr+V5H1qM2JFBRygrx2vtMw9onoXRPpth+SzWTCFmUT1 vrx5SKRd/y2/8JiGLuQJwSnVGWh40Ad6H3FbtWOZbVQ5r91Iv8JvDVmlYr8tALfJNeWl mumg== X-Forwarded-Encrypted: i=1; AJvYcCWig+l1FoURsqqXps4B5DMuv6W6IfLHbsDjCiR0Vc0NwVBiWkRyfFIGKOKb5rKb++fm7tjRMmT1fAP5AA==@freebsd.org X-Gm-Message-State: AOJu0Yx/+ZNORtV0bkUqF8zGKREPvlYBwncmSS3jNKLNOgKgKLcYzPDD 4fLAldeXOX9pq0LaQIc+ICV86fdcYC05XG246Rmg0QtN8PGhC0IowdMOjJ0t9ynlZvBKGgowWbs EZ0oQhHJ/gDsYs+3A/uRg2wEvCp55+vxX1q3n46o5KRfIFM9LRyU= X-Gm-Gg: ASbGncsH0IA7U8zzt8jbTV/DEd6lQhpRBQHy8DICLDOo/gf9Fx+xdgRN3hB3K9hM1rZ Ojf2HuQadYZJvWcYfQ6saK30pVfMxkC68ilBoU531Myh500ezhSXFLAUDL6jJvgkJZRdFaiHe/b L89NSzVaWlqBm18HqPPwAFilNtpSh/R4HAepdBWS3RkzcJd7dFbS/eHhIdg3iP3S/m++LIWN1O8 e2j1xvO X-Google-Smtp-Source: AGHT+IE/4AMc0T+og3ZL3TE0eSbMUXf27dSo8YejL+Pyk7AsfqHl3pOpxscEAz1FUweLUJ2GUNaqPaPY3CXuZjfj7Os= X-Received: by 2002:a05:620a:2a0d:b0:7fb:188e:5bfc with SMTP id af79cd13be357-7fed6ab6814mr395616985a.31.1756575881854; Sat, 30 Aug 2025 10:44:41 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <6HcKz3OxJSnjZdoCr4I0mksk9RemKJflHVgnkYI8-FydM4mDDldzTm8qthQ0iJCftaETOVeQFde4fz5i1703B8Gd2ZBvPmBwF_MMnhuJ8VM=@brokenco.de> <7f463f6f-3a6e-47db-aab8-7817cc6192a5@denninger.net> In-Reply-To: From: Kevin Bowling Date: Sat, 30 Aug 2025 10:44:30 -0700 X-Gm-Features: Ac12FXzu79Ox6Iyur_x1TnwXisD_PPTlhnJllwJHTmNL6gfLtz6W7yEutFcqqYs Message-ID: Subject: Re: Intermittent failure of routing/gateway with ix(4) (x86_64) To: R Tyler Croy Cc: Karl Denninger , freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4cDjFW59c3z3nS0 On Sat, Aug 30, 2025 at 8:18=E2=80=AFAM R Tyler Croy w= rote: > > (replies inelin) > > > On Saturday, August 23rd, 2025 at 10:32 PM, Kevin Bowling wrote: > > > > > > ix is generally regarded as stable as others have stated. It would be > > helpful to see 'sysctl dev.ix' after a stall, and maybe a clean one > > prior to it. > > > > > On X540 I'd pay some attention to thermals, the PHY generates a real > > amount of heat. > > > I was feeling pretty good this week that it might be the thermals since i= t's been cooler and there were no issues... > > Then in the middle of the night, the issue popped up again! > > I have attached the diff on `sysctl dev.ix` before and after the stall. T= he ix1 is the LAN interface where gateway traffic disappears. I'm hoping mo= re savvy eyes on this list might spot something useful in this You've got an assortment of MAC level errors going on in the 'after': +dev.ix.1.mac_stats.checksum_errs: 137 +dev.ix.1.mac_stats.rx_missed_packets: 930676 +dev.ix.1.mac_stats.rx_errs: 930676 +dev.ix.0.mac_stats.checksum_errs: 45 +dev.ix.0.mac_stats.local_faults: 563829 +dev.ix.0.mac_stats.short_discards: 6 +dev.ix.0.mac_stats.byte_errs: 6 +dev.ix.0.mac_stats.ill_errs: 6 I would be surprised if it is not a hardware issue given the MAC errors on both ports. It's been a minute since I looked at this but IIRC the thermal diode is somehow botched somewhere in the ix family so we don't get a notification in software if the PHY over temps. But it's also possible yours is already cooked or some other issue. A potentially useful hint, the X550 uses a lot less power and produces less heat. Regards, Kevin > > Cheers