From owner-freebsd-net@freebsd.org Wed Jul 24 18:17:57 2019 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C9B9B414B for ; Wed, 24 Jul 2019 18:17:57 +0000 (UTC) (envelope-from lists.dan@gmail.com) Received: from mail-vs1-xe43.google.com (mail-vs1-xe43.google.com [IPv6:2607:f8b0:4864:20::e43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6B1E76BAAC for ; Wed, 24 Jul 2019 18:17:56 +0000 (UTC) (envelope-from lists.dan@gmail.com) Received: by mail-vs1-xe43.google.com with SMTP id v129so31970654vsb.11 for ; Wed, 24 Jul 2019 11:17:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=qRRE40N0Af0OVvWXGqSeJSKHtUltd/9LId76FnFpTn8=; b=krHr3PY160KEjs6Mkm2UJgvIVAYruUCEgVx5tbYKq3XHEJZzQ3RICEtviNkt9hZmJe 6srVYkPwu2N4XgMMEJ6TMwcjam84VI4d/YpQY9RG4G+phyxWom0jdDrIbsOsmD29Ew6e nMtcF6dhc4PIVO1dJgPH0NEljhK1zqZVh1xQGzfItWtP6Bb/NVA6nF8FgtAuW2B0mf1b qdo1tCMRIAiKA6jO9kIPcwQsW4xj6ffIuzZbZYG2yxDQC/4U/XkFRaIhZvXI9/Cqrje/ xCUhHBGnM0QRwwgOzSqZUoF3XPlvdYVdxm8afAWbrRptTJrgo0NLiaVHXUFccxwF+bLf RnjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=qRRE40N0Af0OVvWXGqSeJSKHtUltd/9LId76FnFpTn8=; b=cir81f2ErFDj4utZ17Y+pyafGMKg7/Vuo0xlFrf0S9d0qPawKv+j00+iKxcr1N3G4y uDVY3TWGEFN41FbqYF2tM0rZHTtYqkyT+7Ym6iKjK9dGYYG+gwmfaGag0rxJ19baRIqS by2ESuSnVjvkzbO9o/LfCpO6MWxPocgbB3sLDJ715e7HHL9YH53nHcn7X/hw6953N1cD kdKDPPSCGyoadDUWc8U3Op50H3pAP7dOAHBpFqK4N7y70OZYUH1qCBpYHxB1v73s2QEu QcJfT917eaMMO5YThDfA+fotrbGfNasgLkSNitynA3hVqIqAKV7ejHlo4DbPReKJYkLr hTKA== X-Gm-Message-State: APjAAAVH2uk6SrRGfFLi9pHc5FNVnNIKMgo0v+OlRLrFjrSmd0xy3fw9 HasMq5suW2IvTxhyh+WUEt5kCcdjzAGdtluwN/233g== X-Google-Smtp-Source: APXvYqzuc15yBlZwBsvBukx7FRRlFdIjv7mg2FsmnGNyGDr4W/Nx9vRKNXjV0OGtN0MDdE6IKtO39Wm4GN/FZf5RrkM= X-Received: by 2002:a67:fd13:: with SMTP id f19mr52608006vsr.25.1563992275924; Wed, 24 Jul 2019 11:17:55 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Dan Lists Date: Wed, 24 Jul 2019 13:17:44 -0500 Message-ID: Subject: Re: Bridge Not Forwarding ARP To: Michael Sierchio Cc: "freebsd-net@freebsd.org" X-Rspamd-Queue-Id: 6B1E76BAAC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=krHr3PY1; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of listsdan@gmail.com designates 2607:f8b0:4864:20::e43 as permitted sender) smtp.mailfrom=listsdan@gmail.com X-Spamd-Result: default: False [-4.54 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.91)[-0.906,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.e.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-0.62)[ip: (2.47), ipnet: 2607:f8b0::/32(-3.09), asn: 15169(-2.43), country: US(-0.05)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jul 2019 18:17:57 -0000 Does anyone have any ideas on how to debug this issue? I can build a custom kernel or use dtrace if necessary. I'm not familiar with the kernel source so I don't really know where to look. Thanks for any help you can provide. On Mon, Jul 8, 2019 at 12:19 PM Dan Lists wrote: > > On Mon, Jul 8, 2019 at 11:55 AM Michael Sierchio > wrote: > >> What's your firewall ruleset look like? (show, don't tell) >> > > The firewall is off for testing (the machine is only on a private network= ). > > # ipfw list > 65535 allow ip from any to any > > >> What does sysctl report on the interfaces and on arp? >> >> > I have not changed any settings. > > net.link.ether.inet.log_arp_permanent_modify: 1 > > net.link.ether.inet.log_arp_movements: 1 > > net.link.ether.inet.log_arp_wrong_iface: 1 > > net.link.ether.inet.garp_rexmit_count: 0 > > net.link.bridge.allow_llz_overlap: 0 > > net.link.bridge.inherit_mac: 0 > > net.link.bridge.log_stp: 0 > > net.link.bridge.pfil_local_phys: 0 > > net.link.bridge.pfil_member: 1 > > net.link.bridge.pfil_bridge: 1 > > net.link.bridge.ipfw_arp: 0 > net.link.bridge.pfil_onlyip: 1 > > hw.em.eee_setting: 1 > > hw.em.rx_process_limit: 100 > > hw.em.enable_msix: 1 > > hw.em.sbp: 0 > > hw.em.smart_pwr_down: 0 > > hw.em.txd: 1024 > > hw.em.rxd: 1024 > > hw.em.rx_abs_int_delay: 66 > > hw.em.tx_abs_int_delay: 66 > > hw.em.rx_int_delay: 0 > > hw.em.tx_int_delay: 66 > > hw.em.disable_crc_stripping: 0 > > dev.em.2.wake: 0 > > dev.em.2.mac_stats.tso_ctx_fail: 0 > > dev.em.2.mac_stats.tso_txd: 0 > > dev.em.2.mac_stats.tx_frames_1024_1522: 3 > > dev.em.2.mac_stats.tx_frames_512_1023: 2 > > dev.em.2.mac_stats.tx_frames_256_511: 5675 > > dev.em.2.mac_stats.tx_frames_128_255: 4255 > > dev.em.2.mac_stats.tx_frames_65_127: 35563 > > dev.em.2.mac_stats.tx_frames_64: 918055 > > dev.em.2.mac_stats.mcast_pkts_txd: 0 > > dev.em.2.mac_stats.bcast_pkts_txd: 0 > > dev.em.2.mac_stats.good_pkts_txd: 963553 > > dev.em.2.mac_stats.total_pkts_txd: 963553 > > dev.em.2.mac_stats.good_octets_txd: 60423175 > > dev.em.2.mac_stats.good_octets_recvd: 16906 > > dev.em.2.mac_stats.rx_frames_1024_1522: 1 > > dev.em.2.mac_stats.rx_frames_512_1023: 0 > > dev.em.2.mac_stats.rx_frames_256_511: 0 > > dev.em.2.mac_stats.rx_frames_128_255: 0 > > dev.em.2.mac_stats.rx_frames_65_127: 235 > > dev.em.2.mac_stats.rx_frames_64: 0 > > dev.em.2.mac_stats.mcast_pkts_recvd: 0 > > dev.em.2.mac_stats.bcast_pkts_recvd: 0 > > dev.em.2.mac_stats.good_pkts_recvd: 236 > > dev.em.2.mac_stats.total_pkts_recvd: 236 > > dev.em.2.mac_stats.xoff_txd: 0 > > dev.em.2.mac_stats.xoff_recvd: 0 > > dev.em.2.mac_stats.xon_txd: 0 > > dev.em.2.mac_stats.xon_recvd: 0 > > dev.em.2.mac_stats.coll_ext_errs: 0 > > dev.em.2.mac_stats.alignment_errs: 0 > > dev.em.2.mac_stats.crc_errs: 0 > > dev.em.2.mac_stats.recv_errs: 0 > > dev.em.2.mac_stats.recv_jabber: 0 > > dev.em.2.mac_stats.recv_oversize: 0 > > dev.em.2.mac_stats.recv_fragmented: 0 > > dev.em.2.mac_stats.recv_undersize: 0 > > dev.em.2.mac_stats.recv_no_buff: 0 > > dev.em.2.mac_stats.missed_packets: 0 > > dev.em.2.mac_stats.defer_count: 0 > > dev.em.2.mac_stats.sequence_errors: 0 > > dev.em.2.mac_stats.symbol_errors: 0 > > dev.em.2.mac_stats.collision_count: 0 > > dev.em.2.mac_stats.late_coll: 0 > > dev.em.2.mac_stats.multiple_coll: 0 > > dev.em.2.mac_stats.single_coll: 0 > > dev.em.2.mac_stats.excess_coll: 0 > > dev.em.2.rxd_tail: 235 > > dev.em.2.rxd_head: 236 > > dev.em.2.txd_tail: 127 > > dev.em.2.txd_head: 127 > > dev.em.2.fifo_reset: 0 > > dev.em.2.fifo_workaround: 0 > > dev.em.2.fc_low_water: 45604 > > dev.em.2.fc_high_water: 47104 > > dev.em.2.rx_control: 32794 > > dev.em.2.device_control: 1086325321 > > dev.em.2.watchdog_timeouts: 0 > > dev.em.2.rx_overruns: 0 > > dev.em.2.tx_desc_fail2: 0 > > dev.em.2.tx_desc_fail1: 0 > > dev.em.2.tx_dma_fail: 0 > > dev.em.2.dropped: 0 > > dev.em.2.mbuf_defrag_fail: 0 > > dev.em.2.cluster_alloc_fail: 0 > > dev.em.2.flow_control: 3 > > dev.em.2.rx_processing_limit: 100 > > dev.em.2.itr: 488 > > dev.em.2.tx_abs_int_delay: 66 > > dev.em.2.rx_abs_int_delay: 66 > > dev.em.2.tx_int_delay: 66 > > dev.em.2.rx_int_delay: 0 > > dev.em.2.nvm: -1 > > dev.em.2.%parent: pci2 > > dev.em.2.%pnpinfo: vendor=3D0x8086 device=3D0x100f subvendor=3D0x15ad > subdevice=3D0x0750 class=3D0x020000 > > dev.em.2.%location: slot=3D3 function=3D0 dbsf=3Dpci0:2:3:0 > handle=3D\_SB_.PCI0.P2P0.S4F0 > > dev.em.2.%driver: em > > dev.em.2.%desc: Intel(R) PRO/1000 Legacy Network Connection 1.1.0 > > dev.em.1.wake: 0 > > dev.em.1.mac_stats.tso_ctx_fail: 0 > > dev.em.1.mac_stats.tso_txd: 0 > > dev.em.1.mac_stats.tx_frames_1024_1522: 1 > > dev.em.1.mac_stats.tx_frames_512_1023: 0 > > dev.em.1.mac_stats.tx_frames_256_511: 0 > > dev.em.1.mac_stats.tx_frames_128_255: 0 > > dev.em.1.mac_stats.tx_frames_65_127: 13 > > dev.em.1.mac_stats.tx_frames_64: 222 > > dev.em.1.mac_stats.mcast_pkts_txd: 0 > > dev.em.1.mac_stats.bcast_pkts_txd: 0 > > dev.em.1.mac_stats.good_pkts_txd: 236 > > dev.em.1.mac_stats.total_pkts_txd: 236 > > dev.em.1.mac_stats.good_octets_txd: 15962 > > dev.em.1.mac_stats.good_octets_recvd: 5286574431 > > dev.em.1.mac_stats.rx_frames_1024_1522: 2876152 > > dev.em.1.mac_stats.rx_frames_512_1023: 269810 > > dev.em.1.mac_stats.rx_frames_256_511: 605978 > > dev.em.1.mac_stats.rx_frames_128_255: 1879331 > > dev.em.1.mac_stats.rx_frames_65_127: 3179015 > > dev.em.1.mac_stats.rx_frames_64: 6 > > dev.em.1.mac_stats.mcast_pkts_recvd: 0 > > dev.em.1.mac_stats.bcast_pkts_recvd: 0 > > dev.em.1.mac_stats.good_pkts_recvd: 8809664 > > dev.em.1.mac_stats.total_pkts_recvd: 8816562 > > dev.em.1.mac_stats.xoff_txd: 0 > > dev.em.1.mac_stats.xoff_recvd: 0 > > dev.em.1.mac_stats.xon_txd: 0 > > dev.em.1.mac_stats.xon_recvd: 0 > > dev.em.1.mac_stats.coll_ext_errs: 0 > > dev.em.1.mac_stats.alignment_errs: 0 > > dev.em.1.mac_stats.crc_errs: 0 > > dev.em.1.mac_stats.recv_errs: 0 > > dev.em.1.mac_stats.recv_jabber: 0 > > dev.em.1.mac_stats.recv_oversize: 0 > > dev.em.1.mac_stats.recv_fragmented: 0 > > dev.em.1.mac_stats.recv_undersize: 0 > > dev.em.1.mac_stats.recv_no_buff: 0 > > dev.em.1.mac_stats.missed_packets: 0 > > dev.em.1.mac_stats.defer_count: 0 > > dev.em.1.mac_stats.sequence_errors: 0 > > dev.em.1.mac_stats.symbol_errors: 0 > > dev.em.1.mac_stats.collision_count: 0 > > dev.em.1.mac_stats.late_coll: 0 > > dev.em.1.mac_stats.multiple_coll: 0 > > dev.em.1.mac_stats.single_coll: 0 > > dev.em.1.mac_stats.excess_coll: 0 > > dev.em.1.rxd_tail: 167 > > dev.em.1.rxd_head: 168 > > dev.em.1.txd_tail: 236 > > dev.em.1.txd_head: 236 > > dev.em.1.fifo_reset: 0 > > dev.em.1.fifo_workaround: 0 > > dev.em.1.fc_low_water: 45604 > > dev.em.1.fc_high_water: 47104 > > dev.em.1.rx_control: 32794 > > dev.em.1.device_control: 1086325321 > > dev.em.1.watchdog_timeouts: 0 > > dev.em.1.rx_overruns: 0 > > dev.em.1.tx_desc_fail2: 0 > > dev.em.1.tx_desc_fail1: 0 > > dev.em.1.tx_dma_fail: 0 > > dev.em.1.dropped: 0 > > dev.em.1.mbuf_defrag_fail: 0 > > dev.em.1.cluster_alloc_fail: 0 > > dev.em.1.flow_control: 3 > > dev.em.1.rx_processing_limit: 100 > > dev.em.1.itr: 488 > > dev.em.1.tx_abs_int_delay: 66 > > dev.em.1.rx_abs_int_delay: 66 > > dev.em.1.tx_int_delay: 66 > > dev.em.1.rx_int_delay: 0 > > dev.em.1.nvm: -1 > > dev.em.1.%parent: pci2 > > dev.em.1.%pnpinfo: vendor=3D0x8086 device=3D0x100f subvendor=3D0x15ad > subdevice=3D0x0750 class=3D0x020000 > > dev.em.1.%location: slot=3D2 function=3D0 dbsf=3Dpci0:2:2:0 > handle=3D\_SB_.PCI0.P2P0.S3F0 > > dev.em.1.%driver: em > > dev.em.1.%desc: Intel(R) PRO/1000 Legacy Network Connection 1.1.0 > > >> >> On Mon, Jul 8, 2019 at 9:15 AM Dan Lists wrote: >> >> > I have a server running FreeBSD 11.2 that I am wanting to use as a >> bridged >> > firewall. I have it set up and it mostly works. The problem is that >> ARP >> > replies are not being forwarded from the outside interface to the insi= de >> > interface. It appears to be working in the other direction. I see t= he >> > ARP request go out on the outside interface and the reply arrives back >> at >> > the outside interface. The ARP reply is never getting to the bridge >> or to >> > the inside interface. >> > >> > The firewall server and the device behind it are in ESX. I think I'v= e >> > worked all the ESX issues out. When I manually add an ARP entry >> everything >> > works. I've done this before with a physical server running FreeBSD >> 8.4 >> > and it works as expected. The differences are physical vs virtual, a= nd >> > 8.4 vs 11.2. >> > >> > I'm at a loss as to why it is not working. I've searched the web and >> > found noting. If anyone could offer suggestions on how to fix this or >> > begin to debug it I would greatly appreciate it. >> > >> > Thanks, >> > >> > Dan >> > _______________________________________________ >> > freebsd-net@freebsd.org mailing list >> > https://lists.freebsd.org/mailman/listinfo/freebsd-net >> > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> > >> >> >> -- >> >> "Well," Brahm=C4=81 said, "even after ten thousand explanations, a fool = is no >> wiser, but an intelligent person requires only two thousand five hundred= ." >> >> - The Mah=C4=81bh=C4=81rata >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >> >