From owner-freebsd-net@FreeBSD.ORG Fri Jul 30 12:07:15 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8A8C41065677 for ; Fri, 30 Jul 2010 12:07:15 +0000 (UTC) (envelope-from freebsd@knarf.de) Received: from mail.server-king.de (mail.server-king.de [IPv6:2001:6f8:1d0d::10]) by mx1.freebsd.org (Postfix) with ESMTP id 072358FC08 for ; Fri, 30 Jul 2010 12:07:14 +0000 (UTC) Received: from cheese.server-king.de (localhost [127.0.0.1]) by mail.server-king.de (8.14.4/8.14.4) with ESMTP id o6UC77xr061148 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 30 Jul 2010 14:07:08 +0200 (CEST) (envelope-from freebsd@knarf.de) DomainKey-Signature: a=rsa-sha1; s=mail.server-king.de; d=knarf.de; c=nofws; q=dns; h=dkim-signature:received: x-authentication-warning:date:from:to:subject:message-id:mime-version:content-type: content-disposition:user-agent:x-greylist; b=R6u3DLF+UE3e+Fkr0whNO2Hz9y/xf35PQkJ1YE7rVw6fuS7+xSYPIHU3tnD5Dk+5s 55WpxoshCsmRFTQQfWCToUmNBIF+/TgQMs9YpwtD8LjCycY5TwYKOPDRXR2NBq1Ap+Y XQWwBTTbJj5pGTUEv6LULJ3tniTVZDbSUMycLAo= DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=knarf.de; s=mail.server-king.de; t=1280491628; bh=DLqR2wYXRlH1iGApnPNfJd3B02rMYTARM2HIT1HBC/Q=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=hjPeBY6rAqy9v/xIqUFus9op6sn4SOotVXD8XN2BoqO41ItZlUOdCR91mDsNrOt+D Vay5kiDKNmgS2yrIw68SyYy4wBqCAdCdO152CJFYgbKvNBbnv8hPCTTm1JZ5jdOXkT o5MenHCvKZgnGpYNrk3xEucC8o1qAV/yeT6lRr1k= Received: (from knarf@localhost) by cheese.server-king.de (8.14.4/8.14.4/Submit) id o6UC77Lw061147; Fri, 30 Jul 2010 14:07:07 +0200 (CEST) (envelope-from freebsd@knarf.de) X-Authentication-Warning: cheese.server-king.de: knarf set sender to freebsd@knarf.de using -f Date: Fri, 30 Jul 2010 14:07:07 +0200 From: Frank Bartels To: freebsd-net@freebsd.org Message-ID: <20100730120707.GA56845@server-king.de> MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary="tThc/1wpZn/ma/RB" Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.5 (mail.server-king.de [127.0.0.1]); Fri, 30 Jul 2010 14:07:08 +0200 (CEST) Subject: Packet loss when using multiple IP addresses X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Jul 2010 12:07:15 -0000 --tThc/1wpZn/ma/RB Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline Hi freebsd-net, I'm trying to run a root server using FreeBSD using four different IP addresses. Everything works fine with one IP address, but if I add more addresses I notice a packet loss of about 10% after some minutes, in rare cases after three hours. Sometimes the packet loss raises to 50% and somtimes up to 95%. But never 100%. Incoming connections are affected. I cannot type in my ssh connection. Outgoing connections do not seem to be affected, mtr has 0.0% loss after thousands of packets. Running mtr on the host seems to "help" (*). There are no error messages in messages and console.log. The second IP address is used for a jail and the third IP address for a VM running VirtualBox. The final configuration is with native IPv6 (dual stack). I've tried all of the following without success: - FreeBSD 8.1-RELEASE and 8.1-STABLE (20100729) - re(4) and em(4) - with or without the changes to /sys/dev/re/if_re.c from r207977 - with or without jail (alias IP address) - with or without vbox - with or without IPv6 - with or without powerd - with ifconfig_${INTERFACE}="DHCP" and with static configuration - with or without rxcsum,txcsum - the motherboard was changed already (mainly because of problems with ahci enabled) If I use tcpdump in order to trace the ICMP packets on the ethernet interface, I do not see the incoming ICMP requests. The motherboard is a MSI-X58Pro-E. kernel is GENERIC. I do not use ipfw(8). I've recompiled virtualbox after switching from 8.1-RELEASE to 8.1-STABLE. Ports are updated daily. I have a very similar setup running in the office without problems. I'm very frustrated because I have absolutely no idea what's going on here. (*) I can repoduce reducing the packet loss a lot (to less than 1%) by running mtr from the host using the remote console. If I start the mtr, the packet loss goes down and I can login using ssh. If you have any idea what I can do in order to find the source of my problem, please answer. Maybe a single keyword is enough. :) Thanks, Knarf --tThc/1wpZn/ma/RB Content-Type: application/x-pkcs7-signature Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIIPxgYJKoZIhvcNAQcCoIIPtzCCD7MCAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCC DPgwggY0MIIEHKADAgECAgEgMA0GCSqGSIb3DQEBBQUAMH0xCzAJBgNVBAYTAklMMRYwFAYD VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0 ZSBTaWduaW5nMSkwJwYDVQQDEyBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAe Fw0wNzEwMjQyMTAyNTVaFw0xNzEwMjQyMTAyNTVaMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UE ChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUg U2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0 ZSBDbGllbnQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDLKIVFnAEs+xny q6UzjCqgDcvQVe1dIoFnRsQPCFO+y92k8RK0Pn3MbQ2Gd+mehh9GBZ+36uUQA7Xj9AGM6wgP hEE34vKtfpAN5tJ8LcFxveDObCKrL7O5UT9WsnAZHv7OYPYSR68mdmnEnJ83M4wQgKO19b+R t8sPDAz9ptkQsntCn4GeJzg3q2SVc4QJTg/WHo7wF2ah5LMOeh8xJVSKGEmd6uPkSbj113yK Mm8vmNptRPmM1+YgmVwcdOYJOjCgFtb2sOP79jji8uhWR91xx7TpM1K3hv/wrBZwffrmmEpU euXHRs07JqCCvFh9coKF4UQZvfEg+x3/69xRCzb1AgMBAAGjggGtMIIBqTAPBgNVHRMBAf8E BTADAQH/MA4GA1UdDwEB/wQEAwIBBjAdBgNVHQ4EFgQUrlWDb+wxyrn3HfqvazHzyB3jrLsw HwYDVR0jBBgwFoAUTgvvGqRAW6UXaYcwyjRoQ9BBrvIwZgYIKwYBBQUHAQEEWjBYMCcGCCsG AQUFBzABhhtodHRwOi8vb2NzcC5zdGFydHNzbC5jb20vY2EwLQYIKwYBBQUHMAKGIWh0dHA6 Ly93d3cuc3RhcnRzc2wuY29tL3Nmc2NhLmNydDBbBgNVHR8EVDBSMCegJaAjhiFodHRwOi8v d3d3LnN0YXJ0c3NsLmNvbS9zZnNjYS5jcmwwJ6AloCOGIWh0dHA6Ly9jcmwuc3RhcnRzc2wu Y29tL3Nmc2NhLmNybDCBgAYDVR0gBHkwdzB1BgsrBgEEAYG1NwECATBmMC4GCCsGAQUFBwIB FiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kucGRmMDQGCCsGAQUFBwIBFihodHRw Oi8vd3d3LnN0YXJ0c3NsLmNvbS9pbnRlcm1lZGlhdGUucGRmMA0GCSqGSIb3DQEBBQUAA4IC AQA6qScNyNO0FpHvaZTQacVMXH33O51KyEKSRw3IvdQxRu31YR0ZDGdSfgSoOVDVMSBSdmfQ fdDInHPzV3LO5DwUXZ+lxjv7z3PO2OkfnFkvTXPfn6dxJ5rJveDsTsCPcJ/Kp6/+qN5g+J6D /SaYcFD018B6L42r0Z4VEBy36P4tjRtF14Ex10tl5tJFVKM16qWKQHbpjIgf73s49UB0CQ5l HT2DHKfq3oPfdNc5Mk93w1v4ryVb+qVrZIej8NsrWU+5r4O2IV91edDb/OtHFddZqHFFXKgS 79IHE/hwQ2LW7r3sTX7cDUCg+dfdwO8zeLxuwk2JF8crUoyrl66RGrRIhT8VoG/OJ1Y9uUlO av69V4cG8upi4ZG2l7JZFbcBFk91Wp+Payo5SuF61CmGFrZ386umkmpObtFacXda2O/bVoQ9 xHQrzoTc/0KZTWvlZCLK3Ke/vGYT9ZdW9lOjGsSFbXrlTA919L84iMK+48WGnvRWY28ZaVHp ql43AtEGhXze6iNCbEDACy+4hkQYOytAqDgcxAnQ937mYpeZFPyz/XK9QSt9VNFMuudWxZwD DDJKoQAoSG59Hou9lZ26UrK60nRdAQBmEPL8h2nuWgoPh++XVQld9yuhbsWa39Pck8/lcfz5 HUVGJF5mc/zk38iV7FDlF68puiryNq2KXHEpOTCCBrwwggWkoAMCAQICAgl2MA0GCSqGSIb3 DQEBBQUAMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRDb20gTHRkLjErMCkGA1UE CxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzE4MDYGA1UEAxMvU3RhcnRD b20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0ZSBDbGllbnQgQ0EwHhcNMTAwNzE0MTEx MTQzWhcNMTIwNzE0MTg1NjEzWjCBuTEgMB4GA1UEDRMXMjI2MjU1LTdWNXd1MDFnUmtUaTYw S2IxCzAJBgNVBAYTAkRFMQ8wDQYDVQQIEwZCYXllcm4xETAPBgNVBAcTCE11ZW5jaGVuMS0w KwYDVQQLEyRTdGFydENvbSBWZXJpZmllZCBDZXJ0aWZpY2F0ZSBNZW1iZXIxFjAUBgNVBAMT DUZyYW5rIEJhcnRlbHMxHTAbBgkqhkiG9w0BCQEWDmtuYXJmQGtuYXJmLmRlMIIBIjANBgkq hkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAzD4z4S8NZqOpqzEsNTzVN/9P1v74kqLu+iMWIKIP ESI+pugiA5dD/9xKZvDnCJDIXBEbn/hV92TRGcGLj/rtnd1/nDfI6TJai52E46tGZwf8jHdd vY30X7BT+sS0uiKm9tFtPGt5UQHajDUoH91iIMJhs3xDtPo3iGTsFVHMD9EMRE+uS/EqSx88 KAPSw2N9zgJWYtMHOULQvsh2IrxT//p2MyCnVZnn/qqzMFRBII7ixIEWqKwTzyj1SUErzqrN Xd9ZFA/znLAZkj5q+guIli20efmynIS0/23rejSpzRAMftJcVcrzzSpe6EnmX3pO7f3OSBfU I4ofjcW1TQFHfwIDAQABo4IC9zCCAvMwCQYDVR0TBAIwADALBgNVHQ8EBAMCBLAwHQYDVR0l BBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBQFiGhVAZ3h7V3ALEISyJpW+aQH IDAfBgNVHSMEGDAWgBSuVYNv7DHKufcd+q9rMfPIHeOsuzAZBgNVHREEEjAQgQ5rbmFyZkBr bmFyZi5kZTCCAUIGA1UdIASCATkwggE1MIIBMQYLKwYBBAGBtTcBAgIwggEgMC4GCCsGAQUF BwIBFiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kucGRmMDQGCCsGAQUFBwIBFiho dHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9pbnRlcm1lZGlhdGUucGRmMIG3BggrBgEFBQcCAjCB qjAUFg1TdGFydENvbSBMdGQuMAMCAQEagZFMaW1pdGVkIExpYWJpbGl0eSwgc2VlIHNlY3Rp b24gKkxlZ2FsIExpbWl0YXRpb25zKiBvZiB0aGUgU3RhcnRDb20gQ2VydGlmaWNhdGlvbiBB dXRob3JpdHkgUG9saWN5IGF2YWlsYWJsZSBhdCBodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9w b2xpY3kucGRmMGMGA1UdHwRcMFowK6ApoCeGJWh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2Ny dHUyLWNybC5jcmwwK6ApoCeGJWh0dHA6Ly9jcmwuc3RhcnRzc2wuY29tL2NydHUyLWNybC5j cmwwgY4GCCsGAQUFBwEBBIGBMH8wOQYIKwYBBQUHMAGGLWh0dHA6Ly9vY3NwLnN0YXJ0c3Ns LmNvbS9zdWIvY2xhc3MyL2NsaWVudC9jYTBCBggrBgEFBQcwAoY2aHR0cDovL3d3dy5zdGFy dHNzbC5jb20vY2VydHMvc3ViLmNsYXNzMi5jbGllbnQuY2EuY3J0MCMGA1UdEgQcMBqGGGh0 dHA6Ly93d3cuc3RhcnRzc2wuY29tLzANBgkqhkiG9w0BAQUFAAOCAQEAgpXgIBgtD3GLGedI IXJivBjcif9oEvVKS+E5JQmalBXVJIxXZ6GUPKm9gvQ4Iwq4JM6pRU79HF3xlifZFe6U5ary r1ShPzaIiM97CSaBVZ5czVNU9uE14/fE36x81f+sSX4lFXK41lM3nTgqPm/0HDqLmt4hvOBk 7Im4p7sQEBJKP2UC3vXunrDCTAhGIe9QUG9YeV5rFS1+dCkbqUqOXUlQdGTo9ObELSc2UmRU B3iojwQUogFWLukCQmOLR/jDovGzex+kvAxlLgUd2xgbh2ZgkRIc6TVlrJQ21PWR5RNKUkgh bPuNnT1hvtlJpvttU4f4Zzl1RP2DTe31ohiMSjGCApYwggKSAgEBMIGTMIGMMQswCQYDVQQG EwJJTDEWMBQGA1UEChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwg Q2VydGlmaWNhdGUgU2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5 IEludGVybWVkaWF0ZSBDbGllbnQgQ0ECAgl2MAkGBSsOAwIaBQCggdgwGAYJKoZIhvcNAQkD MQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTAwNzMwMTIwNzA3WjAjBgkqhkiG9w0B CQQxFgQU/zqNWV4SsQMTXAAAlTq7YtHte8wweQYJKoZIhvcNAQkPMWwwajALBglghkgBZQME ASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAOBggqhkiG9w0DAgIC AIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwDQYJKoZIhvcNAQEB BQAEggEAfQo1ALfZPqkl8kZLV74C8GsOdxo2owph9wg4Ve7s3p0u85OBFzgeykczdYhiRKpJ eZ8gWp1W4zrlhZmTo4pYa0Km3F5ICqolQE4WqNjRGSmXS0CXvclYNVqL/keO24070aDSHBQd mETjw+A1osf4e6GnQG+dHqIY77GMTdY4XHIB0OSDkESIAjtiAFCj6uIV/sFpyjb4kQ/MBo8C 6XlKXQCH7Jh3gO/nWIU1XMThlSbMxBFkyhMgsRC8EV7K7PJgZBAWHhb2ebAUBshKSeCL8p5G CrTcLbjQIZd37HJxQy+4suUwmMQVNB33Mr9ToJz3LkmMHgc10eSFNVjSuPZTkQ== --tThc/1wpZn/ma/RB--