From owner-freebsd-net@freebsd.org Thu Jul 13 04:11:47 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53DE9D93EF8 for ; Thu, 13 Jul 2017 04:11:47 +0000 (UTC) (envelope-from jwjerni@g.clemson.edu) Received: from mail-qt0-x236.google.com (mail-qt0-x236.google.com [IPv6:2607:f8b0:400d:c0d::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78D333F34 for ; Thu, 13 Jul 2017 04:11:45 +0000 (UTC) (envelope-from jwjerni@g.clemson.edu) Received: by mail-qt0-x236.google.com with SMTP id i2so28743157qta.3 for ; Wed, 12 Jul 2017 21:11:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=g-clemson-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=Bhsf4QNn3qmrR/uD1OAeUvPxlZIZemLOgWNf7czJgdg=; b=xwMZFApMv/v/c+UmRXeCIHTkosfQqRNReBzC2NTdUDgp7c0Hnpu/tfJDA/tpCv1N2N URoaf6WwrhkSKFV4epKEgKgCpNDXZQ7sFw42Xpzlr2tZj5chTvsr+5BfPc2wOdn714EP BXf70TWWA7dwO5NTFrQaEIVKCAXTqjXpeb2+kJccQ/bZdi5NcZ+u+UUGzpJItf+4rz5S j0JHL6j30ePY/ttuMClB4TtafXUKzyi1IdnLwMv7JrR6MQoOgwOIzonCSWXVMdYekoXp uRjOLxwNwECL7c0V6940ey7U0RYIQWhIrqXpzU/9W65dQjl0cNPXHNs1/cLZFbq0f3/N f90A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Bhsf4QNn3qmrR/uD1OAeUvPxlZIZemLOgWNf7czJgdg=; b=p8QIllFbbX5knxXVgYUimg8HMfRFzLixPzXNYsypzPPuX6E/oO3b/ErzE1EBlEms0N o/+MtaMcGlL0TYMTlXgCdaWsgc4nzj7mHPhZyL8fPFQ/t6rXkPSw4HNXQVqMMtjdaQT3 EHyCB8zBozBQfwJgjzJU1mRwjxOhAh7XrO2FyRHRWkJZ46JQu4FGJju1LXP9DR06uJP8 H8QSsuN4yCTmd34+4l5+GlU4vFkOTYMpjdwDBYzGxDJ9Vy7Xlfx9BgUVBQDDULhMokGM zNewYW1fUsC7xf75x5LfA/AknEG7fVMVWUfi0e4gZSTUYh8XDPpYcFJOxQSG+TgIbozA LOiA== X-Gm-Message-State: AIVw112BwycODJTa//1M/vd2H4Dwt4oPXUKlmN/0Do8XcpxP2E1ctX2N yixBDho3SX2KcM3ZxU8dkUqxk6s20oP/r/lUxQ== X-Received: by 10.200.59.74 with SMTP id r10mr2325152qtf.162.1499919104215; Wed, 12 Jul 2017 21:11:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.140.32.68 with HTTP; Wed, 12 Jul 2017 21:11:43 -0700 (PDT) From: James Jernigan Date: Thu, 13 Jul 2017 00:11:43 -0400 Message-ID: Subject: ixv driver 12.0 crash in AWS To: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Jul 2017 04:11:47 -0000 Hey freebsd net, I have created a few instances in AWS using the lastest AMI for the CURRENT branch: FreeBSD 12.0-CURRENT-amd64-2017-07-11 (ami-847b7992) A couple of these have started up just fine, but the rest of the instances are inaccessible due to the network driver crashing on startup and rendering the machines inaccessible by SSH. I have one working instance, but even creating more based off of that configuration are failing to start networking properly. Restarting the instances does not fix the problem. I have pulled the following logs from the AWS web console for two m4.10xlarge instances with the same configuration and AMI. Working instance: > ixv0: 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on > pci0 > ixv0: Using MSI-X interrupts with 2 vectors > ixv0: Ethernet address: 0a:2f:e8:85:2f:38 > ixv0: netmap queues/slots: TX 1/1024, RX 1/1024 Malfunctioning instance: > ixv0: 1.5.13-k> mem 0xf3000000-0xf3003fff,0xf3004000-0xf3007fff at device 3.0 on > pci0 > ixv0: MBX API 1.2 negotiation failed! Error -32 The error appears to be coming from sys/dev/ixgbe/if_ixv.c in the source. Does this appear to be an AWS specific issue or a more widespread one? Let me know if I can provide any further information. Thanks, James