From owner-freebsd-infiniband@freebsd.org Mon Apr 25 21:55:50 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3E357B1C761 for ; Mon, 25 Apr 2016 21:55:50 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: from mail-io0-x22e.google.com (mail-io0-x22e.google.com [IPv6:2607:f8b0:4001:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 098901941 for ; Mon, 25 Apr 2016 21:55:50 +0000 (UTC) (envelope-from bacon4000@gmail.com) Received: by mail-io0-x22e.google.com with SMTP id f89so162892466ioi.0 for ; Mon, 25 Apr 2016 14:55:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=/Y0D2wvwu6NROl8vZ5y2oHkv+h1AhAcWersDFE7vTDE=; b=olRM8FAWIRbFanrFN1+u4A7uDxTc3/AZY6JiivxxXh9H+wLzUZv0P7ZuabWLo4m6B9 GBCi4R/zJQssSPNVpBI4WD5x2YBG2NUN0kFhDdI3OLjMC/Zv2xHW0bXfGq93ErNx9IaO o3iAAhrQeiCbn67mjgypL4kE9ow/gSGSYXQBKQRk8sBp9DINkLPZd6TvErEkyzeVYH3i mV0D4WHtazRFAsycDzO6GOMJu2I3/LeGpx9XzQN7Ia/SPdp6RCr35Qn/tW/rlQynAOuY MRCYvcOKEbjRRP4DZCg7WIJuNal/cu0tDLDUVqfqatUbYLyWwpgAwfJ05XtXWEjWWEfa 2g6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=/Y0D2wvwu6NROl8vZ5y2oHkv+h1AhAcWersDFE7vTDE=; b=kEMwrHXaD8wkSlHxVjKx84tG/kWQZe7vuNqQE2ekljAgbeqp9PwBJp4foYXS05Ef29 sKxb5RY3Ca0dLBa5jpEmpvsopq0fXOMyQlT4jCF5WttpCQ5NFk1CPMZSpR4K3rzFgu7Y NwEB8mG7PoLDjCzBTfupEylbj+V24cGkCHM5LYH580x8o1JhR05SR0MwiXcpDUP66Ox3 EClsjeTPxgsC1Fp/RKcKRzcWcLnSb5ZcVLsqnQtoWmkKhnAPiTei7H36hgZczo1Ua1KS tROOZXOg2+mXQ9ti7kR0RFsoJGp5F3YLc5ofksWAHo2IJXr1ZNRKSLsdnR4Ov4yKWVCw tZYw== X-Gm-Message-State: AOPr4FUsxTT6fLmwqwJuHnP79sf6JL2sIiAhhmL6qojEajRFVICSVaogfqzNUOyf0Ok0Cw== X-Received: by 10.107.10.37 with SMTP id u37mr14875148ioi.92.1461621349295; Mon, 25 Apr 2016 14:55:49 -0700 (PDT) Received: from imacbsd.acadix.biz ([64.83.177.9]) by smtp.gmail.com with ESMTPSA id n75sm12485941ioe.9.2016.04.25.14.55.47 for (version=TLSv1/SSLv3 cipher=OTHER); Mon, 25 Apr 2016 14:55:48 -0700 (PDT) To: "freebsd-infiniband@freebsd.org" From: Jason Bacon Subject: Userland without buildworld? Message-ID: <571E9261.1000508@gmail.com> Date: Mon, 25 Apr 2016 16:55:45 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Apr 2016 21:55:50 -0000 I explored /usr/src a bit to see where WITH_OFED actually comes into play. For the most part, it appears to be just adding the following to the build tree: /usr/src/contrib/ofed /usr/src/sys/ofed Outside the ofed directories and the kernel, it doesn't seem to do a lot, as I would expect. /usr/src/etc/rc.d/Makefile optionally builds opensm. /usr/src/usr.bin/netstat/Makefile adds --DSDP to CFLAGS. It would seem to me that it should be possible to build OFED userland support without wasting time building the > 99% of the code that has nothing to do with it. Does anyone know of a proven method to build and install the OFED userland without doing an entire buildworld? This would go a long way toward easing deployment of the IB stack en masse. I suspect that there would be stiff resistance to the idea of including IB support in the default builds, since it would add some bulk and so few people will ever use it. It may therefore be on those of us who are interested in finding efficient ways to deploy IB support. Regards, Jason P.S. Step 1 in my exploration: <<>> /home/bacon 1001 # find /usr/src/ -type f -exec fgrep -l OFED '{}' \; /usr/src/tools/build/options/WITH_OFED /usr/src/etc/rc.d/Makefile /usr/src/share/man/man5/src.conf.5 /usr/src/share/man/man5/pf.conf.5 /usr/src/share/mk/bsd.own.mk /usr/src/contrib/ofed/libmlx4/fixes/lim_qp_resources.patch /usr/src/contrib/ofed/libmlx4/fixes/userspace_dev_lims.patch /usr/src/contrib/ofed/libmlx4/fixes/xrc_consolidated_v2.patch /usr/src/contrib/ofed/libmlx4/fixes/xrc_kernel_user_mismatch.patch /usr/src/contrib/ofed/libsdp/README /usr/src/contrib/ofed/usr.lib/libsdp/Makefile /usr/src/contrib/ofed/libibverbs/fixes/XRC_RCV_QP.patch /usr/src/contrib/ofed/libibverbs/fixes/pthread_cond_t_fields.patch /usr/src/contrib/ofed/libibverbs/fixes/XRC_base_implementation.patch /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes_openib-1.2.1.txt /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes_openib-2.0.5.txt /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes-3.2.txt /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes_openib-3.0.13.txt /usr/src/contrib/ofed/management/opensm/doc/performance-manager-HOWTO.txt /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes-3.1.10.txt /usr/src/contrib/ofed/management/opensm/doc/opensm_release_notes-3.1.11.txt /usr/src/contrib/ofed/management/opensm/complib/ChangeLog /usr/src/contrib/ofed/management/infiniband-diags/infiniband-diags.spec.in /usr/src/sys/modules/ibcore/Makefile /usr/src/sys/modules/ipoib/Makefile /usr/src/sys/modules/Makefile /usr/src/sys/modules/mlx4ib/Makefile /usr/src/sys/amd64/conf/NOTES /usr/src/sys/i386/conf/NOTES /usr/src/sys/conf/kern.pre.mk /usr/src/sys/conf/options /usr/src/sys/conf/files /usr/src/sys/sys/socket.h /usr/src/sys/ofed/include/linux/module.h /usr/src/sys/ofed/drivers/infiniband/hw/mlx4/main.c /usr/src/sys/ofed/drivers/net/mlx4/main.c /usr/src/sys/ofed/drivers/net/mlx4/mlx4.h /usr/src/sys/ofed/drivers/net/mlx4/en_main.c /usr/src/usr.bin/netstat/Makefile /usr/src/Makefile.inc1 -- All wars are civil wars, because all men are brothers ... Each one owes infinitely more to the human race than to the particular country in which he was born. -- Francois Fenelon