From owner-freebsd-hackers@freebsd.org Tue Jun 30 18:12:13 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 758AE352D08 for ; Tue, 30 Jun 2020 18:12:13 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49xCB43LcTz3X45 for ; Tue, 30 Jun 2020 18:12:12 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-lj1-x229.google.com with SMTP id s1so23711440ljo.0 for ; Tue, 30 Jun 2020 11:12:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vieRvU3qAoIYVxyJ7fVATWXsltcPsMHUv0eqpbU0QAg=; b=GkK1b5gfusPZuUzj1IBsPRIcg6rDE1GUf+4mlea19DW+yguM7QBlz/FtfQauSb8PwL wAMkZ4dyCVOrql/taWHVlFRSFn8ybc+oEkv57Rz8RRWiB/g8o93D3vqdM3Ip+EyMOI4+ F/6n7t6z1gcSU16K5yqmGgk73teZDUWuRqf21wIDCpKM+IysgLq3u2JVkE+B5xM1YP3Q 9pxmRpE9J0Yde78oFVqbp8xkOHNG5h3hcFnfmi8T2jP1iUg2tFwTPTTSQtDnWGFZDjsM w9JP5/c5LGZB0Jn19OowReMDqEHADVOLDjRI51l7dNcQud8RWpbzSQF/jRDqbfeMhF33 i2sQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vieRvU3qAoIYVxyJ7fVATWXsltcPsMHUv0eqpbU0QAg=; b=D+X3zWRxQA0gRTWuD5GPuciq1OvsmC3BKE63UVfW8ize/SRFhCo8VjqRSXPcJz7/PL tzokMKqopvU0XIwAMLk6r2Wpb5thVl1GPMdvy8ZpM3rdZ4TUNkbKRxJorysflLCUL2zl JQKAYe1xxm+hdHQzKvpIXMzlKGEAWtz+z31FkZ6zH1v8yXl5nscxMX6Bxjqmcl1LPhFx QXO+ccRb4vudzJg5of1KhvvJ4O+ztyhSd1lmv2rQQAiApUY0TxNl+t2Ek7l8nTyH77Nu AuhrdLY2V2jB00keffa0F6eA15hV/qVCRfHsaDeVXlNvKQoVkM2Kmq0GslCGh60kcrf7 3ZNg== X-Gm-Message-State: AOAM532CUSwyBJ3DqIkqoB7kiw/TpkZofyjkjsGNH6hOiRly8SBuaOMn RjONnC3NDG4OVXtEeLd6EaaZTunto4jW2Ng+nmG26ts0Hj4= X-Google-Smtp-Source: ABdhPJxp99uiKdhyvjhaQAB95Ys522yQ59D35xNGwWe1ezHxtS0B4SGYXnDR5Pc/ZLjilY4HiRLs18TINzwutFQyD2Q= X-Received: by 2002:a17:906:19c9:: with SMTP id h9mr18593477ejd.526.1593540666027; Tue, 30 Jun 2020 11:11:06 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Chuck Tuffli Date: Tue, 30 Jun 2020 11:10:53 -0700 Message-ID: Subject: Re: how to set up a nvme target over RAMDISK backend To: Krishnamraju Eraparaju Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 49xCB43LcTz3X45 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tuffli-net.20150623.gappssmtp.com header.s=20150623 header.b=GkK1b5gf; dmarc=none; spf=permerror (mx1.freebsd.org: domain of chuck@tuffli.net uses mechanism not recognized by this client) smtp.mailfrom=chuck@tuffli.net X-Spamd-Result: default: False [-2.29 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.79)[-0.786]; R_DKIM_ALLOW(-0.20)[tuffli-net.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.94)[-0.940]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[tuffli.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::229:from]; DKIM_TRACE(0.00)[tuffli-net.20150623.gappssmtp.com:+]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; NEURAL_HAM_SHORT(-0.27)[-0.267]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jun 2020 18:12:13 -0000 On Thu, Jun 25, 2020 at 9:01 PM Krishnamraju Eraparaju wrote: > Hi All, > > > Could someone please help me in setting up a nvme target over RAMDISK > backend(or any pseudo disk). > > Equivalent in Linux would be as below: > > modprobe null_blk > modprobe nvmet > modprobe nvmet_rdma > > > mkdir /sys/kernel/config/nvmet/subsystems/nvme-ram0 > mkdir /sys/kernel/config/nvmet/subsystems/nvme-ram0/namespaces/1 > > echo -n /dev/ram1 > >/sys/kernel/config/nvmet/subsystems/nvme-ram0/namespaces/1/device_path > echo 1 > /sys/kernel/config/nvmet/subsystems/nvme-ram0/attr_allow_any_host > echo 1 > /sys/kernel/config/nvmet/subsystems/nvme-ram0/namespaces/1/enable > FreeBSD doesn't have a direct equivalent of this. It does support NVMe device emulation in bhyve, but based on loading RDMA drivers above, I'm guessing this won't meet your needs. Another option would be to use the nvmf_tgt provided in SPDK (https://spdk.io/). This would give you the similar functionality to the Linux NVMe target and supports multiple transports including RoCE. --chuck