From owner-freebsd-hackers@FreeBSD.ORG Mon Mar 4 18:24:16 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id B96D78F8 for ; Mon, 4 Mar 2013 18:24:16 +0000 (UTC) (envelope-from garym@oedata.com) Received: from mail-qe0-f54.google.com (mail-qe0-f54.google.com [209.85.128.54]) by mx1.freebsd.org (Postfix) with ESMTP id 82570D2D for ; Mon, 4 Mar 2013 18:24:16 +0000 (UTC) Received: by mail-qe0-f54.google.com with SMTP id i11so3260700qej.27 for ; Mon, 04 Mar 2013 10:24:09 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type:x-gm-message-state; bh=5647zb5WjSUmNJd95Cl0lRWWZV+b75sdx5Awfo3Q/9I=; b=bHrfDhiPGS/jtvIVgZ6vxEd4IOMPjXFTSTj2K0Ka8RONrxPc81K7vw5jhySPgxoOrx V8wAPWvJTXNujWnVJVb7f6u6Cbo8Hu4Q9M43qMbYXQZ4zERatUVCDRj1cQ9wmKWBeQBe v9DjDCrL9aAQk3BsASVGZdWgQ48UGVv5oWpxJ5UIqrYZiJa3qtTi4+G1WemBmZrVvpGo VeFODwjs/cimijBv2/euDikNI6mub2lBlBQ4nEpWWaYr5ViUdhrfVAj6JtzvUVnc3Rww S+U0MhJH/kgUY6MvLz3zrKpBKsfAd24CEFrm+1JJalJvBZl98ET7FSYQgDnT9mUsUDKU rhjg== MIME-Version: 1.0 X-Received: by 10.224.106.201 with SMTP id y9mr35282695qao.3.1362421448994; Mon, 04 Mar 2013 10:24:08 -0800 (PST) Received: by 10.224.219.137 with HTTP; Mon, 4 Mar 2013 10:24:08 -0800 (PST) In-Reply-To: References: Date: Mon, 4 Mar 2013 11:24:08 -0700 Message-ID: Subject: Re: Need advice on sys5 shm and zero copy sockets From: gary mazzaferro To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQkJ8YW0vFzrHaDQ+23UR6RLn/1oUZvvu9bf+zdxY2Me14SeY8qSAzozM3kIdmJ+nojBY6Gp X-Mailman-Approved-At: Mon, 04 Mar 2013 21:18:35 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Mar 2013 18:24:16 -0000 Hi, Thanks for all the help.. Looks like I'll move forward with recommending linux as a base for our new cloud execution containers. Personally, I thought freebsd would be a technically superior and longer term solution for scientific grid and cloud, but if I can't get support on best architectural practices. I'll need to move to something I that will be supported during eval, design and prototyping processes. -g On Thu, Feb 7, 2013 at 1:22 PM, gary mazzaferro wrote: > Hi, > > I was told to post this question here (Ken Merry), it would be a good > place to get some help. I'm not sure this is doable without a kernel > module, which I don't want to add. > > I'll explain what I'm attempting.. > > I'm designing a high speed rest motor for cloud execution environment. > > 1) I'd like to eliminate copy from the tcp stack to the application(s). > > 2) I'm also sharing the buffers across processes and jails. So I'd > like to preserve the zero-copy in a msg pipe/unix socket > > 3) Some buffers will go to disk file systems. > > > Wish list: > 4) I'd like it to work with sctp because I like it for local networking :) > > 5) I'd like to provision memory pools on a per > application/connection/ip port basis. > > Ultimate Goal: > 6) Additionally, I'm injecting "code" from a foreign process into the > workflow of another process (state machine). The connection between > them will be a signal and shared state information. > > I'm assuming item (6) is a separate issue, but it may impact the direction.. > > I've tried shm with zero copy sockets with linux and it just will not work !! > > BTW, I'm returning to freebsd after far too many years > > cheers, > gary