From owner-freebsd-performance@FreeBSD.ORG Wed May 21 00:14:33 2014 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3DD3DBBC; Wed, 21 May 2014 00:14:33 +0000 (UTC) Received: from mail-la0-x232.google.com (mail-la0-x232.google.com [IPv6:2a00:1450:4010:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 75C5B2260; Wed, 21 May 2014 00:14:32 +0000 (UTC) Received: by mail-la0-f50.google.com with SMTP id b8so1003685lan.9 for ; Tue, 20 May 2014 17:14:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=QnS3juKGBwwY+AhFcO+2hyadp0uVMoT+TIdGWPAX46g=; b=gNcjXnSEzLZzPZq8sU5WbbQT3RRuWwKAFjdXOUn9jFIW8Sm9RCZ+pvoPCwXoC73uLb +/wX7Kczen+MudEYGNKqWlbnZnLLsQ0vQMy8MLHQfCIze2ZpMfw7Jz/MXuM4VCJPFe72 66k9sB+1/of1ASHzkWtTYe13Z1tm9kfprqggRmnjb+jJ33MwAeVHaY6sIdMwkDp4Gbgq SRXlbmBEsHG2kXYmveW52MbQR30kdmDmL6n8ruDu9cu0tvlbvG4mKwvJ8bdpTfzOjQKc 8JVVqRix41RnuWlMfezjA28AlR7Bw1ZlQj/amPxJcgkuBmXmISAnNbAfjKH+qUZrmFf9 jjBA== X-Received: by 10.152.87.52 with SMTP id u20mr10312152laz.52.1400631270344; Tue, 20 May 2014 17:14:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.115.4.4 with HTTP; Tue, 20 May 2014 17:13:50 -0700 (PDT) In-Reply-To: <572540F9-13E4-4BA9-88AE-5F47FB19450A@pingpong.net> References: <5327B9B7.3050103@gmail.com> <2610F490C952470C9D15999550F67068@multiplay.co.uk> <532A192A.1070509@gmail.com> <572540F9-13E4-4BA9-88AE-5F47FB19450A@pingpong.net> From: =?UTF-8?Q?Gezeala_M=2E_Bacu=C3=B1o_II?= Date: Tue, 20 May 2014 17:13:50 -0700 Message-ID: Subject: Re: FreeBSD 10 and PostgreSQL 9.3 scalability issues To: Palle Girgensohn Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18 Cc: Adrian Chadd , "bsdmailinglist@googlegroups.com" , Petr Janda , Steven Hartland , FreeBSD Mailing Lists , Sean Chittenden X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 May 2014 00:14:33 -0000 Do you guys have any updates on this? -- regards gezeala bacu=C3=B1o II On Tue, Apr 22, 2014 at 11:52 PM, Palle Girgensohn wro= te: > > > > 23 apr 2014 kl. 01:04 skrev Adrian Chadd : > > > > Hi, > > > > Are you able to repeat these tests (for both 9.2 and 9.3) whilst > > grabbing some performance data from lock profiling and hwpmc? > > I sure can, but I'd love some pointers as to how this is done. Please? :-= ) > > > > > The benchmarking is great but it doesn't tell us enough information as > > to "why" things behave poorly compared to Linux and why the mmap drop > > isn't so great. > > > As per the discussion on postresql-hackers, the regression between pg9.2 > and pg9.3, which includes the sysv->mmap shift, *might* also exist, at > least partly, on Linux as well. > > The initial post in *this* thread does however indicate that freebsd > performs poorer than Linux and dragonflybsd, but does not really compare > PostgreSQL versions. > > Just so we're not pursuing the wrong problem here, let's be open minded > about the definition of the problem. :-) > > > > > What about with more clients? 64? 128? 256? > > My test went to 80. I can go higher as well, though other sources say 50 > is a reasonable limit for PostgreSQL. > > Palle > > > > > > > > Thanks! > > > > > > > > -a > > > > > >> On 21 April 2014 14:11, Palle Girgensohn wrote: > >> > >> > >>> Den torsdagen den 20:e mars 2014 kl. 00:33:10 UTC+1 skrev Sean > Chittenden: > >>> > >>>> As far as I know, the test was done on both UFS2 and ZFS and the > >>>> difference was marginal. > >>> > >>> As Adrian pointed out, there is an mmap(2) mutex in the way. Starting > in > >>> PostgreSQL 9.3, shared buffers are allocated out of mmap(2) instead o= f > shm. > >>> shm is only used to notify the PostgreSQL postmaster that a child > process > >>> exited/crashed (when a pid detaches from a shm segment, there is a > kernel > >>> event, but there is no kernel event when detaching from an mmap(2) > region). > >>> -sc > >>> > >>> http://www.postgresql.org/docs/9.3/static/release-9-3.html#AEN115039 > >>> > >>> > >>>>>> Just want to share these pgbench results done by DragonFlyBSD, and > >>> would > >>>>>> like some input on why these numbers look so bad and what can be > done > >>> to > >>>>>> improve (ie. kernel tunables etc) the performance. > >>> > http://lists.dragonflybsd.org/pipermail/users/attachments/20140310/4250b9= 61/attachment-0001.pdf > >>>>> > >>>>> > >>>>> Do you have the ability to test with FreeBSD 8.x and 9.x to see if > this > >>> is > >>>>> regression? > >>>>> > >>>>> Also you don't mention the FS used in each case, so I'm wondering i= f > >>> you > >>>>> used a ZFS install of FreeBSD which could help to explain things. > >>> > >>> > >>> -- > >>> Sean Chittenden > >>> se...@chittenden.org > >> Hi, > >> > >> There is a fresh thread about this in postgresql-hackers [1]. > >> > >> There are two parallel approaches suggested there, where one is to hav= e > an > >> option to continue using the old SYSV shared memory in PostgreSQL, and > the > >> other is the suggestion that "somebody needs to hold the FreeBSD folks= ' > >> feet to the fire about when we can expect to see a fix from their side= ." > >> > >> Looking at the original post in this thread, it seems to me that FreeB= SD > >> has scalability problems beyond what the SYSV vs mmap change in > PostgreSQL > >> introduces? Check my test of PostgreSQL 9.2 vs 9.3 on FreeBSD 10.0 at > [1]. > >> The difference between PG92 and PG93 is not huge, ~17%. The difference > >> between FreeBSD and the other OS:es in this thread's original post's > >> performance chart seems to be about a lot more? > >> > >> Palle > >> > >> [1] > >> > http://www.postgresql.org/message-id/2AE143D2-87D3-4AD1-AC78-CE2258230C05= @FreeBSD.org > >> _______________________________________________ > >> freebsd-performance@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance > >> To unsubscribe, send any mail to " > freebsd-performance-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to " > freebsd-performance-unsubscribe@freebsd.org" >