From owner-freebsd-questions@FreeBSD.ORG Mon Jan 2 20:38:15 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8EBD1065688 for ; Mon, 2 Jan 2012 20:38:15 +0000 (UTC) (envelope-from nec556@retena.com) Received: from resmaa12.ono.com (smtp12.ono.com [62.42.230.20]) by mx1.freebsd.org (Postfix) with ESMTP id 7E7068FC29 for ; Mon, 2 Jan 2012 20:38:15 +0000 (UTC) Received: from GogPortatil.retena.com (95.20.241.130) by resmaa12.ono.com (8.5.113) (authenticated as nec556@retena.com) id 4EFDA3B500092EC0; Mon, 2 Jan 2012 21:38:13 +0100 Message-ID: <4EFDA3B500092EC0@> (added by postmaster@resmaa12.ono.com) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 02 Jan 2012 21:38:09 +0100 To: "Muhammet S. AYDIN" ,freebsd-questions@freebsd.org From: Eduardo Morras In-Reply-To: References: Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Antivirus: AVG for E-mail 10.0.1416 [2109/4118] Cc: Subject: Re: freebsd server limits question X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jan 2012 20:38:16 -0000 At 20:12 02/01/2012, Muhammet S. AYDIN wrote: >Hello everyone. > >My first post here and I'd like to thank everyone who's involved within the >FreeBSD project. We are using FreeBSD on our web servers and we are very >happy with it. > >We have an online messaging application that is using mongodb. Our members >send messages to "the voice" show's (turkish version) contestants. Our two >mongodb instances ended up in two centos6 servers. We have failed. So hard. >There were announcements and calls made live on tv. We had +30K/sec >visitors to the app. > >When I looked at the mongodb errors, I had thousands of these: >http://pastie.org/private/nd681sndos0bednzjea0g. You may be wondering why >I'm telling you about centos. Well, we are making the switch from centos to >freebsd FreeBSD. I would like to know what are our limits? How we can set >it up so our FreeBSD servers can handle min 20K connections (mongodb's >connection limit)? > >Our two servers have 24 core CPUs and 32 GBs of RAM. We are also very open >to suggestions. Please help me out here so we don't fail deadly, again. > >ps. this question was asked in the forums as well however as someone >suggested in the forums, i am posting it here too. Is your app limited by cpu or by i/o? What do vmstat/iostat says about your hd usage? Perhaps mongodb fails to read/write fast enough and making process thread pool bigger only will make problem worse, there will be more threads trying to read/write. Have you already tuned mongodb? Post more info please, several lines (not the first one) of iostat and vmstat may be a start. Your hd configuration, raid, etc... too. L