From owner-freebsd-bugs@freebsd.org Tue Oct 20 17:06:24 2015 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D594A1AAAA for ; Tue, 20 Oct 2015 17:06:24 +0000 (UTC) (envelope-from 3LG8mVhkQAFs5AKBLMB3GF76B3UaY+GHK7IER9HH9E79KHNIL.5HF@unified-notifications.bounces.google.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id E1C108B4 for ; Tue, 20 Oct 2015 17:06:23 +0000 (UTC) (envelope-from 3LG8mVhkQAFs5AKBLMB3GF76B3UaY+GHK7IER9HH9E79KHNIL.5HF@unified-notifications.bounces.google.com) Received: by mailman.ysv.freebsd.org (Postfix) id DF3BBA1AAA9; Tue, 20 Oct 2015 17:06:23 +0000 (UTC) Delivered-To: bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5123A1AAA7 for ; Tue, 20 Oct 2015 17:06:23 +0000 (UTC) (envelope-from 3LG8mVhkQAFs5AKBLMB3GF76B3UaY+GHK7IER9HH9E79KHNIL.5HF@unified-notifications.bounces.google.com) Received: from mail-pa0-f72.google.com (mail-pa0-f72.google.com [209.85.220.72]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A407A8B3 for ; Tue, 20 Oct 2015 17:06:23 +0000 (UTC) (envelope-from 3LG8mVhkQAFs5AKBLMB3GF76B3UaY+GHK7IER9HH9E79KHNIL.5HF@unified-notifications.bounces.google.com) Received: by pacfs1 with SMTP id fs1so70788402pac.2 for ; Tue, 20 Oct 2015 10:06:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=mime-version:date:message-id:subject:from:to:content-type; bh=068F5I/C6S3jMZq1/TcSyExjnqbZeFThjmSsfbbJaZo=; b=EL1X62upViuSW43SPeuaWdkQnXyJoYZbtroH92TOuSJRIFrW2HddXKlBdE2u/x9UHZ MYRTw4fayur/hbF/+oiqyvMdFfdrHLPBVy/ZteyvXhWg/UYae6DJrhFoktBEybAAIIks OpR9L4O/Mew0GuGwhvUvwX1Ps17aA74NzKhjgm19k4Xf+/p/Mi7Dv5fDeQ37LbwJnBT3 KjcpFpxtgclyhWIUaldIevvXM2RjcrpZbX2Yy3pN5W9C991o4oo+JutUhdwl9fue/pqr xdKCMd4LFV4yWcMqmFlX40CBkhHOjH2yhZlbNixnGDxfGSO/zDiyNjz0YTNQOGQgrrGR WSwA== MIME-Version: 1.0 X-Received: by 10.66.199.6 with SMTP id jg6mr3552290pac.35.1445359404975; Tue, 20 Oct 2015 09:43:24 -0700 (PDT) X-Notifications: XEAAAANPYWfVuEiI5XR05W57rmV0 Date: Tue, 20 Oct 2015 09:43:24 -0700 (PDT) Message-ID: <8ZCBYYtWsinGSnqEW10-_A@notifications.google.com> Subject: You have been added to christianmedia175 From: christianmedia175 To: bugs@freebsd.org Content-Type: text/plain; charset=UTF-8; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2015 17:06:24 -0000 SGkgYnVnc0BmcmVlYnNkLm9yZywNCmNocmlzdGlhbm1lZGlhMTc1QGdtYWlsLmNvbSBhZGRlZCB5 b3UgdG8gdGhlIGNocmlzdGlhbm1lZGlhMTc1IGdyb3VwLg0KaHR0cHM6Ly9ncm91cHMuZ29vZ2xl LmNvbS9kL2ZvcnVtL2NocmlzdGlhbm1lZGlhMTc1DQoNCk1lc3NhZ2UgZnJvbSBjaHJpc3RpYW5t ZWRpYTE3NUBnbWFpbC5jb206DQpEZWFyIENocmlzdGlhbiBNZWRpYSBGcmllbmQsDQoNCldlIHNo b3cgeW91IGFzIHJlY2VpdmluZyBvdXIgcHJvcGhlY3kgcHVibGljYXRpb24sIHRoZSBDaHJpc3Rp YW4gTWVkaWEgIA0KQ09NTVVOSVFVRS4gV2l0aCB0aGUgZm9ybWF0aW9uIG9mIG91ciBHb29nbGUg Z3JvdXAsIHdlIGFyZSBhc3N1cmVkIHlvdXIgIA0KcHJvcGhlY3kgbGV0dGVyIHdpbGwgbm90IGJl IGJsb2NrZWQgYnkgbWFsZXZvbGVudCBJbnRlcm5ldCBmYWN0aW9ucywgc28gd2UgIA0KaGF2ZSBt b3ZlZCB0byBzZW5kIHlvdXIgaXNzdWVzIHZpYSB0aGlzIGdyb3VwLiBBbiB1bnN1YnNjcmliZSBv cHRpb24gaXMgIA0KZm91bmQgYXQgdGhlIGJvdHRvbSBvZiBldmVyeSBuZXdzbGV0dGVyLg0KDQpB cyB5b3UgbWF5IGtub3csIHdlIGFsc28gaGF2ZSBtdWx0aXBsZSBwcmludCBwdWJsaWNhdGlvbnMg d2hpY2ggYXJlIG1haWxlZCAgDQp2aWEgdGhlIHBvc3RhbCBzeXN0ZW0uIFRoZXNlIHB1YmxpY2F0 aW9ucyBhcmUgTk9UIG9uIHRoZSBJbnRlcm5ldC4gV2l0aCAzICANCnNlcGFyYXRlIDI0LzcgcmFk aW8gbmV0d29yayBzdHJlYW1zIOKAkyBDaHJpc3RpYW5NZWRpYU5ldHdvcmsuY29tLCAgDQpHRU9t ZWRpYW5ldHdvcmsuY29tLCBhbmQgVkNoYW5uZWwudXMsIG15IHJhZGlvIHNob3csIFRoZSBBcG9j YWx5cHNlICANCkNocm9uaWNsZXMgaXMgYWxzbyBwb3N0ZWQgZm9yIG9uIGRlbWFuZCBsaXN0ZW5p bmcgYXQgIA0KQ2hyaXN0aWFuTWVkaWFEYWlseS5jb20uDQoNClRoYW5rcyBmb3IgcmVzcG9uZGlu ZyB0byB0aGUgbWVzc2FnZSB0aGF0IEdvZCBoYXMgZ2l2ZW4gdXMsIGFuZCB3ZSBob3BlIGFuZCAg DQpwcmF5IHlvdeKAmWxsIGJlIGJsZXNzZWQgd2l0aCBpdC4NCg0KSmFtZXMgTGxveWQNCg0KQWJv dXQgdGhpcyBncm91cDoNCkdyb3VwIGZvcm1lZCB0byBkaXN0cmlidXRlIHRoZSBwcm9waGVjaWVz IG9mIEphbWVzIExsb3lkLg0KDQpHb29nbGUgR3JvdXBzIGFsbG93cyB5b3UgdG8gY3JlYXRlIGFu ZCBwYXJ0aWNpcGF0ZSBpbiBvbmxpbmUgZm9ydW1zIGFuZCAgDQplbWFpbC1iYXNlZCBncm91cHMg d2l0aCBhIHJpY2ggY29tbXVuaXR5IGV4cGVyaWVuY2UuIFlvdSBjYW4gYWxzbyB1c2UgeW91ciAg DQpHcm91cCB0byBzaGFyZSBkb2N1bWVudHMsIHBpY3R1cmVzLCBhbmQgY2FsZW5kYXJzIGludml0 YXRpb25zLg0KSWYgeW91IGRvIG5vdCB3aXNoIHRvIGJlIGEgbWVtYmVyIG9mIHRoaXMgZ3JvdXAg b3IgYmVsaWV2ZSB0aGlzIGdyb3VwIG1heSAgDQpjb250YWluIHNwYW06DQoqIFlvdSBjYW4gdW5z dWJzY3JpYmUgZnJvbSB0aGlzIGdyb3VwIGF0ICANCmh0dHBzOi8vZ3JvdXBzLmdvb2dsZS5jb20v ZC9mb3J1bS9jaHJpc3RpYW5tZWRpYTE3NS91bnN1YnNjcmliZS9sajljZUJRQUFBQS1sU01FN1Rj Z1FzaEdlWjVWWWNUVUNITW92M20wUkw3NUQwbjJ3Rzh4QVENCiogWW91IGNhbiByZXBvcnQgdGhp cyBncm91cCBmb3IgYWJ1c2UgYXQgIA0KaHR0cHM6Ly9ncm91cHMuZ29vZ2xlLmNvbS9kL2FidXNl L1lRQUFBUGhLRmZBTkFBQUF4MTNBTWNRQUFBQ3JNZ0VaVHhIX2VvaFgtYTY0VVkxanZwM01KNjgN CiogWW91IGNhbiBvcHQgb3V0IG9mIGFsbCBmdXR1cmUgR29vZ2xlIEdyb3VwcyBhY3Rpdml0eSBh dCAgDQpodHRwczovL2dyb3Vwcy5nb29nbGUuY29tL2Qvb3B0b3V0DQoNClZpZXcgdGhpcyBncm91 cCBhdDogaHR0cHM6Ly9ncm91cHMuZ29vZ2xlLmNvbS9kL2ZvcnVtL2NocmlzdGlhbm1lZGlhMTc1 DQoNClN0YXJ0IHlvdXIgb3duIGdyb3VwIGF0IGh0dHBzOi8vZ3JvdXBzLmdvb2dsZS5jb20vZC9j cmVhdGVncm91cC4NClZpc2l0IEdvb2dsZSBHcm91cHMgSGVscCBDZW50ZXIgYXQgIA0KaHR0cDov L3N1cHBvcnQuZ29vZ2xlLmNvbS9ncm91cHMvYmluL2Fuc3dlci5weT9hbnN3ZXI9NDY2MDEuDQo= From owner-freebsd-bugs@freebsd.org Tue Oct 20 17:16:12 2015 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 53F62A1ADED for ; Tue, 20 Oct 2015 17:16:12 +0000 (UTC) (envelope-from s-2kfdph4txnm6vw0anfosnpmm6gcwp34cmt4sx56bn9ayu4l20gzkzfj7@bounce.linkedin.com) Received: from maile-fb.linkedin.com (maile-fb.linkedin.com [199.101.162.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.linkedin.com", Issuer "DigiCert Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 35076F26 for ; Tue, 20 Oct 2015 17:16:12 +0000 (UTC) (envelope-from s-2kfdph4txnm6vw0anfosnpmm6gcwp34cmt4sx56bn9ayu4l20gzkzfj7@bounce.linkedin.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linkedin.com; s=proddkim1024; t=1445361357; bh=I2GL+ogtrdc0jui3TQr+3PjKeMqLFXp0baTVdkAMGG4=; h=From:Subject:MIME-Version:Content-Type:To:Date:X-LinkedIn-Class: X-LinkedIn-Template:X-LinkedIn-fbl; b=t1/ai6cIMNEjXRY/yfNaYK8EtgrFDA1erqnp3mhSPT9D3Uv0sXCOo7Ly9K+wPJKQX aMaGeQ6Hh43cQr7qX0dy1DA3Kxz2S12efTbv0IepeAR60PUfM/X1laCIRqcv42kOkv tWkUJ03V0KJ7k++FgG1akEJUnmT81vQPiN0/qVoI= From: Vijay Uppn Message-ID: <1311834773.515516.1445361357208.JavaMail.app@ltx1-app5493.prod.linkedin.com> Subject: Hi FreeBSD MIME-Version: 1.0 To: FreeBSD FreeBSD Date: Tue, 20 Oct 2015 17:15:57 +0000 (UTC) X-LinkedIn-Class: INVITE-GUEST X-LinkedIn-Template: invite_guest X-LinkedIn-fbl: m2-aszwush6921nj15uj88s827h8sfpl7a9yuh9fep8jjwmspkpjdtaroo57knz0ihs6oep542an2gzrr9h076g508550rdo41b6pfb59 X-LinkedIn-Id: -z4hbjy-ifzmtvfs-6e Content-Type: text/plain;charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2015 17:16:12 -0000 Hey FreeBSD, Join me and over 300 Million other members (over 33 Million from India) on = LinkedIn. You can build important contacts to help grow your career and fin= d good job opportunities from India and abroad. Start by viewing my full pr= ofile. Vijay Uppn Technopreneur Bengaluru Area, India Add me on LinkedIn - https://www.linkedin.com/e/v2?e=3D-z4hbjy-ifzmtvfs-6e&= t=3Dssuw&tracking=3Deml-india-m2g-b-cta&ek=3Dinvite_guest&sharedKey=3Dee2b9= 5nE&invitationId=3D6062284683545231360 You received an invitation to connect. LinkedIn will use your email address= to make suggestions to our members in features like People You May Know. U= nsubscribe here: https://www.linkedin.com/e/v2?e=3D-z4hbjy-ifzmtvfs-6e&t=3D= lun&midToken=3DAQFmrFVhGEd36Q&ek=3Dinvite_guest&loid=3DAQHJ4IxNsjwsGgAAAVCG= QBFy0Gy8ZVGyYDHTRD3zYb89X38yHBqaBqn0M6Z3aCfX0hJYzRwdF3JGS7LNaOmnVA&eid=3D-z= 4hbjy-ifzmtvfs-6e This email was sent to freebsd-bugs@freebsd.org. If you need assistance or have questions, please contact LinkedIn Customer = Service: https://www.linkedin.com/e/v2?e=3D-z4hbjy-ifzmtvfs-6e&a=3Dcustomer= ServiceUrl&ek=3Dinvite_guest © 2015 LinkedIn Corporation, 2029 Stierlin Court, Mountain View CA 940= 43. LinkedIn and the LinkedIn logo are registered trademarks of LinkedIn. From owner-freebsd-bugs@freebsd.org Tue Oct 20 17:57:20 2015 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28655A1A6D8 for ; Tue, 20 Oct 2015 17:57:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0C34A7F for ; Tue, 20 Oct 2015 17:57:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t9KHvJJW093137 for ; Tue, 20 Oct 2015 17:57:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 203900] Can not increase above 32K max open files descriptor per PID Date: Tue, 20 Oct 2015 17:57:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ri24l_pwt@yahoo.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Oct 2015 17:57:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203900 Bug ID: 203900 Summary: Can not increase above 32K max open files descriptor per PID Product: Base System Version: 10.1-STABLE Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: ri24l_pwt@yahoo.com I run application which is sometimes opening >200k files at the same time. But, I get issue about "Too many open files". To test it, simply I create many dummy files and open it. Here the steps Download source code to generate & load files: * https://gist.github.com/juniorh/3b2fb0a80cddb8e407b3 * https://gist.github.com/juniorh/ef9273911dee551f1048 # create files > mkdir /tmp/1 > python dummyFileGenerator.py -r 1 -n 1000000 -d /tmp/1 # open all files > python dummyFileLoader.py -r 1 -n 1000000 -d /tmp/1 Then, after the script open 32766 files, error occures like: ================================= ... ... open file number: 30763 retry openfile 32766 Traceback (most recent call last): File "dummyFileLoader.py", line 69, in File "dummyFileLoader.py", line 54, in openfile IOError: [Errno 24] Too many open files: '/tmp/1/00/00/7f/fd' ================================= It seems FreeBSD only alow each PID to open up to 32K files. Changing kern.maxfiles and kern.maxfilesperproc is also not solved the issue. For additional, here my environtment: ================================= # sysctl -a | grep maxfile kern.maxfiles: 130305 kern.maxfilesperproc: 117270 # ulimit -a cpu time (seconds, -t) unlimited file size (512-blocks, -f) unlimited data seg size (kbytes, -d) 33554432 stack size (kbytes, -s) 524288 core file size (512-blocks, -c) unlimited max memory size (kbytes, -m) unlimited locked memory (kbytes, -l) unlimited max user processes (-u) 8514 open files (-n) 117270 virtual mem size (kbytes, -v) unlimited swap limit (kbytes, -w) unlimited sbsize (bytes, -b) unlimited pseudo-terminals (-p) unlimited # uname -a FreeBSD fbd1 10.1-RELEASE FreeBSD 10.1-RELEASE #0 r274401: Tue Nov 11 21:02:49 UTC 2014 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 ================================= -- You are receiving this mail because: You are the assignee for the bug.