From owner-freebsd-database Fri Jun 19 10:20:18 1998 Return-Path: Received: (from majordom@localhost) by hub.freebsd.org (8.8.8/8.8.8) id KAA24403 for freebsd-database-outgoing; Fri, 19 Jun 1998 10:20:18 -0700 (PDT) (envelope-from owner-freebsd-database@FreeBSD.ORG) Received: from elektra.ultra.net (elektra.ultra.net [199.232.56.13]) by hub.freebsd.org (8.8.8/8.8.8) with ESMTP id KAA24294 for ; Fri, 19 Jun 1998 10:19:39 -0700 (PDT) (envelope-from syang@DIRHIT.COM) Received: from moe.dirhit.com (d-hit.dirhit.com [146.115.235.211]) by elektra.ultra.net (8.8.8/ult.n14767) with ESMTP id NAA25010 for ; Fri, 19 Jun 1998 13:19:32 -0400 (EDT) Received: by MOE with Internet Mail Service (5.0.1459.74) id ; Fri, 19 Jun 1998 13:01:21 -0400 Message-ID: <839A86AB6CE4D111A52200104B938D435B41@MOE> From: Steven Yang To: "'freebsd-database@FreeBSD.org'" Subject: gdbm scalability question Date: Fri, 19 Jun 1998 13:01:20 -0400 MIME-Version: 1.0 X-Mailer: Internet Mail Service (5.0.1459.74) Content-Type: text/plain Sender: owner-freebsd-database@FreeBSD.ORG Precedence: bulk Hi, I am having trouble creating a gdbm database larger than 16.9MB. I have 128MB of RAM, and would like my database to be as large as 2GB. However, as I generate a test database, when the file reaches 16.9MB in size, I get: gdbm fatal: malloc error It appears that there is a per-process limitation of 16MB of RAM with a generic kernel. But even if I were to get around that per-process thing, I wouldn't be able to generate a 2GB database file with only 128MB of RAM given what I am doing. Does gdbm have to load the entire database into RAM in order to insert a record? Is there a setting I have to change? Does anybody out there know how to make a large gdbm database, like one with 10 million records where the content of each record is 1-2KB? Once the database is created, it is meant to be read-only. - Steven Yang To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-database" in the body of the message