Date: Sat, 16 Mar 2002 08:59:55 -0500 From: "Jules Gilbert" <jules@aasp.net> To: <freebsd-questions@freebsd.org> Subject: 3GB address space for user app's with FreeBSD 4.5 Message-ID: <008101c1ccf2$dc569be0$1800a8c0@verizon.net>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] I am running FreeBSD 4.5. Out of the box, I can malloc almost 512M. Nice for starter's, but not nearly enough. To overcome this (in earlier editions of FreeBSD), I set MAXDSIZ and DFLDSIZ to 1.5GB, giving me an effective 1GB of malloc'able space. But I've made some changes to my application and I need to go higher, at least to 2GB, and I would not be surprised in six months to be at 2.5GB. I have heard that 4.5 includes a feature to allow the user to increase his available address space. I need to know more. I saw a reference to an export'able variable. Is this right? What is the name of this variable? Where is it documented? My application involves large-scale data mining, and I just upgraded to 1.5GB per box. So, ideas anyone? Sincerely, Jules Gilbert PS1: When I set the MAXDSIZ and DFLDSIZ above, say 1700M, the machines ocasionally issue double interrupts, which causes a third interrupt, which in X86 is equivalent to a hard reset. Not very convienient! PS2: Years ago (until about '95) I ran Slackware Linux. Tried it again for this application. It's changed, and today the Linux'es I tried were bloated and performed very poorly compared to FreeBSD. Sure, not as many applications run 'out of the box' as with Linux, but if you can use a C compiler and want performance, the BSD's are the right choice -- let's make the address space adaquate, too! PS3: What is really needed is a port of FreeBSD designed JUST FOR cluster box'es. The machines I'm using are part of a small cluster (each with 1.5GB and two disks). No terminals, no X sessions, no serial com lines. Just an ethernet card and horsepower. Putting FreeBSD on these boxes was incredibly difficult -- we wound up dup'ing disks. A floppy based install via NFS would have been great. But my bigger point is that no one is providing support for clustered boxes. [-- Attachment #2 --] <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML><HEAD> <META http-equiv=Content-Type content="text/html; charset=iso-8859-1"> <META content="MSHTML 6.00.2600.0" name=GENERATOR> <STYLE></STYLE> </HEAD> <BODY bgColor=#ffffff> <DIV><FONT face=Arial size=2>I am running FreeBSD 4.5.</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>Out of the box, I can malloc almost 512M. Nice for starter's, but not nearly enough. To overcome this (in earlier editions of FreeBSD), I set MAXDSIZ and DFLDSIZ to 1.5GB, giving me an effective 1GB of malloc'able space.</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>But I've made some changes to my application and I need to go higher, at least to 2GB, and I would not be surprised in six months to be at 2.5GB.</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>I have heard that 4.5 includes a feature to allow the user to increase his available address space. I need to know more. I saw a reference to an export'able variable. Is this right? What is the name of this variable? Where is it documented?</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>My application involves large-scale data mining, and I just upgraded to 1.5GB per box.</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>So, ideas anyone?</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>Sincerely,</FONT></DIV> <DIV><FONT face=Arial size=2>Jules Gilbert</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>PS1: When I set the MAXDSIZ and DFLDSIZ above, say 1700M, the machines ocasionally issue double interrupts, which causes a third interrupt, which in X86 is equivalent to a hard reset. Not very convienient!</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>PS2: Years ago (until about '95) I ran Slackware Linux. Tried it again for this application. It's changed, and today the Linux'es I tried were bloated and performed very poorly compared to FreeBSD. Sure, not as many applications run 'out of the box' as with Linux, but if you can use a C compiler and want performance, the BSD's are the right choice -- let's make the address space adaquate, too!</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>PS3: What is really needed is a port of FreeBSD designed JUST FOR cluster box'es. The machines I'm using are part of a small cluster (each with 1.5GB and two disks). No terminals, no X sessions, no serial com lines. Just an ethernet card and horsepower. Putting FreeBSD on these boxes was incredibly difficult -- we wound up dup'ing disks. A floppy based install via NFS would have been great. But my bigger point is that no one is providing support for clustered boxes.</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV></BODY></HTML>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?008101c1ccf2$dc569be0$1800a8c0>