Date: Sat, 22 Apr 2023 11:46:31 +0300 From: Odhiambo Washington <odhiambo@gmail.com> To: Aryeh Friedman <aryeh.friedman@gmail.com> Cc: Mario Marietto <marietto2008@gmail.com>, FreeBSD Mailing List <freebsd-hackers@freebsd.org>, FreeBSD Mailing List <freebsd-questions@freebsd.org>, Yuri Victorovich <yuri@freebsd.org> Subject: Re: Installing openAI's GPT-2 Ada AI Language Model Message-ID: <CAAdA2WP5_OT3Jge37EzS_p65gM59gpQ7%2By3jhQ3RHfAr-v5SLA@mail.gmail.com> In-Reply-To: <CAGBxaXnxvU7oKNVO8uZwLhFNQzzVSxkAuTUqWNjwJz_eyYDncA@mail.gmail.com> References: <CAGBxaXmhRLk9Lx_ZHeRdoN-K2fRLEhY3cBVtBymmAjd4bBh1OQ@mail.gmail.com> <CA%2B1FSihQ-f4uhiOjYH8Wo=AxFEkAKe3NRDJdopgT50J=_jY4fA@mail.gmail.com> <CAGBxaXnYojzQJqO62hkzUJvD2rzaNp%2Bem38FgCqVSBu%2BmkBi9A@mail.gmail.com> <CA%2B1FSijpiko%2B%2B%2BwJuXo2GVV6sz3yGVi7ig0X3037%2B1zE3n91hg@mail.gmail.com> <CAGBxaX=OcaHEZk3S7jQeYW64A_iRNTmJ%2Bab4U7h_hsrG%2BQqQPg@mail.gmail.com> <ZEEnZjzDCtR_ZG4P@graf.pompo.net> <CAGBxaXmU=Ja9EkoMyxQ0cNxYB4BeiktqQ3P64QcWg%2B=xijTiyQ@mail.gmail.com> <CA%2B1FSii6OOwi%2B%2Bau-_9ViU_SMZ%2BGbESG5H0McVTHQUwmMnOJGQ@mail.gmail.com> <CAGBxaXkhC--ZppimDFabEwPhesjAJmrziNZm753eoyjy1sWzqg@mail.gmail.com> <CA%2B1FSijsSSpCFeKeaOt4gR36BAZ4J8j4QSJRJa-VF-a=J9e2uw@mail.gmail.com> <CAGBxaXnEajP_NKdgDtreavm1Gz5jyLE8-jQBxM9ALX%2BQ9Cpidw@mail.gmail.com> <CA%2B1FSiiyg8An7HwZrJOd=cKh1%2BNC-FMzgaQNfiHP9fkwpgbAEg@mail.gmail.com> <CAGBxaXmnsAQwfeSjGT4K3M2oNvSTpXYfrErRt3UbMvxpCD4htw@mail.gmail.com> <CA%2B1FSiiLEjNTXg5Nj-mxrV6n64gcSa0DXcu=U6a39Dz2fyQahA@mail.gmail.com> <CAGBxaXnxvU7oKNVO8uZwLhFNQzzVSxkAuTUqWNjwJz_eyYDncA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] On Sat, Apr 22, 2023 at 11:20 AM Aryeh Friedman <aryeh.friedman@gmail.com> wrote: > On Fri, Apr 21, 2023 at 8:31 AM Mario Marietto <marietto2008@gmail.com> > wrote: > > > > If you don't want to use the GPU,the commands should be more or less the > following : > > > > > > sudo touch /usr/local/etc/rc.d/ubuntu && chmod +x > /usr/local/etc/rc.d/ubuntu > > > > # Make it have this content: > > > > #!/bin/sh > > # > > # PROVIDE: ubuntu > > # REQUIRE: archdep mountlate > > # KEYWORD: nojail > > # > > # This is a modified version of /etc/rc.d/linux > > # Based on the script by mrclksr: > > # > https://github.com/mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu.in > > # > > . /etc/rc.subr > > > > name="ubuntu" > > desc="Enable Ubuntu chroot, and Linux ABI" > > rcvar="ubuntu_enable" > > start_cmd="${name}_start" > > stop_cmd=":" > > > > unmounted() > > { > > [ `stat -f "%d" "$1"` == `stat -f "%d" "$1/.."` -a \ > > `stat -f "%i" "$1"` != `stat -f "%i" "$1/.."` ] > > } > > > > ubuntu_start() > > { > > local _emul_path _tmpdir > > > > load_kld -e 'linux(aout|elf)' linux > > case `sysctl -n hw.machine_arch` in > > amd64) > > load_kld -e 'linux64elf' linux64 > > ;; > > esac > > if [ -x /compat/ubuntu/sbin/ldconfigDisabled ]; then > > _tmpdir=`mktemp -d -t linux-ldconfig` > > /compat/ubuntu/sbin/ldconfig -C ${_tmpdir}/ld.so.cache > > if ! cmp -s ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.cache; then > > cat ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.cache > > fi > > rm -rf ${_tmpdir} > > fi > > > > # Linux uses the pre-pts(4) tty naming scheme. > > load_kld pty > > > > # Handle unbranded ELF executables by defaulting to ELFOSABI_LINUX. > > if [ `sysctl -ni kern.elf64.fallback_brand` -eq "-1" ]; then > > sysctl kern.elf64.fallback_brand=3 > /dev/null > > fi > > > > if [ `sysctl -ni kern.elf32.fallback_brand` -eq "-1" ]; then > > sysctl kern.elf32.fallback_brand=3 > /dev/null > > fi > > sysctl compat.linux.emul_path=/compat/ubuntu > > > > _emul_path="/compat/ubuntu" > > unmounted "${_emul_path}/dev" && (mount -o nocover -t devfs devfs > "${_emul_path}/dev" || exit 1) > > unmounted "${_emul_path}/dev/fd" && (mount -o nocover,linrdlnk -t > fdescfs fdescfs "${_emul_path}/dev/fd" || exit 1) > > unmounted "${_emul_path}/dev/shm" && (mount -o nocover,mode=1777 -t > tmpfs tmpfs "${_emul_path}/dev/shm" || exit 1) > > unmounted "${_emul_path}/home" && (mount -t nullfs /home > "${_emul_path}/home" || exit 1) > > unmounted "${_emul_path}/proc" && (mount -o nocover -t linprocfs > linprocfs "${_emul_path}/proc" || exit 1) > > unmounted "${_emul_path}/sys" && (mount -o nocover -t linsysfs > linsysfs "${_emul_path}/sys" || exit 1) > > unmounted "${_emul_path}/tmp" && (mount -t nullfs /tmp > "${_emul_path}/tmp" || exit 1) > > unmounted /dev/fd && (mount -o nocover -t fdescfs fdescfs /dev/fd || > exit 1) > > unmounted /proc && (mount -o nocover -t procfs procfs /proc || exit > 1) > > true > > } > > > > load_rc_config $name > > run_rc_command "$1" > > > > sysrc ubuntu_enable=YES > > > > # Create necessary mount points for a working Linuxulator: > > mkdir -p > {/compat/ubuntu/dev/fd,/compat/ubuntu/dev/shm,/compat/ubuntu/home,/compat/ubuntu/tmp,/compat/ubuntu/proc,/compat/ubuntu/sys} > > > > # Start Ubuntu service: > > service ubuntu start > > > > # Install needed packages: > > pkg install debootstrap pulseaudio > > > > # Install Ubuntu 20.04 into /compat/ubuntu: > > debootstrap --arch=amd64 --no-check-gpg focal /compat/ubuntu > > > > # Restart Ubuntu service to make sure everything is properly mounted: > > service ubuntu restart > > > > # Fix broken symlink: > > cd /compat/ubuntu/lib64/ && rm ./ld-linux-x86-64.so.2 ; ln -s > ../lib/x86_64-linux-gnu/ld-2.31.so ld-linux-x86-64.so.2 > > > > # Chroot into your Linux environment: > > chroot /compat/ubuntu /bin/bash > > > > # Set correct timezone inside your chroot: > > printf "%b\n" "0.0 0 0.0\n0\nUTC" > /etc/adjtime > > sudo dpkg-reconfigure tzdata # For some reason sudo is necessary here, > otherwise it fails. > > > > # Fix APT package manager: > > printf "APT::Cache-Start 251658240;" > /etc/apt/apt.conf.d/00aptitude > > > > # Enable more repositories: > > printf "deb http://archive.ubuntu.com/ubuntu/ focal main restricted > universe multiverse" > /etc/apt/sources.list > > > > # Install required programs: > > > > apt update ; apt install -y apt-transport-https curl fonts-symbola gnupg > pulseaudio build-essential gcc gfortran > > > > # Exit out of chroot > > exit > > > > # Fix x86_64-linux-gnu libraries path between ubuntu and freebsd > > cp -r /compat/ubuntu/usr/lib/x86_64-linux-gnu /lib > > > > > > --> Installing PyTorch and your chatgpt github fork on FreeBSD > > > > > > # fetch > https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b0000c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_override.c > > > > # /compat/ubuntu/bin/gcc --sysroot=/compat/ubuntu -m64 -std=c99 -Wall > -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c > > > > # pkg install linux-miniconda-installer > > # miniconda-installer > > # bash > > # source /home/marietto/miniconda3/etc/profile.d/conda.sh > > # conda activate > > > > (base) # conda activate pytorch > > > > (pytorch) # conda activate > > > > (base) # conda activate > > > > (base) # git clone your chatgpt github fork > > > I have done that I think and get: > > (base) [babyspock@babyspock ~]$ python > src/generate_unconditional_samples.py --model_name 117M --nsamples 5 > --length 512 > python: can't open file > '/usr/opt/babySpock/src/generate_unconditional_samples.py': [Errno 2] > No such file or directory > (base) [babyspock@babyspock ~]$ cd gpt-2/ > (base) [babyspock@babyspock ~/gpt-2]$ python > src/generate_unconditional_samples.py --model_name 117M --nsamples 5 > --length 512 > 2023-04-22 00:17:18.661083: I tensorflow/tsl/cuda/cudart_stub.cc:28] > Could not find cuda drivers on your machine, GPU will not be used. > 2023-04-22 00:17:18.710468: I tensorflow/tsl/cuda/cudart_stub.cc:28] > Could not find cuda drivers on your machine, GPU will not be used. > 2023-04-22 00:17:18.710951: I > tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow > binary is optimized to use available CPU instructions in > performance-critical operations. > To enable the following instructions: AVX2 FMA, in other operations, > rebuild TensorFlow with the appropriate compiler flags. > 2023-04-22 00:17:19.429409: W > tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: > Could not find TensorRT > Traceback (most recent call last): > File "/usr/opt/babySpock/gpt-2/src/generate_unconditional_samples.py", > line 9, in <module> > import model, sample, encoder > File "/usr/opt/babySpock/gpt-2/src/model.py", line 3, in <module> > from tensorflow.contrib.training import HParams > ModuleNotFoundError: No module named 'tensorflow.contrib' > Use Python3.7 or earlier. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html] [-- Attachment #2 --] <div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Apr 22, 2023 at 11:20 AM Aryeh Friedman <<a href="mailto:aryeh.friedman@gmail.com">aryeh.friedman@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On Fri, Apr 21, 2023 at 8:31 AM Mario Marietto <<a href="mailto:marietto2008@gmail.com" target="_blank">marietto2008@gmail.com</a>> wrote:<br> ><br> > If you don't want to use the GPU,the commands should be more or less the following :<br> ><br> ><br> > sudo touch /usr/local/etc/rc.d/ubuntu && chmod +x /usr/local/etc/rc.d/ubuntu<br> ><br> > # Make it have this content:<br> ><br> > #!/bin/sh<br> > #<br> > # PROVIDE: ubuntu<br> > # REQUIRE: archdep mountlate<br> > # KEYWORD: nojail<br> > #<br> > # This is a modified version of /etc/rc.d/linux<br> > # Based on the script by mrclksr:<br> > # <a href="https://github.com/mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu.in" rel="noreferrer" target="_blank">https://github.com/mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu.in</a><br>; > #<br> > . /etc/rc.subr<br> ><br> > name="ubuntu"<br> > desc="Enable Ubuntu chroot, and Linux ABI"<br> > rcvar="ubuntu_enable"<br> > start_cmd="${name}_start"<br> > stop_cmd=":"<br> ><br> > unmounted()<br> > {<br> > [ `stat -f "%d" "$1"` == `stat -f "%d" "$1/.."` -a \<br> > `stat -f "%i" "$1"` != `stat -f "%i" "$1/.."` ]<br> > }<br> ><br> > ubuntu_start()<br> > {<br> > local _emul_path _tmpdir<br> ><br> > load_kld -e 'linux(aout|elf)' linux<br> > case `sysctl -n hw.machine_arch` in<br> > amd64)<br> > load_kld -e 'linux64elf' linux64<br> > ;;<br> > esac<br> > if [ -x /compat/ubuntu/sbin/ldconfigDisabled ]; then<br> > _tmpdir=`mktemp -d -t linux-ldconfig`<br> > /compat/ubuntu/sbin/ldconfig -C ${_tmpdir}/ld.so.cache<br> > if ! cmp -s ${_tmpdir}/ld.so.cache /compat/ubuntu/etc/ld.so.cache; then<br> > cat ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.cache<br> > fi<br> > rm -rf ${_tmpdir}<br> > fi<br> ><br> > # Linux uses the pre-pts(4) tty naming scheme.<br> > load_kld pty<br> ><br> > # Handle unbranded ELF executables by defaulting to ELFOSABI_LINUX.<br> > if [ `sysctl -ni kern.elf64.fallback_brand` -eq "-1" ]; then<br> > sysctl kern.elf64.fallback_brand=3 > /dev/null<br> > fi<br> ><br> > if [ `sysctl -ni kern.elf32.fallback_brand` -eq "-1" ]; then<br> > sysctl kern.elf32.fallback_brand=3 > /dev/null<br> > fi<br> > sysctl compat.linux.emul_path=/compat/ubuntu<br> ><br> > _emul_path="/compat/ubuntu"<br> > unmounted "${_emul_path}/dev" && (mount -o nocover -t devfs devfs "${_emul_path}/dev" || exit 1)<br> > unmounted "${_emul_path}/dev/fd" && (mount -o nocover,linrdlnk -t fdescfs fdescfs "${_emul_path}/dev/fd" || exit 1)<br> > unmounted "${_emul_path}/dev/shm" && (mount -o nocover,mode=1777 -t tmpfs tmpfs "${_emul_path}/dev/shm" || exit 1)<br> > unmounted "${_emul_path}/home" && (mount -t nullfs /home "${_emul_path}/home" || exit 1)<br> > unmounted "${_emul_path}/proc" && (mount -o nocover -t linprocfs linprocfs "${_emul_path}/proc" || exit 1)<br> > unmounted "${_emul_path}/sys" && (mount -o nocover -t linsysfs linsysfs "${_emul_path}/sys" || exit 1)<br> > unmounted "${_emul_path}/tmp" && (mount -t nullfs /tmp "${_emul_path}/tmp" || exit 1)<br> > unmounted /dev/fd && (mount -o nocover -t fdescfs fdescfs /dev/fd || exit 1)<br> > unmounted /proc && (mount -o nocover -t procfs procfs /proc || exit 1)<br> > true<br> > }<br> ><br> > load_rc_config $name<br> > run_rc_command "$1"<br> ><br> > sysrc ubuntu_enable=YES<br> ><br> > # Create necessary mount points for a working Linuxulator:<br> > mkdir -p {/compat/ubuntu/dev/fd,/compat/ubuntu/dev/shm,/compat/ubuntu/home,/compat/ubuntu/tmp,/compat/ubuntu/proc,/compat/ubuntu/sys}<br> ><br> > # Start Ubuntu service:<br> > service ubuntu start<br> ><br> > # Install needed packages:<br> > pkg install debootstrap pulseaudio<br> ><br> > # Install Ubuntu 20.04 into /compat/ubuntu:<br> > debootstrap --arch=amd64 --no-check-gpg focal /compat/ubuntu<br> ><br> > # Restart Ubuntu service to make sure everything is properly mounted:<br> > service ubuntu restart<br> ><br> > # Fix broken symlink:<br> > cd /compat/ubuntu/lib64/ && rm ./ld-linux-x86-64.so.2 ; ln -s ../lib/x86_64-linux-gnu/<a href="http://ld-2.31.so" rel="noreferrer" target="_blank">ld-2.31.so</a> ld-linux-x86-64.so.2<br> ><br> > # Chroot into your Linux environment:<br> > chroot /compat/ubuntu /bin/bash<br> ><br> > # Set correct timezone inside your chroot:<br> > printf "%b\n" "0.0 0 0.0\n0\nUTC" > /etc/adjtime<br> > sudo dpkg-reconfigure tzdata # For some reason sudo is necessary here, otherwise it fails.<br> ><br> > # Fix APT package manager:<br> > printf "APT::Cache-Start 251658240;" > /etc/apt/apt.conf.d/00aptitude<br> ><br> > # Enable more repositories:<br> > printf "deb <a href="http://archive.ubuntu.com/ubuntu/" rel="noreferrer" target="_blank">http://archive.ubuntu.com/ubuntu/</a>; focal main restricted universe multiverse" > /etc/apt/sources.list<br> ><br> > # Install required programs:<br> ><br> > apt update ; apt install -y apt-transport-https curl fonts-symbola gnupg pulseaudio build-essential gcc gfortran<br> ><br> > # Exit out of chroot<br> > exit<br> ><br> > # Fix x86_64-linux-gnu libraries path between ubuntu and freebsd<br> > cp -r /compat/ubuntu/usr/lib/x86_64-linux-gnu /lib<br> ><br> ><br> > --> Installing PyTorch and your chatgpt github fork on FreeBSD<br> ><br> ><br> > # fetch <a href="https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b0000c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_override.c" rel="noreferrer" target="_blank">https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b0000c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_override.c</a><br>; ><br> > # /compat/ubuntu/bin/gcc --sysroot=/compat/ubuntu -m64 -std=c99 -Wall -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c<br> ><br> > # pkg install linux-miniconda-installer<br> > # miniconda-installer<br> > # bash<br> > # source /home/marietto/miniconda3/etc/profile.d/conda.sh<br> > # conda activate<br> ><br> > (base) # conda activate pytorch<br> ><br> > (pytorch) # conda activate<br> ><br> > (base) # conda activate<br> ><br> > (base) # git clone your chatgpt github fork<br> <br> <br> I have done that I think and get:<br> <br> (base) [babyspock@babyspock ~]$ python<br> src/generate_unconditional_samples.py --model_name 117M --nsamples 5<br> --length 512<br> python: can't open file<br> '/usr/opt/babySpock/src/generate_unconditional_samples.py': [Errno 2]<br> No such file or directory<br> (base) [babyspock@babyspock ~]$ cd gpt-2/<br> (base) [babyspock@babyspock ~/gpt-2]$ python<br> src/generate_unconditional_samples.py --model_name 117M --nsamples 5<br> --length 512<br> 2023-04-22 00:17:18.661083: I tensorflow/tsl/cuda/cudart_stub.cc:28]<br> Could not find cuda drivers on your machine, GPU will not be used.<br> 2023-04-22 00:17:18.710468: I tensorflow/tsl/cuda/cudart_stub.cc:28]<br> Could not find cuda drivers on your machine, GPU will not be used.<br> 2023-04-22 00:17:18.710951: I<br> tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow<br> binary is optimized to use available CPU instructions in<br> performance-critical operations.<br> To enable the following instructions: AVX2 FMA, in other operations,<br> rebuild TensorFlow with the appropriate compiler flags.<br> 2023-04-22 00:17:19.429409: W<br> tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning:<br> Could not find TensorRT<br> Traceback (most recent call last):<br> File "/usr/opt/babySpock/gpt-2/src/generate_unconditional_samples.py",<br> line 9, in <module><br> import model, sample, encoder<br> File "/usr/opt/babySpock/gpt-2/src/model.py", line 3, in <module><br> from tensorflow.contrib.training import HParams<br> ModuleNotFoundError: No module named 'tensorflow.contrib'<br></blockquote><div></div></div><div><br></div>Use Python3.7 or earlier.<br clear="all"><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div dir="ltr"><div>Best regards,<br>Odhiambo WASHINGTON,<br>Nairobi,KE<br>+254 7 3200 0004/+254 7 2274 3223<br>"<span style="font-size:12.8px">Oh, the cruft.</span><span style="font-size:12.8px">", </span><span style="font-size:12.8px">egrep -v '^$|^.*#' </span><span style="background-color:rgb(34,34,34);color:rgb(238,238,238);font-family:"Lucida Console",Consolas,"Courier New",monospace;font-size:13.6px">¯\_(ツ)_/¯</span><span style="font-size:12.8px"> :-)</span></div><div><span style="font-size:12.8px">[How to ask smart questions: </span><span style="font-size:12.8px"><a href="http://www.catb.org/~esr/faqs/smart-questions.html" target="_blank">http://www.catb.org/~esr/faqs/smart-questions.html</a>]</span></div></div></div></div></div>;
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAAdA2WP5_OT3Jge37EzS_p65gM59gpQ7%2By3jhQ3RHfAr-v5SLA>