Date: Sat, 22 Apr 2023 11:18:40 +0200 From: Mario Marietto <marietto2008@gmail.com> To: Odhiambo Washington <odhiambo@gmail.com> Cc: Aryeh Friedman <aryeh.friedman@gmail.com>, FreeBSD Mailing List <freebsd-hackers@freebsd.org>, FreeBSD Mailing List <freebsd-questions@freebsd.org>, Yuri Victorovich <yuri@freebsd.org> Subject: Re: Installing openAI's GPT-2 Ada AI Language Model Message-ID: <CA%2B1FSihfyo=mJ0JzKNCRbFO4%2B8VLJKVntLB99T7XbLMzkeugQw@mail.gmail.com> In-Reply-To: <CAAdA2WP5_OT3Jge37EzS_p65gM59gpQ7%2By3jhQ3RHfAr-v5SLA@mail.gmail.com> References: <CAGBxaXmhRLk9Lx_ZHeRdoN-K2fRLEhY3cBVtBymmAjd4bBh1OQ@mail.gmail.com> <CA%2B1FSihQ-f4uhiOjYH8Wo=AxFEkAKe3NRDJdopgT50J=_jY4fA@mail.gmail.com> <CAGBxaXnYojzQJqO62hkzUJvD2rzaNp%2Bem38FgCqVSBu%2BmkBi9A@mail.gmail.com> <CA%2B1FSijpiko%2B%2B%2BwJuXo2GVV6sz3yGVi7ig0X3037%2B1zE3n91hg@mail.gmail.com> <CAGBxaX=OcaHEZk3S7jQeYW64A_iRNTmJ%2Bab4U7h_hsrG%2BQqQPg@mail.gmail.com> <ZEEnZjzDCtR_ZG4P@graf.pompo.net> <CAGBxaXmU=Ja9EkoMyxQ0cNxYB4BeiktqQ3P64QcWg%2B=xijTiyQ@mail.gmail.com> <CA%2B1FSii6OOwi%2B%2Bau-_9ViU_SMZ%2BGbESG5H0McVTHQUwmMnOJGQ@mail.gmail.com> <CAGBxaXkhC--ZppimDFabEwPhesjAJmrziNZm753eoyjy1sWzqg@mail.gmail.com> <CA%2B1FSijsSSpCFeKeaOt4gR36BAZ4J8j4QSJRJa-VF-a=J9e2uw@mail.gmail.com> <CAGBxaXnEajP_NKdgDtreavm1Gz5jyLE8-jQBxM9ALX%2BQ9Cpidw@mail.gmail.com> <CA%2B1FSiiyg8An7HwZrJOd=cKh1%2BNC-FMzgaQNfiHP9fkwpgbAEg@mail.gmail.com> <CAGBxaXmnsAQwfeSjGT4K3M2oNvSTpXYfrErRt3UbMvxpCD4htw@mail.gmail.com> <CA%2B1FSiiLEjNTXg5Nj-mxrV6n64gcSa0DXcu=U6a39Dz2fyQahA@mail.gmail.com> <CAGBxaXnxvU7oKNVO8uZwLhFNQzzVSxkAuTUqWNjwJz_eyYDncA@mail.gmail.com> <CAAdA2WP5_OT3Jge37EzS_p65gM59gpQ7%2By3jhQ3RHfAr-v5SLA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--00000000000097e7d305f9e94448 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable marietto@marietto-nano:~$ python3 Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import tensorflow as tf >>> tf.__version__ '2.12.0' >>> print(tf.reduce_sum(tf.random.normal([1000, 1000]))) tf.Tensor(51.500687, shape=3D(), dtype=3Dfloat32) https://qengineering.eu/install-tensorflow-2.4.0-on-jetson-nano.html On Sat, Apr 22, 2023 at 10:47=E2=80=AFAM Odhiambo Washington <odhiambo@gmai= l.com> wrote: > > > On Sat, Apr 22, 2023 at 11:20=E2=80=AFAM Aryeh Friedman <aryeh.friedman@g= mail.com> > wrote: > >> On Fri, Apr 21, 2023 at 8:31=E2=80=AFAM Mario Marietto <marietto2008@gma= il.com> >> wrote: >> > >> > If you don't want to use the GPU,the commands should be more or less >> the following : >> > >> > >> > sudo touch /usr/local/etc/rc.d/ubuntu && chmod +x >> /usr/local/etc/rc.d/ubuntu >> > >> > # Make it have this content: >> > >> > #!/bin/sh >> > # >> > # PROVIDE: ubuntu >> > # REQUIRE: archdep mountlate >> > # KEYWORD: nojail >> > # >> > # This is a modified version of /etc/rc.d/linux >> > # Based on the script by mrclksr: >> > # >> https://github.com/mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu= .in >> > # >> > . /etc/rc.subr >> > >> > name=3D"ubuntu" >> > desc=3D"Enable Ubuntu chroot, and Linux ABI" >> > rcvar=3D"ubuntu_enable" >> > start_cmd=3D"${name}_start" >> > stop_cmd=3D":" >> > >> > unmounted() >> > { >> > [ `stat -f "%d" "$1"` =3D=3D `stat -f "%d" "$1/.."` -a \ >> > `stat -f "%i" "$1"` !=3D `stat -f "%i" "$1/.."` ] >> > } >> > >> > ubuntu_start() >> > { >> > local _emul_path _tmpdir >> > >> > load_kld -e 'linux(aout|elf)' linux >> > case `sysctl -n hw.machine_arch` in >> > amd64) >> > load_kld -e 'linux64elf' linux64 >> > ;; >> > esac >> > if [ -x /compat/ubuntu/sbin/ldconfigDisabled ]; then >> > _tmpdir=3D`mktemp -d -t linux-ldconfig` >> > /compat/ubuntu/sbin/ldconfig -C ${_tmpdir}/ld.so.cache >> > if ! cmp -s ${_tmpdir}/ld.so.cache >> /compat/ubuntu/etc/ld.so.cache; then >> > cat ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.cach= e >> > fi >> > rm -rf ${_tmpdir} >> > fi >> > >> > # Linux uses the pre-pts(4) tty naming scheme. >> > load_kld pty >> > >> > # Handle unbranded ELF executables by defaulting to ELFOSABI_LINUX= . >> > if [ `sysctl -ni kern.elf64.fallback_brand` -eq "-1" ]; then >> > sysctl kern.elf64.fallback_brand=3D3 > /dev/null >> > fi >> > >> > if [ `sysctl -ni kern.elf32.fallback_brand` -eq "-1" ]; then >> > sysctl kern.elf32.fallback_brand=3D3 > /dev/null >> > fi >> > sysctl compat.linux.emul_path=3D/compat/ubuntu >> > >> > _emul_path=3D"/compat/ubuntu" >> > unmounted "${_emul_path}/dev" && (mount -o nocover -t devfs devfs >> "${_emul_path}/dev" || exit 1) >> > unmounted "${_emul_path}/dev/fd" && (mount -o nocover,linrdlnk -t >> fdescfs fdescfs "${_emul_path}/dev/fd" || exit 1) >> > unmounted "${_emul_path}/dev/shm" && (mount -o nocover,mode=3D1777= -t >> tmpfs tmpfs "${_emul_path}/dev/shm" || exit 1) >> > unmounted "${_emul_path}/home" && (mount -t nullfs /home >> "${_emul_path}/home" || exit 1) >> > unmounted "${_emul_path}/proc" && (mount -o nocover -t linprocfs >> linprocfs "${_emul_path}/proc" || exit 1) >> > unmounted "${_emul_path}/sys" && (mount -o nocover -t linsysfs >> linsysfs "${_emul_path}/sys" || exit 1) >> > unmounted "${_emul_path}/tmp" && (mount -t nullfs /tmp >> "${_emul_path}/tmp" || exit 1) >> > unmounted /dev/fd && (mount -o nocover -t fdescfs fdescfs /dev/fd >> || exit 1) >> > unmounted /proc && (mount -o nocover -t procfs procfs /proc || exi= t >> 1) >> > true >> > } >> > >> > load_rc_config $name >> > run_rc_command "$1" >> > >> > sysrc ubuntu_enable=3DYES >> > >> > # Create necessary mount points for a working Linuxulator: >> > mkdir -p >> {/compat/ubuntu/dev/fd,/compat/ubuntu/dev/shm,/compat/ubuntu/home,/compa= t/ubuntu/tmp,/compat/ubuntu/proc,/compat/ubuntu/sys} >> > >> > # Start Ubuntu service: >> > service ubuntu start >> > >> > # Install needed packages: >> > pkg install debootstrap pulseaudio >> > >> > # Install Ubuntu 20.04 into /compat/ubuntu: >> > debootstrap --arch=3Damd64 --no-check-gpg focal /compat/ubuntu >> > >> > # Restart Ubuntu service to make sure everything is properly mounted: >> > service ubuntu restart >> > >> > # Fix broken symlink: >> > cd /compat/ubuntu/lib64/ && rm ./ld-linux-x86-64.so.2 ; ln -s >> ../lib/x86_64-linux-gnu/ld-2.31.so ld-linux-x86-64.so.2 >> > >> > # Chroot into your Linux environment: >> > chroot /compat/ubuntu /bin/bash >> > >> > # Set correct timezone inside your chroot: >> > printf "%b\n" "0.0 0 0.0\n0\nUTC" > /etc/adjtime >> > sudo dpkg-reconfigure tzdata # For some reason sudo is necessary here, >> otherwise it fails. >> > >> > # Fix APT package manager: >> > printf "APT::Cache-Start 251658240;" > /etc/apt/apt.conf.d/00aptitude >> > >> > # Enable more repositories: >> > printf "deb http://archive.ubuntu.com/ubuntu/ focal main restricted >> universe multiverse" > /etc/apt/sources.list >> > >> > # Install required programs: >> > >> > apt update ; apt install -y apt-transport-https curl fonts-symbola >> gnupg pulseaudio build-essential gcc gfortran >> > >> > # Exit out of chroot >> > exit >> > >> > # Fix x86_64-linux-gnu libraries path between ubuntu and freebsd >> > cp -r /compat/ubuntu/usr/lib/x86_64-linux-gnu /lib >> > >> > >> > --> Installing PyTorch and your chatgpt github fork on FreeBSD >> > >> > >> > # fetch >> https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b0000c60f4ad79= 7e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_override.c >> > >> > # /compat/ubuntu/bin/gcc --sysroot=3D/compat/ubuntu -m64 -std=3Dc99 -W= all >> -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c >> > >> > # pkg install linux-miniconda-installer >> > # miniconda-installer >> > # bash >> > # source /home/marietto/miniconda3/etc/profile.d/conda.sh >> > # conda activate >> > >> > (base) # conda activate pytorch >> > >> > (pytorch) # conda activate >> > >> > (base) # conda activate >> > >> > (base) # git clone your chatgpt github fork >> >> >> I have done that I think and get: >> >> (base) [babyspock@babyspock ~]$ python >> src/generate_unconditional_samples.py --model_name 117M --nsamples 5 >> --length 512 >> python: can't open file >> '/usr/opt/babySpock/src/generate_unconditional_samples.py': [Errno 2] >> No such file or directory >> (base) [babyspock@babyspock ~]$ cd gpt-2/ >> (base) [babyspock@babyspock ~/gpt-2]$ python >> src/generate_unconditional_samples.py --model_name 117M --nsamples 5 >> --length 512 >> 2023-04-22 00:17:18.661083: I tensorflow/tsl/cuda/cudart_stub.cc:28] >> Could not find cuda drivers on your machine, GPU will not be used. >> 2023-04-22 00:17:18.710468: I tensorflow/tsl/cuda/cudart_stub.cc:28] >> Could not find cuda drivers on your machine, GPU will not be used. >> 2023-04-22 00:17:18.710951: I >> tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow >> binary is optimized to use available CPU instructions in >> performance-critical operations. >> To enable the following instructions: AVX2 FMA, in other operations, >> rebuild TensorFlow with the appropriate compiler flags. >> 2023-04-22 00:17:19.429409: W >> tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: >> Could not find TensorRT >> Traceback (most recent call last): >> File "/usr/opt/babySpock/gpt-2/src/generate_unconditional_samples.py", >> line 9, in <module> >> import model, sample, encoder >> File "/usr/opt/babySpock/gpt-2/src/model.py", line 3, in <module> >> from tensorflow.contrib.training import HParams >> ModuleNotFoundError: No module named 'tensorflow.contrib' >> > > Use Python3.7 or earlier. > > -- > Best regards, > Odhiambo WASHINGTON, > Nairobi,KE > +254 7 3200 0004/+254 7 2274 3223 > "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-) > [How to ask smart questions: > http://www.catb.org/~esr/faqs/smart-questions.html] > --=20 Mario. --00000000000097e7d305f9e94448 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><span style=3D"font-family:monospace"><span style=3D"font-= weight:bold;color:rgb(84,255,84);background-color:rgb(255,255,255)">mariett= o@marietto-nano</span><span style=3D"color:rgb(0,0,0);background-color:rgb(= 255,255,255)">:</span><span style=3D"font-weight:bold;color:rgb(84,84,255);= background-color:rgb(255,255,255)">~</span><span style=3D"color:rgb(0,0,0);= background-color:rgb(255,255,255)">$ python3 </span><br>Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] on linu= x <br>Type "help", "copyright", "credits" or &q= uot;license" for more information. <br>>>> import tensorflow as tf<br>>>> tf.__version__ <br>'2.12.0' <br>>>> print(tf.reduce_sum(tf.random.normal([1000, 1000]))) =C2= =A0<br>tf.Tensor(51.500687, shape=3D(), dtype=3Dfloat32)<br> <br></span><a href=3D"https://qengineering.eu/install-tensorflow-2.4.0-on-j= etson-nano.html">https://qengineering.eu/install-tensorflow-2.4.0-on-jetson= -nano.html</a></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class= =3D"gmail_attr">On Sat, Apr 22, 2023 at 10:47=E2=80=AFAM Odhiambo Washingto= n <<a href=3D"mailto:odhiambo@gmail.com">odhiambo@gmail.com</a>> wrot= e:<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0= .8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"l= tr"><div dir=3D"ltr"><br></div><br><div class=3D"gmail_quote"><div dir=3D"l= tr" class=3D"gmail_attr">On Sat, Apr 22, 2023 at 11:20=E2=80=AFAM Aryeh Fri= edman <<a href=3D"mailto:aryeh.friedman@gmail.com" target=3D"_blank">ary= eh.friedman@gmail.com</a>> wrote:<br></div><blockquote class=3D"gmail_qu= ote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,20= 4);padding-left:1ex">On Fri, Apr 21, 2023 at 8:31=E2=80=AFAM Mario Marietto= <<a href=3D"mailto:marietto2008@gmail.com" target=3D"_blank">marietto20= 08@gmail.com</a>> wrote:<br> ><br> > If you don't want to use the GPU,the commands should be more or le= ss the following :<br> ><br> ><br> > sudo touch /usr/local/etc/rc.d/ubuntu && chmod +x /usr/local/e= tc/rc.d/ubuntu<br> ><br> > # Make it have this content:<br> ><br> > #!/bin/sh<br> > #<br> > # PROVIDE: ubuntu<br> > # REQUIRE: archdep mountlate<br> > # KEYWORD: nojail<br> > #<br> > # This is a modified version of /etc/rc.d/linux<br> > # Based on the script by mrclksr:<br> > # <a href=3D"https://github.com/mrclksr/linux-browser-installer/blob/m= ain/rc.d/ubuntu.in" rel=3D"noreferrer" target=3D"_blank">https://github.com= /mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu.in</a><br> > #<br> > . /etc/rc.subr<br> ><br> > name=3D"ubuntu"<br> > desc=3D"Enable Ubuntu chroot, and Linux ABI"<br> > rcvar=3D"ubuntu_enable"<br> > start_cmd=3D"${name}_start"<br> > stop_cmd=3D":"<br> ><br> > unmounted()<br> > {<br> >=C2=A0 =C2=A0 =C2=A0[ `stat -f "%d" "$1"` =3D=3D `s= tat -f "%d" "$1/.."` -a \<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0`stat -f "%i" "$1"` !=3D= `stat -f "%i" "$1/.."` ]<br> > }<br> ><br> > ubuntu_start()<br> > {<br> >=C2=A0 =C2=A0 =C2=A0local _emul_path _tmpdir<br> ><br> >=C2=A0 =C2=A0 =C2=A0load_kld -e 'linux(aout|elf)' linux<br> >=C2=A0 =C2=A0 =C2=A0case `sysctl -n hw.machine_arch` in<br> >=C2=A0 =C2=A0 =C2=A0amd64)<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0load_kld -e 'linux64elf' linu= x64<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0;;<br> >=C2=A0 =C2=A0 =C2=A0esac<br> >=C2=A0 =C2=A0 =C2=A0if [ -x /compat/ubuntu/sbin/ldconfigDisabled ]; the= n<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0_tmpdir=3D`mktemp -d -t linux-ldconfi= g`<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0/compat/ubuntu/sbin/ldconfig -C ${_tm= pdir}/ld.so.cache<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0if ! cmp -s ${_tmpdir}/ld.so.cache /c= ompat/ubuntu/etc/ld.so.cache; then<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0cat ${_tmpdir}/ld.so.ca= che > /compat/ubuntu/etc/ld.so.cache<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0fi<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0rm -rf ${_tmpdir}<br> >=C2=A0 =C2=A0 =C2=A0fi<br> ><br> >=C2=A0 =C2=A0 =C2=A0# Linux uses the pre-pts(4) tty naming scheme.<br> >=C2=A0 =C2=A0 =C2=A0load_kld pty<br> ><br> >=C2=A0 =C2=A0 =C2=A0# Handle unbranded ELF executables by defaulting to= ELFOSABI_LINUX.<br> >=C2=A0 =C2=A0 =C2=A0if [ `sysctl -ni kern.elf64.fallback_brand` -eq &qu= ot;-1" ]; then<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sysctl kern.elf64.fallback_brand=3D3 = > /dev/null<br> >=C2=A0 =C2=A0 =C2=A0fi<br> ><br> >=C2=A0 =C2=A0 =C2=A0if [ `sysctl -ni kern.elf32.fallback_brand` -eq &qu= ot;-1" ]; then<br> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sysctl kern.elf32.fallback_brand=3D3 = > /dev/null<br> >=C2=A0 =C2=A0 =C2=A0fi<br> >=C2=A0 =C2=A0 =C2=A0sysctl compat.linux.emul_path=3D/compat/ubuntu<br> ><br> >=C2=A0 =C2=A0 =C2=A0_emul_path=3D"/compat/ubuntu"<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/dev" && = (mount -o nocover -t devfs devfs "${_emul_path}/dev" || exit 1)<b= r> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/dev/fd" &&am= p; (mount -o nocover,linrdlnk -t fdescfs fdescfs "${_emul_path}/dev/fd= " || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/dev/shm" &&a= mp; (mount -o nocover,mode=3D1777 -t tmpfs tmpfs "${_emul_path}/dev/sh= m" || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/home" &&= (mount -t nullfs /home "${_emul_path}/home" || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/proc" &&= (mount -o nocover -t linprocfs linprocfs "${_emul_path}/proc" ||= exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/sys" && = (mount -o nocover -t linsysfs linsysfs "${_emul_path}/sys" || exi= t 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted "${_emul_path}/tmp" && = (mount -t nullfs /tmp "${_emul_path}/tmp" || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted /dev/fd && (mount -o nocover -t f= descfs fdescfs /dev/fd || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0unmounted /proc && (mount -o nocover -t pro= cfs procfs /proc || exit 1)<br> >=C2=A0 =C2=A0 =C2=A0true<br> > }<br> ><br> > load_rc_config $name<br> > run_rc_command "$1"<br> ><br> > sysrc ubuntu_enable=3DYES<br> ><br> > # Create necessary mount points for a working Linuxulator:<br> > mkdir -p {/compat/ubuntu/dev/fd,/compat/ubuntu/dev/shm,/compat/ubuntu/= home,/compat/ubuntu/tmp,/compat/ubuntu/proc,/compat/ubuntu/sys}<br> ><br> > # Start Ubuntu service:<br> > service ubuntu start<br> ><br> > # Install needed packages:<br> > pkg install debootstrap pulseaudio<br> ><br> > # Install Ubuntu 20.04 into /compat/ubuntu:<br> > debootstrap --arch=3Damd64 --no-check-gpg focal /compat/ubuntu<br> ><br> > # Restart Ubuntu service to make sure everything is properly mounted:<= br> > service ubuntu restart<br> ><br> > # Fix broken symlink:<br> > cd /compat/ubuntu/lib64/ && rm ./ld-linux-x86-64.so.2 ; ln -s = ../lib/x86_64-linux-gnu/<a href=3D"http://ld-2.31.so" rel=3D"noreferrer" ta= rget=3D"_blank">ld-2.31.so</a> ld-linux-x86-64.so.2<br> ><br> > # Chroot into your Linux environment:<br> > chroot /compat/ubuntu /bin/bash<br> ><br> > # Set correct timezone inside your chroot:<br> > printf "%b\n" "0.0 0 0.0\n0\nUTC" > /etc/adjtim= e<br> > sudo dpkg-reconfigure tzdata # For some reason sudo is necessary here,= otherwise it fails.<br> ><br> > # Fix APT package manager:<br> > printf "APT::Cache-Start 251658240;" > /etc/apt/apt.conf.= d/00aptitude<br> ><br> > # Enable more repositories:<br> > printf "deb <a href=3D"http://archive.ubuntu.com/ubuntu/" rel=3D"= noreferrer" target=3D"_blank">http://archive.ubuntu.com/ubuntu/</a> focal m= ain restricted universe multiverse" > /etc/apt/sources.list<br> ><br> > # Install required programs:<br> ><br> > apt update ; apt install -y apt-transport-https curl fonts-symbola gnu= pg pulseaudio build-essential gcc gfortran<br> ><br> > # Exit out of chroot<br> > exit<br> ><br> > # Fix x86_64-linux-gnu libraries path between ubuntu and freebsd<br> > cp -r /compat/ubuntu/usr/lib/x86_64-linux-gnu /lib<br> ><br> ><br> > --> Installing PyTorch and your chatgpt github fork on FreeBSD<br> ><br> ><br> > # fetch <a href=3D"https://gist.githubusercontent.com/shkhln/40ef29046= 3e78fb2b0000c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_io= ctl_override.c" rel=3D"noreferrer" target=3D"_blank">https://gist.githubuse= rcontent.com/shkhln/40ef290463e78fb2b0000c60f4ad797e/raw/f640983249607e38af= 405c95c457ce4afc85c608/uvm_ioctl_override.c</a><br> ><br> > # /compat/ubuntu/bin/gcc --sysroot=3D/compat/ubuntu -m64 -std=3Dc99 -W= all -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c<br> ><br> > # pkg install linux-miniconda-installer<br> > # miniconda-installer<br> > # bash<br> > # source /home/marietto/miniconda3/etc/profile.d/conda.sh<br> > # conda activate<br> ><br> > (base) # conda activate pytorch<br> ><br> > (pytorch) # conda activate<br> ><br> > (base) # conda activate<br> ><br> > (base) # git clone your chatgpt github fork<br> <br> <br> I have done that I think and get:<br> <br> (base) [babyspock@babyspock ~]$ python<br> src/generate_unconditional_samples.py --model_name 117M --nsamples 5<br> --length 512<br> python: can't open file<br> '/usr/opt/babySpock/src/generate_unconditional_samples.py': [Errno = 2]<br> No such file or directory<br> (base) [babyspock@babyspock ~]$ cd gpt-2/<br> (base) [babyspock@babyspock ~/gpt-2]$ python<br> src/generate_unconditional_samples.py --model_name 117M --nsamples 5<br> --length 512<br> 2023-04-22 00:17:18.661083: I tensorflow/tsl/cuda/cudart_stub.cc:28]<br> Could not find cuda drivers on your machine, GPU will not be used.<br> 2023-04-22 00:17:18.710468: I tensorflow/tsl/cuda/cudart_stub.cc:28]<br> Could not find cuda drivers on your machine, GPU will not be used.<br> 2023-04-22 00:17:18.710951: I<br> tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow<br> binary is optimized to use available CPU instructions in<br> performance-critical operations.<br> To enable the following instructions: AVX2 FMA, in other operations,<br> rebuild TensorFlow with the appropriate compiler flags.<br> 2023-04-22 00:17:19.429409: W<br> tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning:<br> Could not find TensorRT<br> Traceback (most recent call last):<br> =C2=A0 File "/usr/opt/babySpock/gpt-2/src/generate_unconditional_sampl= es.py",<br> line 9, in <module><br> =C2=A0 =C2=A0 import model, sample, encoder<br> =C2=A0 File "/usr/opt/babySpock/gpt-2/src/model.py", line 3, in &= lt;module><br> =C2=A0 =C2=A0 from tensorflow.contrib.training import HParams<br> ModuleNotFoundError: No module named 'tensorflow.contrib'<br></bloc= kquote><div></div></div><div><br></div>Use Python3.7 or earlier.<br clear= =3D"all"><div><br></div><span>-- </span><br><div dir=3D"ltr"><div dir=3D"lt= r"><div dir=3D"ltr"><div>Best regards,<br>Odhiambo WASHINGTON,<br>Nairobi,K= E<br>+254 7 3200 0004/+254 7 2274 3223<br>"<span style=3D"font-size:12= .8px">Oh, the cruft.</span><span style=3D"font-size:12.8px">",=C2=A0</= span><span style=3D"font-size:12.8px">egrep -v '^$|^.*#'=C2=A0</spa= n><span style=3D"background-color:rgb(34,34,34);color:rgb(238,238,238);font= -family:"Lucida Console",Consolas,"Courier New",monospa= ce;font-size:13.6px">=C2=AF\_(=E3=83=84)_/=C2=AF</span><span style=3D"font-= size:12.8px">=C2=A0:-)</span></div><div><span style=3D"font-size:12.8px">[H= ow to ask smart questions:=C2=A0</span><span style=3D"font-size:12.8px"><a = href=3D"http://www.catb.org/~esr/faqs/smart-questions.html" target=3D"_blan= k">http://www.catb.org/~esr/faqs/smart-questions.html</a>]</span></div></di= v></div></div></div> </blockquote></div><br clear=3D"all"><br><span class=3D"gmail_signature_pre= fix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature">Mario.<br></d= iv> --00000000000097e7d305f9e94448--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CA%2B1FSihfyo=mJ0JzKNCRbFO4%2B8VLJKVntLB99T7XbLMzkeugQw>