From nobody Fri Apr 21 11:34:17 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q2sr70P6dz46JVD; Fri, 21 Apr 2023 11:34:31 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-ed1-x52f.google.com (mail-ed1-x52f.google.com [IPv6:2a00:1450:4864:20::52f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q2sr65Xvyz3tGQ; Fri, 21 Apr 2023 11:34:30 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52f.google.com with SMTP id 4fb4d7f45d1cf-506bdf29712so11369604a12.0; Fri, 21 Apr 2023 04:34:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682076869; x=1684668869; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=7FfYJvMQgH5idukvFw+WBu5k6Q0+VCI5huVUXkgRv7w=; b=IkX0OV6+3QbpDnLeQGMC3iEFPm/wIO0fr2Fj6Q9NLrAsWMUvrnyG1K6SDDTyprscdF 1kKEzU98cq90+1RJc0YCrOq+UebxxdRpaYSVvo581D7kt7c2iFdx5ABSMJnd1imQnGIF pZdAA2DmQk7JewnWvOw8/lMGrfl3CdQxErEuw4u5KbsGr+nDHKqgJ/IC0hUV2ewBK+F8 kaY+HcTUlPnShijZDGQDn6TqFmQvLcHo0M4CTgyDjDa3DWccDH7UmHaVQE4SiVS0F4pg EiNxvOsbG7vbzVGgMskmoSbFjHwaY5iICBBBAGldyx3xTUHgPjyLjktBUCj0797zvE2k DLdw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682076869; x=1684668869; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=7FfYJvMQgH5idukvFw+WBu5k6Q0+VCI5huVUXkgRv7w=; b=iy/+dJ6ig4VOtIpFYaEgrqNb7LSsZcuTxd4QG0qgTe18Sum27NTT7WyTJ/HBGfhKg2 AGhdcSxtjGunIeyqMxN2L5heZLALeL7OM/MwuxGpC2tUKT8HhBgwfn7ADPsgt7eo+wa3 fw5JXEwXtDkG/v7JY6gYeELKpPX0Nxo4wz7E5/rzQ8Fp+4tbH45JALKs4rhQwauM89Nw zlB9t2w6EvRdGiXSD0EUeUvAqxMhaLDO5kDJ7o7OuDCEQTqfXkZKP9itvqz6GkOK+ARv lZsFQ/PJ+qfMXC6Sej4otXQ+2/cUBE8ObcxgzsyShfvBXOWNcJhsCkab4nuNlGIU46CI vPMQ== X-Gm-Message-State: AAQBX9clWvQGGjnjHKMXwX0JK9Du/7x7f7M/xNX5NQJlW+eY7ZGCH1qA XiGjYoKnI/Mapg9nGAubTmoUUkYfhqtZVgnSGSI= X-Google-Smtp-Source: AKy350Y/ujmwBQCo+6trdSBauMQfc34F4EuSTnxgl/GnY2QZZ8XZFsqD0ya7QRrAayLPObWMngAmydGPD32P8ptl/dQ= X-Received: by 2002:a17:906:8691:b0:953:7e68:7e01 with SMTP id g17-20020a170906869100b009537e687e01mr1759219ejx.36.1682076869195; Fri, 21 Apr 2023 04:34:29 -0700 (PDT) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Aryeh Friedman Date: Fri, 21 Apr 2023 07:34:17 -0400 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: Mario Marietto Cc: FreeBSD Mailing List , FreeBSD Mailing List , Yuri Victorovich Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Q2sr65Xvyz3tGQ X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Fri, Apr 21, 2023 at 6:40=E2=80=AFAM Mario Marietto wrote: > > You don't need bhyve to make that,but only the Linuxulator. I don't think= the type of cpu will make any difference. I've used the Intel I9 cpu. I tr= ied FreeBSD 13.1 and I haven't found problems. For sure using python env is= tricky,but if you have the thinkering attitude,you will have some fun. I already have a VM allocated on it (the same host has 3 other VM's on it). I guess that is one thing I missed was the linuxulator (the linsuckslator is more like it) and as far tinkering goes it is fine to a point but not when it has taken *DAYS* away from paying projects (I am a freelancer). BTW I will be trying your specific command lines tomorrow (I must get back to paid work). P.S. The point of this project is to start a new project called babySpock that is a personal assistant for me and my programming partner/wife in all but legal detail. babySpock will hopefully be able to help with pair programming/design brainstorming, general clerical office tasks, be a halfway decent conversation partner (roughly on or near the level of chatGPT which inspired this project in the first place in order to increase the amount of "context" that it could store and to slice and dice context as needed to feed the more expensive models just relevant context as well use multiple models.... basically a DIY hobbyist AM (artificial mind with the final goal being artificial mature minds [AMM] instead of AGI due to the rule making paradox) lab that has to "earn its own way in life" (i.e. if it is not useful it will likely die from misuse). > > On Fri, Apr 21, 2023 at 12:26=E2=80=AFPM Aryeh Friedman wrote: >> >> The more I am fighting with it in linux (only thing there is docs for) >> the more obvious it just doesn't work on >> >> On Fri, Apr 21, 2023 at 6:19=E2=80=AFAM Mario Marietto wrote: >> > >> > Can't you install pytorch using the linux miniconda installer like bel= ow ? >> > >> > # fetch https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b000= 0c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_overrid= e.c >> > >> > # /compat/ubuntu/bin/gcc --sysroot=3D/compat/ubuntu -m64 -std=3Dc99 -W= all -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c >> > >> > # pkg install linux-miniconda-installer >> > # miniconda-installer >> > # bash >> > # source /home/marietto/miniconda3/etc/profile.d/conda.sh >> > # conda activate >> > >> > (base) # conda activate pytorch >> > >> Will this work a bhyve on an AMD Ryzen 5 host? After playing with it >> in several linux instances I always get stuck when it can't find a >> compatible version >> >> -- >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > > > -- > Mario. --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org