Date: Tue, 27 Aug 2024 17:44:29 GMT From: Yuri Victorovich <yuri@FreeBSD.org> To: ports-committers@FreeBSD.org, dev-commits-ports-all@FreeBSD.org, dev-commits-ports-main@FreeBSD.org Subject: git: ba338beba4a6 - main - misc/ollama: Add environment variables to 'ollama start' to work around memory allocation issues Message-ID: <202408271744.47RHiTO3058203@gitrepo.freebsd.org>
next in thread | raw e-mail | index | archive | help
The branch main has been updated by yuri: URL: https://cgit.FreeBSD.org/ports/commit/?id=ba338beba4a6165268a78ea58fde862c2fc03465 commit ba338beba4a6165268a78ea58fde862c2fc03465 Author: Yuri Victorovich <yuri@FreeBSD.org> AuthorDate: 2024-08-27 17:43:01 +0000 Commit: Yuri Victorovich <yuri@FreeBSD.org> CommitDate: 2024-08-27 17:44:27 +0000 misc/ollama: Add environment variables to 'ollama start' to work around memory allocation issues --- misc/ollama/pkg-message | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/misc/ollama/pkg-message b/misc/ollama/pkg-message index 936a3494000a..a3b6614a58b1 100644 --- a/misc/ollama/pkg-message +++ b/misc/ollama/pkg-message @@ -5,7 +5,7 @@ You installed ollama: the AI model runner. To run ollama, plese open 2 terminals. 1. In the first terminal, please run: - $ ollama start + $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start 2. In the second terminal, please run: $ ollama run mistral
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?202408271744.47RHiTO3058203>