From owner-freebsd-ports@freebsd.org Fri Jul 27 23:31:07 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B02B9105A506 for ; Fri, 27 Jul 2018 23:31:07 +0000 (UTC) (envelope-from robert.ayrapetyan@gmail.com) Received: from mail-pf1-x443.google.com (mail-pf1-x443.google.com [IPv6:2607:f8b0:4864:20::443]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 332B98EF0A; Fri, 27 Jul 2018 23:31:07 +0000 (UTC) (envelope-from robert.ayrapetyan@gmail.com) Received: by mail-pf1-x443.google.com with SMTP id a26-v6so2223816pfo.4; Fri, 27 Jul 2018 16:31:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=T9YOk6jVn9VlGs7aDg2wLp+rF+dnSFi7hOkW5EbhINI=; b=IyE6fBIbBT4iiJkEDp/sR9wWBSbZZc4xMZcsaKniDjq3ygjDvUITdtek0oXzcFgwB0 O4WeH4cdQ3AisiMra0p977PS77J1C5ULLbP3CFc5Egdn51ktPraaBvjnkzrbQeJl/ra0 pDqOWkE00n89iJ/Mf3MIbmdBuwP9+5ZcANooLfjL5o5Tb6BwdJz3WtzM5udrWM3DhU4p umTy0C6iiVEzUNUL9W7UezgeV3Rj0MNgFK9Il1T2/GpbPiYal7ot3ue9i1ukFaWwmlY1 +ecUwiPsIdbbYOLdXCP/wTFxUJM0HwTTaK9MpbXAMCgeIeCHu4kVb1FfFIYDCJhWbKuJ GNHA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=T9YOk6jVn9VlGs7aDg2wLp+rF+dnSFi7hOkW5EbhINI=; b=BrdNn7WWzQ/XjaZU8CobbIfvRZ8oys+8c2/Ev2m/lzWe6byMkE68WVADmsvt2nXNvR U3Iyb6kc+bxFylkz5jduoG8/Xxw0FfgA2cSGjA5YoqSKvmP5r6wWDPp4phwY8WXhCX7J +tvnf06Me2zbhPApoi5yVQNxVLHhHSr7CX/4tQfSJPi5KjFctBMMKELMN5BBjOeOHTLG AxWDL+ZWaUDnd53vqKwEWcHCfiu8pB6bvRN3m83+AHTWkBPEH0cN5QnFwjI+/scg8PTf G4Xarz5ezo+yDCW7ISos2rZ+eZrlxDPDeKzk10M+kW+aEZwn7U5LksmY6KVFORHF9Ynl pHXg== X-Gm-Message-State: AOUpUlFDp2RSszod6GOdJkypjXs5T7V8PEmSLAB1S2KjHyKzR78/1FUp 85qhrEAGEuhnhKAn70Gue2y4Jio= X-Google-Smtp-Source: AAOMgpf64HYy5A70yu9sl8gA1vzz4fAxma4wgnNu89ENXo5G6gkI27d6nvrqkjYI0gQkUtIVIfNrUA== X-Received: by 2002:a65:5288:: with SMTP id y8-v6mr7728556pgp.284.1532734265778; Fri, 27 Jul 2018 16:31:05 -0700 (PDT) Received: from [192.168.1.113] (c-76-126-66-179.hsd1.ca.comcast.net. [76.126.66.179]) by smtp.gmail.com with ESMTPSA id m81-v6sm3858985pfa.188.2018.07.27.16.31.04 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 27 Jul 2018 16:31:04 -0700 (PDT) Subject: Re: porting project with large files (git-lfs) from github To: Mathieu Arnold Cc: freebsd-ports@freebsd.org References: <7d8a980d-5b0d-bfd2-790f-579881175e95@gmail.com> <20180726081034.hiu5zoemz5steqz5@atuin.in.mat.cc> <21ac85b2-9d28-5d9f-aa4d-b542b85ea95a@gmail.com> <20180727132239.6n4qay7z636tdqya@atuin.in.mat.cc> From: Robert Message-ID: Date: Fri, 27 Jul 2018 16:31:03 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.9.0 MIME-Version: 1.0 In-Reply-To: <20180727132239.6n4qay7z636tdqya@atuin.in.mat.cc> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jul 2018 23:31:07 -0000 Thanks, which file hosting is most preferred for large freebsd ports? On 07/27/18 06:22, Mathieu Arnold wrote: > On Thu, Jul 26, 2018 at 08:42:59AM -0700, Robert wrote: >> Hi, you can find it here: >> https://github.com/rayrapetyan/daal/tree/FreeBSD_support >> All files in e.g. https://github.com/rayrapetyan/daal/tree/FreeBSD_support/externals/mklfpk/lnx/lib/intel64 >> are "large files" they are fetching normally when doing git pull, but when >> downloading from "codeload" (this is what FreeBSD does) - they contain just >> text hashes... > Well, yeah, like I said, this repository is using git-lfs, which is not > part of the Git distribution, but an extension. Doing a clone works for > you because you have it installed, but it does not work for me because I > do not, It ends up saying: > > $ git clone https://github.com/rayrapetyan/daal.git > Cloning into 'daal'... > remote: Counting objects: 35068, done. > remote: Compressing objects: 100% (20/20), done. > remote: Total 35068 (delta 3), reused 7 (delta 2), pack-reused 35044 > Receiving objects: 100% (35068/35068), 583.32 MiB | 2.71 MiB/s, done. > Resolving deltas: 100% (27544/27544), done. > git-lfs filter-process: git-lfs: not found > fatal: The remote end hung up unexpectedly > warning: Clone succeeded, but checkout failed. > You can inspect what was checked out with 'git status' > and retry the checkout with 'git checkout -f HEAD' > > > It seems the servers running codeload.g.o do not have git-lfs installed, > so when they run git-archive(1) you end up with the pointers to the > large files. > > You will have to run git-archive yourself on a machine where git-lfs is > installed. Something along the lines of: > > git archive --format tar.gz --prefix daal- -o daal-.tar.gz > > And then host that file somewhere, and use it for your port. > >> On 07/26/18 01:10, Mathieu Arnold wrote: >>> On Wed, Jul 25, 2018 at 11:04:41PM -0700, Robert wrote: >>>> Hi, I'm porting something hosted on github using GH_... options in Makefile. >>>> >>>> FreeBSD tries to fetch a tar.gz archive from https://codeload.github.com and >>>> within such archive there are "large files" which contain something like: >>>> >>>> version https://git-lfs.github.com/spec/v1 >>>> oid sha256:e8f293258e38e9689cb87ffbb91c3de2c339a6c074c77115ca86d50b5a48bc64 >>>> size 20413048 >>>> >>>> instead of a real data, so build fails. >>>> >>>> What's the best way to resolve this issue? >>> Mmmm, I never tried a repository using git-lfs, I am not surprised >>> git-archive(1) does not work with it though. What is the project so I >>> can have a look? >>> >> _______________________________________________ >> freebsd-ports@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-ports >> To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org" >>