Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 15 Jul 2024 08:01:58 +0100
From:      Nuno Teixeira <eduardo@freebsd.org>
To:        Xavier Humbert <xavier@groumpf.org>
Cc:        FreeBSD Ports ML <freebsd-ports@freebsd.org>
Subject:   Re: Duplicity ResourceWarning: unclosed file
Message-ID:  <CAFDf7UJxR5AFXJDm9dQHTZRsrvQr=eUnF7f_McHzKB7yJPEM=Q@mail.gmail.com>
In-Reply-To: <CAFDf7UJJ_XVz17EjVrQdYUVN0pS%2BnppqmMMG3mh8ToA13LH=3Q@mail.gmail.com>
References:  <59b38c2d-e596-402d-9ef0-34e892a5e8c1@groumpf.org> <CAFDf7UJJ_XVz17EjVrQdYUVN0pS%2BnppqmMMG3mh8ToA13LH=3Q@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
--000000000000d15be9061d43cef1
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

(...)

My logs on amd64 main, 141, 140 and 133 are fine without errors.

Thanks,

Nuno Teixeira <eduardo@freebsd.org> escreveu (domingo, 14/07/2024 =C3=A0(s)
13:15):

> Hello Xavier,
>
> I'm running duplicity on amd64 main with no problems (backup and checked
> --version).
>
> I don't have access to amd64 logs right now but it builds fine without
> issues on my arm64 rpi4:
>
> http://freebsdrpi4.hopto.org/data/15aarch64-main/2024-07-12_12h32m44s/log=
s/duplicity-3.0.0.log
>
> I will check amd64 logs when I've got the chance.
>
> Thanks,
>
> Xavier Humbert <xavier@groumpf.org> escreveu (domingo, 14/07/2024 =C3=A0(=
s)
> 09:11):
>
>> Hi,
>>
>> Since the last upgrade of Duplicity, I experience these warnings :
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> /usr/local/lib/python3.11/threading.py:986: ResourceWarning: unclosed
>> file <_io.BufferedReader name=3D5>
>>    del self._target, self._args, self._kwargs
>> ResourceWarning: Enable tracemalloc to get the object allocation traceba=
ck
>> /usr/local/lib/python3.11/site-packages/duplicity/backends/ssh_paramiko_=
backend.py:461:
>>
>> ResourceWarning: unclosed file <_io.TextIOWrapper
>> name=3D'/etc/ssh/ssh_config' mode=3D'r' encoding=3D'UTF-8'>
>>    sshconfig.parse(open(file))
>> ResourceWarning: Enable tracemalloc to get the object allocation traceba=
ck
>> Local and Remote metadata are synchronized, no sync needed.
>> Last full backup date: Mon Jul  1 10:33:46 2024
>> /usr/local/lib/python3.11/site-packages/duplicity/dup_main.py:779:
>> ResourceWarning: unclosed file <_io.BufferedReader
>>
>> name=3Db'/root/.cache/duplicity/b0ba93458b58f009d3339ea64701a6b2/duplici=
ty-inc.20240714T020354Z.to.20240714T075149Z.manifest.part'>
>>    new_man_outfp.to_remote()
>> ResourceWarning: Enable tracemalloc to get the object allocation traceba=
ck
>> /usr/local/lib/python3.11/site-packages/duplicity/dup_main.py:780:
>> ResourceWarning: unclosed file <_io.BufferedReader
>>
>> name=3Db'/root/.cache/duplicity/b0ba93458b58f009d3339ea64701a6b2/duplici=
ty-inc.20240714T020354Z.to.20240714T075149Z.manifest.part'>
>>    new_man_outfp.to_final()
>> ResourceWarning: Enable tracemalloc to get the object allocation traceba=
ck
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> A similar issue has been reported in 2019 :
>> https://bugs.launchpad.net/duplicity/+bug/1847122
>>
>> The warning appears also when I ask for Duplicity version :
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> duplicity 3.0.0 May 29, 2024
>> /usr/local/lib/python3.11/threading.py:986: ResourceWarning: unclosed
>> file <_io.BufferedReader name=3D5>
>>    del self._target, self._args, self._kwargs
>> ResourceWarning: Enable tracemalloc to get the object allocation traceba=
ck
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> Again in rebuild of duplicity, same warning
>>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-future>0 - found
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-mock>0 - found
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-paramiko>=3D0 - f=
ound
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-pexpect>0 - found
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-requests>=3D0 - f=
ound
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-urllib3>=3D0 - fo=
und
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-b2sdk>=3D0.1.8 - =
found
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: py311-dropbox>0 - found
>> =3D=3D=3D>   duplicity-3.0.0 depends on package: gnupg1>=3D1.4.7 - found
>> =3D=3D=3D>   duplicity-3.0.0 depends on file: /usr/local/bin/python3.11 =
- found
>> =3D=3D=3D>   Generating temporary packing list
>> sys:1: ResourceWarning: unclosed file <_io.TextIOWrapper
>> name=3D'/usr/ports/sysutils/duplicity/work/stage/usr/local/lib/python3.1=
1/site-packages/duplicity-3.0.0.dist-info/RECORD'
>>
>> mode=3D'r' encoding=3D'utf-8'>
>>
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>
>> Should I report upstream ?
>>
>> Regards,
>>
>> Xavier
>>
>> --
>> Xavier HUMBERT - Unix/Win/MacOSX Sysadmin/Network Engineer
>> https://www.amdh.fr
>>
>>
>>
>
> --
> Nuno Teixeira
> FreeBSD UNIX:  <eduardo@FreeBSD.org>   Web:  https://FreeBSD.org
>


--=20
Nuno Teixeira
FreeBSD UNIX:  <eduardo@FreeBSD.org>   Web:  https://FreeBSD.org

--000000000000d15be9061d43cef1
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>(...)</div><div><br></div><div>My logs on amd64 main,=
 141, 140 and 133 are fine without errors.</div><div><br></div><div>Thanks,=
<br></div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gm=
ail_attr">Nuno Teixeira &lt;<a href=3D"mailto:eduardo@freebsd.org">eduardo@=
freebsd.org</a>&gt; escreveu (domingo, 14/07/2024 =C3=A0(s) 13:15):<br></di=
v><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;borde=
r-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div>H=
ello Xavier,</div><div><br></div><div>I&#39;m running duplicity on amd64 ma=
in with no problems (backup and checked --version).<br><br></div><div>I don=
&#39;t have access to amd64 logs right now but it builds fine without issue=
s on my arm64 rpi4:</div><div><a href=3D"http://freebsdrpi4.hopto.org/data/=
15aarch64-main/2024-07-12_12h32m44s/logs/duplicity-3.0.0.log" target=3D"_bl=
ank">http://freebsdrpi4.hopto.org/data/15aarch64-main/2024-07-12_12h32m44s/=
logs/duplicity-3.0.0.log</a></div><div><br></div><div>I will check amd64 lo=
gs when I&#39;ve got the chance.</div><div><br></div><div>Thanks,<br></div>=
</div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">=
Xavier Humbert &lt;<a href=3D"mailto:xavier@groumpf.org" target=3D"_blank">=
xavier@groumpf.org</a>&gt; escreveu (domingo, 14/07/2024 =C3=A0(s) 09:11):<=
br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8e=
x;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<br>
<br>
Since the last upgrade of Duplicity, I experience these warnings :<br>
<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
/usr/local/lib/python3.11/threading.py:986: ResourceWarning: unclosed <br>
file &lt;_io.BufferedReader name=3D5&gt;<br>
=C2=A0=C2=A0 del self._target, self._args, self._kwargs<br>
ResourceWarning: Enable tracemalloc to get the object allocation traceback<=
br>
/usr/local/lib/python3.11/site-packages/duplicity/backends/ssh_paramiko_bac=
kend.py:461: <br>
ResourceWarning: unclosed file &lt;_io.TextIOWrapper <br>
name=3D&#39;/etc/ssh/ssh_config&#39; mode=3D&#39;r&#39; encoding=3D&#39;UTF=
-8&#39;&gt;<br>
=C2=A0=C2=A0 sshconfig.parse(open(file))<br>
ResourceWarning: Enable tracemalloc to get the object allocation traceback<=
br>
Local and Remote metadata are synchronized, no sync needed.<br>
Last full backup date: Mon Jul=C2=A0 1 10:33:46 2024<br>
/usr/local/lib/python3.11/site-packages/duplicity/dup_main.py:779: <br>
ResourceWarning: unclosed file &lt;_io.BufferedReader <br>
name=3Db&#39;/root/.cache/duplicity/b0ba93458b58f009d3339ea64701a6b2/duplic=
ity-inc.20240714T020354Z.to.20240714T075149Z.manifest.part&#39;&gt;<br>
=C2=A0=C2=A0 new_man_outfp.to_remote()<br>
ResourceWarning: Enable tracemalloc to get the object allocation traceback<=
br>
/usr/local/lib/python3.11/site-packages/duplicity/dup_main.py:780: <br>
ResourceWarning: unclosed file &lt;_io.BufferedReader <br>
name=3Db&#39;/root/.cache/duplicity/b0ba93458b58f009d3339ea64701a6b2/duplic=
ity-inc.20240714T020354Z.to.20240714T075149Z.manifest.part&#39;&gt;<br>
=C2=A0=C2=A0 new_man_outfp.to_final()<br>
ResourceWarning: Enable tracemalloc to get the object allocation traceback<=
br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
<br>
A similar issue has been reported in 2019 : <br>
<a href=3D"https://bugs.launchpad.net/duplicity/+bug/1847122" rel=3D"norefe=
rrer" target=3D"_blank">https://bugs.launchpad.net/duplicity/+bug/1847122</=
a><br>
<br>
The warning appears also when I ask for Duplicity version :<br>
<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
duplicity 3.0.0 May 29, 2024<br>
/usr/local/lib/python3.11/threading.py:986: ResourceWarning: unclosed <br>
file &lt;_io.BufferedReader name=3D5&gt;<br>
=C2=A0=C2=A0 del self._target, self._args, self._kwargs<br>
ResourceWarning: Enable tracemalloc to get the object allocation traceback<=
br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
<br>
Again in rebuild of duplicity, same warning<br>
<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-future&=
gt;0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-mock&gt=
;0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-paramik=
o&gt;=3D0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-pexpect=
&gt;0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-request=
s&gt;=3D0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-urllib3=
&gt;=3D0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-b2sdk&g=
t;=3D0.1.8 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: py311-dropbox=
&gt;0 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on package: gnupg1&gt;=3D=
1.4.7 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 duplicity-3.0.0 depends on file: /usr/local/bin/p=
ython3.11 - found<br>
=3D=3D=3D&gt;=C2=A0=C2=A0 Generating temporary packing list<br>
sys:1: ResourceWarning: unclosed file &lt;_io.TextIOWrapper <br>
name=3D&#39;/usr/ports/sysutils/duplicity/work/stage/usr/local/lib/python3.=
11/site-packages/duplicity-3.0.0.dist-info/RECORD&#39; <br>
mode=3D&#39;r&#39; encoding=3D&#39;utf-8&#39;&gt;<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
<br>
Should I report upstream ?<br>
<br>
Regards,<br>
<br>
Xavier<br>
<br>
-- <br>
Xavier HUMBERT - Unix/Win/MacOSX Sysadmin/Network Engineer<br>
<a href=3D"https://www.amdh.fr" rel=3D"noreferrer" target=3D"_blank">https:=
//www.amdh.fr</a><br>
<br>
<br>
</blockquote></div><br clear=3D"all"><br><span class=3D"gmail_signature_pre=
fix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"l=
tr"><div><font color=3D"#888888">Nuno Teixeira</font></div><div><div><font =
color=3D"#888888">
FreeBSD UNIX:=C2=A0 &lt;eduardo@FreeBSD.org&gt;=C2=A0 =C2=A0Web:=C2=A0 <a h=
ref=3D"https://FreeBSD.org" rel=3D"noreferrer" target=3D"_blank">https://Fr=
eeBSD.org</a><br></font></div></div></div></div>
</blockquote></div><br clear=3D"all"><br><span class=3D"gmail_signature_pre=
fix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"l=
tr"><div><font color=3D"#888888">Nuno Teixeira</font></div><div><div><font =
color=3D"#888888">
FreeBSD UNIX:=C2=A0 &lt;eduardo@FreeBSD.org&gt;=C2=A0 =C2=A0Web:=C2=A0 <a h=
ref=3D"https://FreeBSD.org" rel=3D"noreferrer" target=3D"_blank">https://Fr=
eeBSD.org</a><br></font></div></div></div></div>

--000000000000d15be9061d43cef1--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFDf7UJxR5AFXJDm9dQHTZRsrvQr=eUnF7f_McHzKB7yJPEM=Q>