From owner-freebsd-python@freebsd.org Fri Feb 28 08:52:50 2020 Return-Path: Delivered-To: freebsd-python@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1299D25DCDD for ; Fri, 28 Feb 2020 08:52:50 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48TNbP1hK1z3N8f for ; Fri, 28 Feb 2020 08:52:49 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: by mailman.nyi.freebsd.org (Postfix) id 1414B25DCDC; Fri, 28 Feb 2020 08:52:49 +0000 (UTC) Delivered-To: python@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 120C725DCDA for ; Fri, 28 Feb 2020 08:52:49 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (smtp.digiware.nl [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48TNbN5M2qz3N7V; Fri, 28 Feb 2020 08:52:48 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from router.digiware.nl (localhost.digiware.nl [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 3157B4366C; Fri, 28 Feb 2020 09:52:45 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.com Received: from smtp.digiware.nl ([127.0.0.1]) by router.digiware.nl (router.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 42mh8TVLwdTE; Fri, 28 Feb 2020 09:52:44 +0100 (CET) Received: from [192.168.10.9] (vaio [192.168.10.9]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 6C25B4365F; Fri, 28 Feb 2020 09:52:44 +0100 (CET) Subject: Re: Missing symbol under tox in openssl stuff To: koobs@FreeBSD.org, python@freebsd.org References: <94312df8-3d70-76e4-4e83-b57bf592a06d@digiware.nl> <3fe14206-cdbe-53e8-41e5-e471e78c6fec@FreeBSD.org> From: Willem Jan Withagen Message-ID: <713fb719-1acf-b290-8dca-4ec32362b2f0@digiware.nl> Date: Fri, 28 Feb 2020 09:52:43 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Firefox/68.0 Thunderbird/68.5.0 MIME-Version: 1.0 In-Reply-To: <3fe14206-cdbe-53e8-41e5-e471e78c6fec@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: nl X-Rspamd-Queue-Id: 48TNbN5M2qz3N7V X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-6.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] X-BeenThere: freebsd-python@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FreeBSD-specific Python issues List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Feb 2020 08:52:50 -0000 On 28-2-2020 03:47, Kubilay Kocak wrote: > On 27/02/2020 10:53 pm, Willem Jan Withagen wrote: >> Hi, >> >> I'm the first to acknowledge that I do not know enough of python. >> But still I can get by most of the times. >> >> However during the tests of my Ceph port one of the tests complains: >> ============== >> >> orchestrator/_interface.py:701: ImportError >> ------------------------------ Captured log call >> ------------------------------- >> ERROR    orchestrator._interface:_interface.py:391 _Promise failed >> Traceback (most recent call last): >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/cephadm/module.py", >> line 334, in do_work >>      res = self._on_complete_(*args, **kwargs) >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/cephadm/module.py", >> line 398, in call_self >>      return f(self, *inner_args) >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/cephadm/module.py", >> line 2352, in _create_grafana >>      return self._create_daemon('grafana', daemon_id, host) >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/cephadm/module.py", >> line 1874, in _create_daemon >>      j = self._generate_grafana_config() >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/cephadm/module.py", >> line 2288, in _generate_grafana_config >>      cert, pkey = create_self_signed_cert('Ceph', 'cephadm') >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/mgr_util.py", >> line 134, in create_self_signed_cert >>      from OpenSSL import crypto >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/.tox/py3/lib/python3.7/site-packages/OpenSSL/__init__.py", >> line 8, in >>      from OpenSSL import crypto, SSL >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/.tox/py3/lib/python3.7/site-packages/OpenSSL/crypto.py", >> line 15, in >>      from OpenSSL._util import ( >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/.tox/py3/lib/python3.7/site-packages/OpenSSL/_util.py", >> line 6, in >>      from cryptography.hazmat.bindings.openssl.binding import Binding >>    File >> "/home/jenkins/workspace/ceph-master/src/pybind/mgr/.tox/py3/lib/python3.7/site-packages/cryptography/hazmat/bindings/openssl/binding.py", >> line 15, in >>      from cryptography.hazmat.bindings._openssl import ffi, lib >> ImportError: >> /home/jenkins/workspace/ceph-master/src/pybind/mgr/.tox/py3/lib/python3.7/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so: >> Undefined symbol "SSLv3_client_method" >> >> ============== >> >> And I have no idea how and why this complaint is here. >> If I check with openssl it seems that this version should be >> available in version 1.1.1,d that is installed. >> And all packages are up to date. >> >> Who is the casue of the error here? >> And how do I debug this.... >> >> --WjW > > Looks like cryptography is compiled/linked inconsistently, probably > against base *and* ports OpenSSl versions, or some OPTIONS in your > openssl port have changed, but cryptography was not rebuilt > > Rebuild cryptography (via ports), and try to reproduce > Clang is consitantly complaining about a mismatch in openldap between openssl-1.1.1 from ports and openssl-1.1 from base. Sort of learned to live with it, since in essence thay are the same on that platform, but it is worrying that 1 program could depend on 2 different openssl libs. > Alternatively, because tox installs dependencies itself in its own > environments, its probably trying to install crytography manually (not > via the port), which produces a broken cryptography Python package. > > This is why we dont use tox for tests (as it bypasses ports). Use the > test runner that tox itself invokes (pytest, nose, unittest, whatever) > I don't really have a chance here because it is part of the CI that comes with Ceph, and changing the infrastucture there just for the sake of this is not really going to happen. Currently openSSL doesn't build the SSLv3 stuff any longer by default. S things got fixed after I build a new openSSL from ports with the SSLv3 stuff in it, then all trouble went away. But it is not a receipe that will work in a port, and on ports@ I have not heard a good way to tackle this. --WjW > > > _______________________________________________ > freebsd-python@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-python > To unsubscribe, send any mail to "freebsd-python-unsubscribe@freebsd.org"