From owner-freebsd-ports@freebsd.org Thu Aug 18 17:06:44 2016 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 597BEBBED46; Thu, 18 Aug 2016 17:06:44 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C13D1C86; Thu, 18 Aug 2016 17:06:43 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 72AF72051C; Thu, 18 Aug 2016 13:06:42 -0400 (EDT) Received: from web3 ([10.202.2.213]) by compute7.internal (MEProxy); Thu, 18 Aug 2016 13:06:42 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=QnBaFnAEq108hm7 dAxtalMivaFM=; b=o5P+qqXW9hG55Y44ifwUFFIg46AwU6PjMvQg7/GgUhHVj7z J0796qqJI5G1C5pc7EvxDnpvS5zQbAbTaoSauDfxXMVoV6GlqUS5pHi7YGxWmlLA xrzDLUfP8r/+1E0DzpXG4Cn3+h3KfqouyMmndsZliYN6Y9BLhOkK6sRCQv6U= Received: by mailuser.nyi.internal (Postfix, from userid 99) id 49898168AF; Thu, 18 Aug 2016 13:06:42 -0400 (EDT) Message-Id: <1471540002.2386051.699306993.7F1A7008@webmail.messagingengine.com> X-Sasl-Enc: 0KTNeyvxgKbecViEL/OM1ZY4w2hybCbqbY9zsyYDqZU3 1471540002 From: Mark Felder To: Roger Marquis , freebsd-ports@freebsd.org Cc: freebsd-security@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-Mailer: MessagingEngine.com Webmail Interface - ajax-b25c4c74 Subject: Re: pkg audit false negatives (was: Perl upgrade - 5.20.x vulnerable) Date: Thu, 18 Aug 2016 12:06:42 -0500 In-Reply-To: References: <3f8f41ff-3262-1021-2e28-2aaae89849b6@cloudzeeland.nl> <2915322d-0b1a-d36e-0725-c10bd0d32b7c@cloudzeeland.nl> <280f6f77-ad33-6ebb-d54a-a97129f793b3@FreeBSD.org> <84206cd3-10fb-2125-c7e9-921d74432c92@cloudzeeland.nl> X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Aug 2016 17:06:44 -0000 On Tue, Aug 16, 2016, at 11:41, Roger Marquis wrote: > > There's also an issue with older versions (perl 5.1*) no longer showing > up in the vuln.xml at all. I've seen perl, php and other critical > network components still in use because the site depended on 'pkg audit' > but did not know that expired OR deprecated ports are not audited. > Apparently this is intentional and by policy. IMO it is a serious flaw > in pkg audit's design. > This is hard to keep track of, but I also agree it is a problem we need to be more conscious of. Unfortunately it adds burden to our ports-secteam because often times upstream will EoL software and not state if older versions are actually vulnerable. Short of a PoC or auditing the source code of something that is EoL / removed from the ports tree there isn't much we can do but guess. It's entirely possible something EoL is not actually vulnerable to newer CVEs depending on if it's in new/refactored code or shared code. Even then it's possible that the way the code is used in the EoL version it's still not vulnerable. > A better policy would include expired AND deprecated ports in the output > of 'pkg audit' for at least a year after they are removed from the ports > and/or pkg trees. If a port had no known vulnerability when removed it > should at least indicate 'no longer audited' in place of 'vulnerable'. > Yes, a solution to create vuxml entries for EoL/removed ports with a simple statement that they're EoL and could be vulnerable is a sane approach. This way we aren't incorrectly listing software as vulnerable to CVEs we haven't validated. I welcome this, but we will need help from users and the community to let us know when this happens as we aren't always aware of the EoL schedules of software in the ports tree. > This is, IMO, one of 3 remaining weaknesses in the otherwise excellent > freebsd audit framework. The other two issues have to do with base not > being packaged (so not really being 'audit'able) and the 'general rule' > announced on Aug 10 that 'the FreeBSD Security Officer does not announce > vulnerabilities for which there is no released patch'. This is > particularly problematic as there are usually mitigations that do not > require patches. > I already solved your #2 problem: https://blog.feld.me/posts/2016/08/monitoring-freebsd-base-system-vulnerabilities-with-pkg-audit/ #3 is being reviewed by secteam/core, so I think we're well on our way to solving these concerns. -- Mark Felder ports-secteam member feld@FreeBSD.org