From owner-freebsd-hackers@freebsd.org Thu Dec 21 09:26:48 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 415B1E895DE for ; Thu, 21 Dec 2017 09:26:48 +0000 (UTC) (envelope-from dvyukov@google.com) Received: from mail-pl0-x234.google.com (mail-pl0-x234.google.com [IPv6:2607:f8b0:400e:c01::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1CDC97EFA2 for ; Thu, 21 Dec 2017 09:26:48 +0000 (UTC) (envelope-from dvyukov@google.com) Received: by mail-pl0-x234.google.com with SMTP id o2so10658783plk.12 for ; Thu, 21 Dec 2017 01:26:48 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=X++YWpS+V9eSU7nkPLqBuMLDggalZrA3WSgEdAtMQTA=; b=sIb1iMH6ThXP2PteF9ZQVZg/FS5S1EKlDWFwLBiwY5Em4+vl+BrpdXziDQjonbY5vZ CyUprPmejnDjUvLX7pNOsjeRJdUu9dSmdx9kTn7s28iaKyHh9gq/BpnqZzAwTljrSnep sENSukpEQ/BL8SvmvzrgSIYnxzerd4dFAnacP/9ZkRLF/3UkfYaWltun6ZetgEJCHJV3 qPeWT0JnI7XixennVZ/Hb9HJxaBHW/8gLp/y3imGt31urXXBLAiEQGl1pM8vqu1QTAIP vD1M4MwST05fSa5oNE1/k0QS7MVDMAGDyfphHw/JfUxEOPfT68La4cKSwzJdVR+pEOsC EApw== X-Gm-Message-State: AKGB3mJpeL1ApP5gMISVC6vG//zumP8kngRb2zAePpD6CWqH9NS1J303 PcKCDJ6x5OYQrF+Z4Qvd/FPgSSxNjdJ0g2LBY0Hsq7KQSEY= X-Google-Smtp-Source: ACJfBosjLkDsHji/gwGwTIsd62o1jkFFb4qiUV+xLowk3SjB8Lu20sYaBjhfxenD8zKfM45+Xqt+qGEOp5nXELCcIAo= X-Received: by 10.84.244.12 with SMTP id g12mr9732016pll.69.1513848407187; Thu, 21 Dec 2017 01:26:47 -0800 (PST) MIME-Version: 1.0 Received: by 10.236.138.12 with HTTP; Thu, 21 Dec 2017 01:26:26 -0800 (PST) From: Dmitry Vyukov Date: Thu, 21 Dec 2017 10:26:26 +0100 Message-ID: Subject: syzkaller for freebsd again To: Ed Maste Cc: FreeBSD Hackers , syzkaller Content-Type: text/plain; charset="UTF-8" X-Mailman-Approved-At: Thu, 21 Dec 2017 11:25:21 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Dec 2017 09:26:48 -0000 Hi Ed, I see that you are using syzkaller and I've seen syzkaller mentioned in some frebsd announce. Do you mind sharing how extensively you are using it and how many bugs you have found? I wanted to point out that freebsd support in syzkaller is still far from being complete. We still need better descriptions of system calls and kernel code coverage, report parsing need improvements as well. For linux we are now finding 100+ bugs per months in a completely automated fashion using syzbot system: https://groups.google.com/forum/#!forum/syzkaller-bugs https://github.com/google/syzkaller/blob/master/docs/syzbot.md which does continuous building, fuzzing, automatic aggregation, reporting and status tracking. We could setup a similar thing for freebsd, but for that we need support for building freebsd kernel and GCE-compatible images. For linux that code lives here: https://github.com/google/syzkaller/blob/master/pkg/kernel/kernel.go https://github.com/google/syzkaller/blob/master/pkg/kernel/generated.go I don't know how size of freebsd kernel compares to linux, but if you don't measure bugs in hundreds, no, syzkaller is not yet working :)