From nobody Fri Jul 19 15:53:21 2024 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WQZ2n6sLvz5RsFr for ; Fri, 19 Jul 2024 15:53:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WQZ2n5nDmz50s0 for ; Fri, 19 Jul 2024 15:53:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721404401; a=rsa-sha256; cv=none; b=RRI49Xh4ayy5PCcYxPEO2vGZiTcezEs0i/jn4CJyi6oTIdrAgcWJBlJowS5GJtfKopTarB rOqlYLGMQmubklhHR12wg6holfXtKn/VEXoaxeOLM4PQFjRNPqexQWFfRxImMcXxXBjzVi /uoSWRY3oovYSXOVhi0wBCPsXNBPIW2Si4OoPZQjeVVTjy72+YB5DZS0VF1lUeswqaN5Zs 6Gz6XfF+HsV8cqUMzAvtgKej0F3VnACUv53HXwhV34zii8Fjz+CRVVuWiPPhI7UhfZ9bio C29TLf1nOcb7Zz/1GqDWIFkIpdzr8HlEzt+bAZuEmdYeAg0bGgtWjGbojJhwVg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721404401; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=egatIK3k4rpeZy8YJl96Gx9Z/BXglty+JU6cmX9MXyQ=; b=x7Dvc3Gj0CDtxUt2Sg8WQ0Ltp9zR3PAaZXqd51I/BF0osOeQHRjC8RyO0M63uZyjcmnLSR dmlQXhnuEDS9DHNl5uoPZvbjpRnwNhJARnwHfaSZ7JE7TsdxZKJjc1IKBzPfuoBhjji08L o8fw5Z1SRZF8e/KzOjTme+5H3/1nvPoabgrv47OezPITAIMqggQhrjOjDsckWZsc2HnJEl 9WzX0M0PMSnjG2tu/kN50RkOGtaZQ3XOIwnHXjdMK8MOuWbSxXQWznKZiMH44gmjv6ktB4 z6vCFIcLOwOPUjRQ1liIDQjArxvBppnXj2Mu80CRvE6pFEuHGKAS2bZBY+wjEQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4WQZ2n5MBKzf6H for ; Fri, 19 Jul 2024 15:53:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 46JFrLTZ066333 for ; Fri, 19 Jul 2024 15:53:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 46JFrLw5066332 for bugs@FreeBSD.org; Fri, 19 Jul 2024 15:53:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 280371] diff(1) attempts to allocate ~10^20 bytes while comparing 32GB text files Date: Fri, 19 Jul 2024 15:53:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 14.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: yuri@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280371 Bug ID: 280371 Summary: diff(1) attempts to allocate ~10^20 bytes while comparing 32GB text files Product: Base System Version: 14.1-STABLE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: bin Assignee: bugs@FreeBSD.org Reporter: yuri@freebsd.org I tried to compare 2 large files: > $ diff broadinstitute-gatk-4.6.0.0_GH0.tar.good.hex broadinstitute-gatk-= 4.6.0.0_GH0.tar.bad.hex | more > diff: xreallocarray: allocating 18446744073509292634 * 12 bytes: Cannot a= llocate memory File sizes: > $ ls -l broadinstitute-gatk-4.6.0.0_GH0.tar.good.hex broadinstitute-gatk-= 4.6.0.0_GH0.tar.bad.hex > -rw-r--r-- 1 yuri users 32676484755 Jul 18 21:07 broadinstitute-gatk-4.6= .0.0_GH0.tar.bad.hex > -rw-r--r-- 1 yuri users 32676397537 Jul 18 20:06 broadinstitute-gatk-4.6= .0.0_GH0.tar.good.hex These files have some differences in the middle. The failure is most likely due to an overflow. diff(1) should be able to compare 32GB files without the need to allocate m= uch more memory than file sizes. --=20 You are receiving this mail because: You are the assignee for the bug.=