From owner-freebsd-questions@freebsd.org Fri Jul 24 20:53:04 2020 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5E648373ADD for ; Fri, 24 Jul 2020 20:53:04 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-io1-xd29.google.com (mail-io1-xd29.google.com [IPv6:2607:f8b0:4864:20::d29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BD1cb4pZqz4HBM for ; Fri, 24 Jul 2020 20:53:03 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: by mail-io1-xd29.google.com with SMTP id p205so11145264iod.8 for ; Fri, 24 Jul 2020 13:53:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=BMjtjslsRSSxMGXGKJXYZzKBYH6oYoXyvjH4RtX51dY=; b=f9JnABQz8OE4jEuVgauB687oUynYPvTGT+Pxkc8XBkaAJLytd8+Ubdr5XfuqaGw5KA FPaH0VZp5pIN4UhM0nE4EV3S9PT+WdCxLLoH0WMWmpaHV3kviJTPsA/J96MbNzi4m1/Q p+pa2i3PymUbxF9w34sgN+Tdluu4VCBHTX8gSoZPs5Ix/OQdn9YuMFTWBDIUp+gmE68+ UYg8+g1HM/F04gnHDtMqVORFhk9+t3tGALQArQD2BYg/9Zg6Xhs7LIpf5Ieqdch7i5jp F+urLxDUQ5GgQK5mKZYg2A5ErwmbHqMGB/5HJy4u8vZR1uDBEr+/sz8smluy44T9rdWr qtTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BMjtjslsRSSxMGXGKJXYZzKBYH6oYoXyvjH4RtX51dY=; b=ZHbpnZH4F4h9420yQbmxmPPHgsicAupqRUBOMffpkRQSzLnjrtLeLhKcb/m3AcvqYm j0WMQPMINypS6QCRPuOcHu1jRI37vV2ASKJ70ZGBBwrSpeCF/xJ4KyVKrglpBSaz6ACk 2ySAXHCtNrR3L6NbT410NQBC68+6hdO/8Xz9MXbsKghVUVYuk8QJwV9dZRU6YAmW3qDU xvhTZ13Y0MyGd5oN5FVRauZSPYmJq8rqmi+jqxScvaIBcBJFIydTaOt0fQKx6D+cisxA orBLyHt6je+RZDJeil1k+fCm46JcDBL/3ZJqV8DAcdun8t+TaSUz1YbNnbmnE9TOl9sC qz5Q== X-Gm-Message-State: AOAM530mN3z8H4fO+i3JxvwuDlum2EpVbgLHMMojcPIx4UrHrsgUJqQO F/4xh9xwUOfbAauhvMK2so806IDuMH/6+d/7WvM= X-Google-Smtp-Source: ABdhPJwE5PiDoTr4V7XU5Ha2qdpIhtiQpGGWTye9+SYFaCPz1yPkDm6rlwEazvvnfahcKNEgGM2KoOr/OgSAbnq+dP0= X-Received: by 2002:a6b:b4c8:: with SMTP id d191mr5864058iof.174.1595623982641; Fri, 24 Jul 2020 13:53:02 -0700 (PDT) MIME-Version: 1.0 References: <20200214121620.GA80657@admin.sibptus.ru> <20200214141600.GA82559@admin.sibptus.ru> <20200214204838.360c8f624397c659946bd764@sohara.org> <20200215063818.GE1482@admin.sibptus.ru> <20200215083359.367d8a3e9ddb4942df67d5b5@sohara.org> <58202623-bbf7-eda0-5cb5-fb4749e91e20@watters.ws> <6318251A-973A-4DEC-9271-12333EB11F7B@kicp.uchicago.edu> <800f33cd-0dc1-1ae9-2262-a374bf8c10dd@kicp.uchicago.edu> <20200724170348.51f108ec@archlinux> <1273868562.6647660.1595604615652@mail.yahoo.com> <20200724183331.6363d69c@archlinux> <20200724210127.7d05e22bd81b95388adf32ba@sohara.org> In-Reply-To: <20200724210127.7d05e22bd81b95388adf32ba@sohara.org> From: Aryeh Friedman Date: Fri, 24 Jul 2020 16:52:51 -0400 Message-ID: Subject: Re: Ask stupid questions and you'll get a stupid answers, was: Technological advantages over Linux To: "Steve O'Hara-Smith" Cc: Ralf Mardorf , FreeBSD Mailing List , Paul Pathiakis X-Rspamd-Queue-Id: 4BD1cb4pZqz4HBM X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=f9JnABQz; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of aryehfriedman@gmail.com designates 2607:f8b0:4864:20::d29 as permitted sender) smtp.mailfrom=aryehfriedman@gmail.com X-Spamd-Result: default: False [-3.65 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.986]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; NEURAL_HAM_LONG(-0.99)[-0.993]; RCVD_COUNT_TWO(0.00)[2]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d29:from]; NEURAL_HAM_SHORT(-0.67)[-0.674]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; FREEMAIL_CC(0.00)[riseup.net,freebsd.org,yahoo.com] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jul 2020 20:53:04 -0000 On Fri, Jul 24, 2020 at 4:01 PM Steve O'Hara-Smith wrote: > On Fri, 24 Jul 2020 14:09:15 -0400 > Aryeh Friedman wrote: > > > spent 7 weeks denying that it was needed because they did block level > disk > > backups (I would love to hear from any DBA who would trust such > > backups!!!) > > Well so long as it streamed all changes to the backup in real time > and was guaranteed never to lose a block no matter what then I might trust > it for hot swap purposes but not for disaster recovery. > That is the reason why we requested replication not backup! (see below for what the hosting company absolutely refused to understand/believe) Did I mention that the database *MUST* stay up 24/7 since it is receiving real-time cardiac data for patients that are known (or at least strongly suspected to have heart conditions serious enough to need potential emergency open heart surgery) and the DB recieves over 1000 updates every 3 seconds that need to be processed in near real time? So no it is not possible to take it down (as is recommended by the MySQL manual and/or almost every blog out there)... So in order to avoid corrupting the DB on restore by backup incomplete transactions the only way is to lock the tables before backing it up (something that can only be done inside the DB not external with block only backups)... only problem here is it takes longer to back them up then 3 seconds and the client software is written by complete morons (who for example never even heard of concurrency as far we can tell) and thus just silent drops any data that can not be written to the DB (they blindly assume everything is a successful write). So therefore block backups are completely out the question (btw the DB is 21 GB and growing at 500 MB a month)... Let add one more complication the client wants us to auto populate the MySQL DB from our webapp DB which is on a physically separate machine, but refuses to buy a second license for the device DB software and thus we are forced to do our development/alpha testing on live data (i.e. we *MUST* have completely working backups made every 15 mins or so). In short this is the kind of project that makes the developers (us) need the devices we have connected to our webapp much sooner than later (if we ever needed them at all outside of this project). Grey hair would be the best possible outcome of this project! -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org