From owner-freebsd-doc@freebsd.org Sun Aug 26 17:25:43 2018 Return-Path: Delivered-To: freebsd-doc@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 807E6107C210 for ; Sun, 26 Aug 2018 17:25:43 +0000 (UTC) (envelope-from ebrandi@fugspbr.org) Received: from mail-oi0-x243.google.com (mail-oi0-x243.google.com [IPv6:2607:f8b0:4003:c06::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 181D988D24 for ; Sun, 26 Aug 2018 17:25:42 +0000 (UTC) (envelope-from ebrandi@fugspbr.org) Received: by mail-oi0-x243.google.com with SMTP id x197-v6so5745167oix.5 for ; Sun, 26 Aug 2018 10:25:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fugspbr-org.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:from:date:message-id:subject:to:cc :content-transfer-encoding; bh=t990qanKVdmHtgM+7VLE8yJoh7zaPNFeHPQL9ZSWQT0=; b=yVrTcFCGUPImcAFDdkQ/oQ0ExjZF9iCQ1u/1NoCaaLc7mF4R/ooaW56EvYr1aXXPPj GgjpdI5W6/IfNz/39LANYBaxwpNeqj8wIPFkvQ3VBxeFSf1mAV5FOO+VRije9TwkFOAL t71cP3kcU+RjDw7uJNQNEEivhEvMxdjcAxTqi3IcG53gETp4F6N2ywPQdBgzyOMOsaTb 4xevah4QQnV8q3miM9PxrNltsIUvLwj9bU3HxytYD1fehKdEmavCe15xpZnU46KqCES0 RQ0tf+181h7K3NK4pN2HJTLaUEi0zJ+bQBtv5ZMERX1NO0wPGQ2TeH3YIrJJrhnr6cHO orgw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to:cc:content-transfer-encoding; bh=t990qanKVdmHtgM+7VLE8yJoh7zaPNFeHPQL9ZSWQT0=; b=nRgULEUKPP8nvigq/VYzAtIowapY6huba+sPJnnz7x+T7iXAOv1e2a9A86du/oyiqy e19QJZCaxFj802rI7RU2eG7x+PxhkiCVaav1Ej3WaoAepKRczJefjhZQQC2lbHm4m7BD wToolq0jKAMVcXlr+NO/7iBJUmLGROxDAb8PWIFodK3Ll/RUPDx9LmxLvp0Lo5TsiMLM qGwDSsJirJOpbSYqZ40fn2rsSDYb93whobr8SdmbGdQT0nLrddslp7Wp8ZfqMGT/Fkwy x53jFoJ3CcpEIvL+qfRdN0rIPg0J4DcCArPceex3q3qLI59o1E1fzjMGH4IHDW5h/YO8 huvw== X-Gm-Message-State: APzg51D7qWyUWZOiy6SH07sxh7d3doeuQU9QstBzX5sGTX2EQWLYr3fe 8EgBp1YqqSPDq0n+DWOx/XD82vKeKaJ2P90zx1Jb+oOn0Lk= X-Google-Smtp-Source: ANB0VdYNGhYnGbyE3ukw3BLtJ36NKzh4NOexYfHaAwI4M8+7N2E+aS4wWaQ6xBtUq/fGkFwRqf2uLfbqnD9lTkKUdLk= X-Received: by 2002:aca:eac4:: with SMTP id i187-v6mr9960561oih.256.1535304341950; Sun, 26 Aug 2018 10:25:41 -0700 (PDT) MIME-Version: 1.0 Sender: ebrandi@fugspbr.org Received: by 2002:a8a:98b:0:0:0:0:0 with HTTP; Sun, 26 Aug 2018 10:25:41 -0700 (PDT) From: Edson Brandi Date: Sun, 26 Aug 2018 14:25:41 -0300 X-Google-Sender-Auth: FcV4bGSaMQrXEkJ_4YES5n7s4kc Message-ID: Subject: Status Update about effort to translate the FreeBSD Documentation from en_US to pt_BR To: freebsd-doc@freebsd.org Cc: "Danilo G. Baio" , Gabor Kovesdan Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-doc@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Documentation project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Aug 2018 17:25:43 -0000 Hello Guys, First of all, i'm sorry for the text wall... But I think it's worth sharing with you what we did in the last 2 weeks, because I believe that what we have learned can be useful to other translation groups. About two weeks ago Danilo (dbaio@) mentioned here in the list about the tests he was doing with the Zanata translation platform, and the .po files that can be generated with the docproj toolset. Talking to him in private we concluded that we should try to resume the project to translate the FreeBSD documentation into our language using these tools to simplify the translation workflow. And since we made this decision I can say that the last 2 weeks have been extremely productive for us. Before starting the project itself, we have prepared the necessary infrastructure to receive the translations, than we re-enabled the github repository maintained by the Brazilian FreeBSD user group (FUG-BR) which was used in the past for the translation initiatives, and it was loaded with .po files generated with docproj toolset from all the books and articles available in the en_US.ISO8859-1 directory, and we have also created a project on the Zanata platform with them. We also configured an automated pipeline with jenkins to build the documents from the translated .po files downloaded Zanata platform, and we've published a new website with basic instructions on how people could contribute to the translation, Once everything was ready, we went out looking for volunteers to help us with the translation. When we presented the new simplified translation process to our community we had an excellent acceptance, which allowed us to quickly reach the number of 22 volunteers working on the translation and revision of the documents. We talked to many of the volunteers to understand what method they would normally use to do their translations and found that most of them would use google translator to draft an initial translation, and than this initial draft goes through a meticulously review, to ensure that the text are in the correct context. Based on this finding, we decided to make the work of the volunteers even simpler and one of our volunteers builded a NLTK script that allowed us to extract the text contained in the msgid tags of an .po files and to translate them using Google Cloud Translation API, generating a new .po file that already have an initial translation at msgstr tags. T This simple procedure avoided a lot of manual work for our volunteers and have speedup the translation process a lot. After these initial 2 weeks of work, we have the following results to share= : * 100% of the content of all files (7 books and 35 articles) has already been translated from en_US into pt_BR using Google Cloud Translation API * ~42% of the translated content of all files has already been reviewed by at least one volunteer. * ~11% of the translated content of all files has already been reviewed by at least one second volunteer, and are considered as "finished" - based in our previous experience if a document has passed successfully by at least 2 different revisions made by 2 different volunteers, it=C2=B4s translation can be considered finished. While there is still a lot work to be done, the progress we have made in these 2 weeks has been enough to keep our volunteers motivated to keep moving forward :) Than i'm sure that very soon we will have some documents ready to be committed to our SVN repository. For those who wish to track our progress, i think that following urls can be useful: Preview of pt_BR builded documents: https://doc.fug.com.br/jenkins/ Our project website: https://doc.fug.com.br Our project at Zanata Platform: https://translate.zanata.org/project/view/FreeBSD Our github repository: https://github.com/doc-br/zanata --=20 [ ]'s Brandi -- Edson Brandi ebrandi@FreeBSD.org OpenPGP Key: 0x209E9B54FFD3035B 443B 5363 564F 06C3 EA54 9482 209E 9B54 FFD3 035B