Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 11 Oct 2025 13:14:24 +0200
From:      ft <ml@ft-c.de>
To:        stable@FreeBSD.org
Subject:   What to do, if chatgpt gives a wrong answer
Message-ID:  <2ee60f98af9e62da887deb970006a86dfe19a207.camel@ft-c.de>

next in thread | raw e-mail | index | archive | help
Hello,=C2=A0

When I ask ChatGPT a question about FreeBSD, I very often get the wrong
answer. Does FreeBSD have a plan for improving the quality of answers
so that it can be taken into account in the next version?

Here are some suggestions (which I received from ChatGPT) on how this
could be done:

First, use the built-in feedback system. If you are using ChatGPT in a
browser, you will usually see thumbs-up and thumbs-down buttons under
each answer. If an answer is incorrect, click the thumbs-down button.
In the feedback form, explain what is wrong and provide the correct
information. For example, if ChatGPT suggests an invalid option for the
pkg command, you could write: =E2=80=9CThe response about pkg usage is
incorrect. The option -b does not exist as described. The correct
option to build a package is -p, as documented in man pkg(8).=E2=80=9D

Second, it would be great if the FreeBSD community could create a list
to collect and document wrong answers. Keeping a simple personal record
of mistakes is also very helpful. The idea is to systematically
document any wrong answers before submitting them as feedback or
sharing them with others. This makes it easier to prove what was
incorrect, ensures you don=E2=80=99t forget important corrections, and help=
s
others understand the issue clearly.

A practical way to do this is to note:
- The topic, command, or function the answer relates to, e.g., =E2=80=9Cpkg
build=E2=80=9D
- The incorrect answer given by ChatGPT, e.g., =E2=80=9COption -b builds a
package=E2=80=9D
- The correct answer, e.g., =E2=80=9COption -p builds a package=E2=80=9D
- The source or reference, e.g., =E2=80=9Cman pkg(8)=E2=80=9D
- You can collect this information in a simple text document or table.
Later, when giving feedback to OpenAI, you have all the information
ready and verifiable.

Third, use community channels to amplify the feedback. OpenAI=E2=80=99s
community forum (community.openai.com) allows you to create threads
about repeated errors or FreeBSD-specific issues. Other users can
comment, verify, or add additional information. For open-source AI
models, you can submit issues directly on GitHub or the project=E2=80=99s i=
ssue
tracker.

Finally, when giving feedback about FreeBSD, try to provide context.
Include the exact FreeBSD version, quote commands or man pages, and
explain why the original answer is incorrect. Logs or screenshots can
also be helpful.

By following these steps, we can gradually improve the quality of AI
responses for FreeBSD topics and help future users get more accurate
information.

Best regards,
Franz



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2ee60f98af9e62da887deb970006a86dfe19a207.camel>