As someone who was raised extremely religious, strayed to the polar opposite, and is now trying to find my way in between the two, I do find this interesting. While the understanding of LLMs and when/how to apply them makes sense, I would argue that they fit right alongside human interpretation of scripture. Consider that many pastors "teaching" scriptures aren't even formally educated.Arguing that you can't use an LLM for Christian apologetics because it "might not be true" overemphasizes the definition of "truth" when it comes to scripture and those teaching Christian apologetics, which is entirely influenced by what doctrine you subscribe to.
heyjamesknight|1 year ago
1. This interpretation might not be "true" but it is a good-faith effort that respects the text.
2. This LLM is fabricating verses, chapters, and even books of the Bible.
If you've used LLMs much, you know that #2 is not only possible, its quite common. This is the kind of "might not be true" that you should be aware of when using an LLM for apologetics—or any effort where "truthiness" is important.
bmicraft|1 year ago
Much more so than any decent LLM ever would. Even while they're "making stuff up", they largely stick to the general themes.
darrmit|1 year ago
causal|1 year ago
Even if you don't believe, the creators certainly intend for their bot to have eternal consequences. Like selling an LLM with the claim it can give advice better than most doctors and should be used as such, the intent behind the apologetics bot is just as reckless and conceited.
vunderba|1 year ago
And going a step further, any follow-up questions to the LLM will be using this incorrect copy as the source for interpretation causing it to go even further in the wrong direction.
Incidentally - this was occurring using a custom fine-tuned model with an added layer of RAG.
FartyMcFarter|1 year ago
But the author is pretty explicit about wanting a high standard (e.g. insisting on using the best sources possible), and doesn't think that using LLMs is compatible with that goal.
jimbokun|1 year ago
The main example he gives is a simple factual matter about the words a specific early Christian manuscript. The LLM invented new text that’s not at all what’s in the manuscript.
He also convincingly argues people performing poor apologetics is no excuse to deploy an LLM performing poor apologetics.
freedomben|1 year ago
darrmit|1 year ago
The friction for me is I am just a very logical and evidence-driven person by nature, so while I recognize (at least for me) that there are some benefits to adhering to some religion or spirituality, the core Christian belief is really difficult for me and always has been. So I don't really know yet where I'll land.
scotty79|1 year ago
What's your motivation for doing that?