[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-devel
Subject:    Re: Interest in building an LLM frontend for KDE
From:       Felix Ernst <felixernst () zohomail ! eu>
Date:       2023-12-01 12:09:00
Message-ID: 18c25474b8c.c5ecf92e43342.772554137078024502 () zohomail ! eu
[Download RAW message or body]

+1 to what Ethan B. said i.e.:

 > I am anti-LLM on the grounds that the training sets were created without the \
original authors' consent. I see no issue with a libre/ethical LLM, if there is one, \
though. If a developer or team of developers wants to implement a Qt and \
KDE-integrated LLM app, I have no problem with that, but I believe KDE as an \
organization should probably steer clear of such a thorny subject. It's sure to upset \
a lot of users no matter what position is taken. On the other hand, for those people \
who do make use of AI tools, a native interface would be nice, especially one as \
feature-ful as you're describing...

> > Should we limit support to open models like Llama 2 or would we be OK with adding \
> > API support for proprietary models like GPT-4?

As Andre said, there is not much reason to discuss this if it can be implemented \
"generalized and backend agnostic". Aside from that, I want us to be aware though \
that if we are steering users towards using LLMs created by known bad actors (which \
all big LLM companies currently seem to be), we give those bad actors power to \
manipulate and lie to users, which undoubtedly will happen more and more if LLMs \
manage to establish themselves as a middleman between users and the more valuable \
training data. However, if the frontend you want to start allows users to choose a \
LLM to work with, and we can even recommend users one LLM over the other there, then \
this shouldn't be a problem.

> > Should we be joining the mainstream push to put AI into everything or should we \
> > stand apart and let Microsoft have its fun focusing on AI instead of potentially \
> > more useful features?

I personally wouldn't want to spend my time on what you are planning to do. I don't \
think there is much to gain there. At the end of the day, everyone can decide this \
for themselves though.

Cheers,
Felix


[prev in list] [next in list] [prev in thread] [next in thread]