[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-devel
Subject:    Re: Interest in building an LLM frontend for KDE
From:       Felix Ernst <felixernst () zohomail ! eu>
Date:       2023-12-01 12:09:00
Message-ID: 18c25474b8c.c5ecf92e43342.772554137078024502 () zohomail ! eu
[Download RAW message or body]

+1 to what Ethan B. said i.e.:

 > I am anti-LLM on the grounds that the training sets were created without the original \
authors' consent. I see no issue with a libre/ethical LLM, if there is one, though. If a \
developer or team of developers wants to implement a Qt and KDE-integrated LLM app, I have no \
problem with that, but I believe KDE as an organization should probably steer clear of such a \
thorny subject. It's sure to upset a lot of users no matter what position is taken. On the \
other hand, for those people who do make use of AI tools, a native interface would be nice, \
especially one as feature-ful as you're describing...

> > Should we limit support to open models like Llama 2 or would we be OK with adding API \
> > support for proprietary models like GPT-4?

As Andre said, there is not much reason to discuss this if it can be implemented "generalized \
and backend agnostic". Aside from that, I want us to be aware though that if we are steering \
users towards using LLMs created by known bad actors (which all big LLM companies currently \
seem to be), we give those bad actors power to manipulate and lie to users, which undoubtedly \
will happen more and more if LLMs manage to establish themselves as a middleman between users \
and the more valuable training data. However, if the frontend you want to start allows users to \
choose a LLM to work with, and we can even recommend users one LLM over the other there, then \
this shouldn't be a problem.

> > Should we be joining the mainstream push to put AI into everything or should we stand apart \
> > and let Microsoft have its fun focusing on AI instead of potentially more useful features?

I personally wouldn't want to spend my time on what you are planning to do. I don't think there \
is much to gain there. At the end of the day, everyone can decide this for themselves though.

Cheers,
Felix


[prev in list] [next in list] [prev in thread] [next in thread]