--nextPart2524963.Sgy9Pd6rRy Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8"; protected-headers="v1" From: Andre Heinecke To: "kde-devel@kde.org" Cc: Loren Burkholder Subject: Re: Interest in building an LLM frontend for KDE Date: Fri, 01 Dec 2023 05:44:26 +0100 Message-ID: <2338783.n0HT0TaD9V@teutates> MIME-Version: 1.0 Hi. On Friday, 01 December 2023 03:53:22 CET Loren Burkholder wrote: > they can be quite useful for tasks like programming. I need it desperately for intelligent spellchecking / grammar fixes =F0=9F= =98=85 > From a technical standpoint, such an app would be fairly easy to implemen= t. > It could rely on Ollama[0] (or llama.cpp[1], although llama.cpp isn't > focused on a server mode) to host the actual LLM; either of those backends > support a wide variety of hardware (including running on CPU; no fancy GPU > required), as well as many open-source LLM models like Llama 2. > Additionally, using Ollama could allow users to easily interact with remo= te > Ollama instances, making this an appealing path for users who wished to > offload LLM work to a home server or even offload from a laptop to a more > powerful desktop. I played around with Gpt4all a bit and liked it very much. Especially if I= =20 could alternatively put in my OpenAI API key in a generalized fronted. Sinc= e=20 Hardware will only get better some local solutions for some easy tasks migh= t=20 also make sense. I can totally see a use for a generalized KDE fronted or= =20 even Frameworks API to interact with LLMs=20 > From an ideological standpoint, things get a little more nuanced. Does KDE > condone or condemn the abstract concept of an LLM? What about actual mode= ls > we have available (i.e. are there no models today that were trained in a = way > we view as morally OK)? Should we limit support to open models like Llama= 2 > or would we be OK with adding API support for proprietary models like GPT= =2D4? Please leave ideology out of it, we are doing Free Software. So if you=20 "Ideolically" do not want to have something I have the freedom to come with= my=20 different ideology and just do it anyway. If you want to really work on=20 something like that and not just start some Academic discussion keep things= as=20 generalized and backend agnostic as much as possible IMO. > Should we be joining the mainstream push to put AI into everything or sho= uld > we stand apart and let Microsoft have its fun focusing on AI instead of > potentially more useful features? I don't recall seeing any discussion ab= out > this before (at least not here), so I think those are all questions that > should be fairly considered before development on a KDE LLM frontend begi= ns. I don't think so. I have the slight feeling that you want to start an abstr= act=20 discussion here and then magically the "KDE Community" will develop somethi= ng.=20 Just do it or don't. It will always be in the users freedom to use it or no= t.=20 I would love to have an optional KMail plugin that interacts with an LLM.=20 Others might not =F0=9F=A4=B7=F0=9F=8F=BB=E2=80=8D=E2=99=82 > I fully understand that by sending this email I will likely be setting of= f a > firestorm of arguments about the morality of AI, but I'd like to remind > everyone to (obviously) keep it civil. And for the record, if public opin= ion > comes down in favor of building a client, I will happily assume the > responsibility of kicking off and potentially maintaining development of = said > client. I don't really see why this should kick of a firestorm of arguments. It's a= ll=20 about freedom. Its not like you are proposing to forcefully feed all the us= ers=20 data in a remote LLM as a requirement to get Plasma to start. Start a project on invent, create something useful, and then we see where i= t=20 goes how many users it will find. How well it integrates. I would happily j= oin=20 you and I am very interested in this. A simple first useful prototype for m= e=20 would be to have KMail Messagecomposer integration where it could help me=20 write mails, just like ELOPe =F0=9F=98=80 I am currently working on a prototype to combine https://invent.kde.org/ schwarzer/klash/ with a local LibreTranslate to at least create fuzzy=20 translations for po files and do some trivial translation tasks automatical= ly.=20 I think this is slightly related.=20 Best Regards, Andre =2D-=20 GnuPG.com - a brand of g10 Code, the GnuPG experts. g10 Code GmbH, Erkrath/Germany, AG Wuppertal HRB14459 GF Werner Koch, USt-Id DE215605608, www.g10code.com. GnuPG e.V., Rochusstr. 44, D-40479 D=C3=BCsseldorf. VR 11482 D=C3=BCsseldo= rf Vorstand: W.Koch, B.Reiter, A.Heinecke Mail: board@gnupg.org =46inanzamt D-Altstadt, St-Nr: 103/5923/1779. Tel: +49-211-28010702 --nextPart2524963.Sgy9Pd6rRy Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iRAdBAATCQ+lFiEEUVvLfWNZh6ukRusW7yBWKr8ykOYFAmVpZKvOxiYAmQGNBFZm qpUBDACGI+NCayfhevyjO2nsZrO7I6RNKsQlxW7OUL54fPuu/3VOATIx4q4JAjFy sDS1Zhq9m83dXNtUlpVHrGfPIG01pzLue5ye/4Nc/18cghM58Wp7qDvOW9kF6FVa tCoNTZH2UCnV42tw8pxaSmQLcF9kEvEbWG8G0L67ypxUj/ZzOYHccnh1lLQw6mgX k4Xu/UGCNhnuMrgVQUNLamYtgED0hw+wjh1qji+Geyi9vFtXW5T8wnP95846e4FC bhMyk/4IXx2dIn0ext4cgLed3jhRa+8oJu9DgPKOcK54/7uSvjU7ypNZM87i1NVS w5bV0U3ZOZsVCbyYpbczd4G8JLRTGVdLohGd+S88Mj/IDAe1jd6HEea5ugbrixe9 Jb2p8lRVBBWkruGp6BUrl2hQoB0iT6Mavr0lELywAeI/VaYoqh1emRKO0KSPHBij fjDAABpMkOwkd5U02U/Ddf+CHrCvXkY7qosTkQCSmNF318STF6ZnwB7FG6q1bpoq BxGnrBkAEQEAAbQmQW5kcmUgSGVpbmVja2UgPGFoZWluZWNrZUBnMTBjb2RlLmNv bT6JAdcEEwEIAEECGwMFCRLMAwAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AWIQSU pcmgPC/lyjsJXY4f33I89GK2sQUCXfJLMgIZAQAKCRAf33I89GK2sW/OC/9tnD+R tMx78HPvT8BsopA2gNY/JrfQOgMQwi1Jaf335NNKAf3+QHgAg6k6GuriXv+W40+y 6qaRHUzuMOPUmN4BmKQvpwdfdbBnaBC6fA+7ii1tOz3MAzdnEERbwwKbMbhqjM/n I0JhbntXGpWsBhTLanHLmR5UHrjCsAGTe2nHmqzo8v21q7G8QXQnyQRYnqvR00yV wyoxi+ZigbxhmiPgYqgKGEXVQizP6NJ2oW/WIqlivQdc3t7hj1DJpEC/KXlDn6jP aL3taspu8bhF1drjSGIQurGnM8+hGLuHLEpt4yeBtPNWs3iNXNVmcIpxyNtUhikh yLZKnn9k6V1DvqVqI59OtA0Z+I3K1zKL3TGSL5cLblXSdJkR6hqeoc/mpcgXhIpQ ydsFsIAdBiaz/9zCxKIrjYCDwIGD2xcqpFI0s2Mbs0oHzH7jJK919B45BXvubO2x nW4wHsy+8gLqriMCiZOMXX+2hFARBs1xt7P0vGEYM63u1pguDC2dgeE0vgC4OARY ocu2EgorBgEEAZdVAQUBAQdAsWkCnMaOawGHVvV5QQlv8S099d8CsiuH692nc6sV V0IDAQgHiQG2BBgBCAAgFiEElKXJoDwv5co7CV2OH99yPPRitrEFAlihy7YCGwwA CgkQH99yPPRitrEHgwv/UGw2NhaFGEPqC4S3CjLDJNBd5TZ9I2fTWamypfgxNltn I5GaAxyPgrdyG52Zie0ehjDzwhdXHVD774cFdSzOm/uIFj/eNYt0E5Mo+r+7ww4H wX9zbQTwgdKzBO2w6BWo6CvnHI8ZFELpZQtdp3RNtzqdzdL67kVQM6+kYaG7w8TP rSB4nNKaHY1w5hYacwdOZ+S8stkiCi6EDQ2HXk2LoNrb0DLRWzA2lVBz+2sde6Xn aQaRJ7VecXWA9uXl12X9v1/SgYbhuMZRfW6P4md/Qfsf0o+wGbj7gaTSrmT9UNHU 1+zS3AeEeALf2iVievgOjQAGoyx8mtPqCL0d4vKua7YMEifmq9Vl0AzpgETvk5Uy 2kekNtrO4Ixl3aETB6M0D5b838vo/gfI6a7PMnh71egp0iabKoLrhlX6VpCFHVej a/wN8MHLUfqt+gbByI9Y8RCKoZ8KHnKymFtG75wl+/06uPV6I9znlKUFiwTY+hH6 5sIAjpFcS1Rqat+YCC30iQG2BCgBCAAgFiEElKXJoDwv5co7CV2OH99yPPRitrEF Aliun0ACHQEACgkQH99yPPRitrH8Bgv/ZWJs0jhubDZ9sUXrDHKu/bjpRfZKtwgQ UuowaUjiJEfG4nv3SXB8XyoSHQghksuweuvKflHNGl2SC/dNGhLAoZhDeb4BIRXw 2HxJGW1295YB+yu0b4ciQlJUiC/NocYrxHIvRqHfxprbemqpYaDGaevEGRwI4jfS ktDPoLHAwS6Qfu74oDHrhwqfLF3ZR0X0keGRcpMKEwgy1VYC7sqcKGiWXbeqR7Gw ZP8jDLbM+jsqZ7WjtyFBgyuMVbNeWC/WAoE0bdI22Z2gN9FAwm4uUIUUzEt1kRH1 oeADClWjrujPQPdrwkgrsEYDNDDF/cAXus2vrzNuvwFHG50rIyfXyjsyM5XTdgvO 0GsWnlJ04Jaxj3zbg3i71h0uTaexCk6BtmvX2ruaT/N0O3U5SRsue1pYEO96g0u9 RJ9V34ljScPi9kJI6jgIuXUjFcr24sHpBvkyxjE7uSDbGZgb8syIwrLLSS+3BAyT BfNtxv7M5ElhHK4meB76zRiduYFxw0C2uQGNBFZmqpUBDACzVnvJwBRSsVF3enMM ioWskplVROhGpXdNo3cKasOdTzS1HYysSHhJZ4hYJIF02PHD6l5cr9qSV8EkAlbS mPx25/k3XHYQSaNFKD5qh2wN2FhiuvuD89tA0I7KnQIVAdM2Y3Bnr6BFcgfhZNDI UgP3DtIjcLfBQwcMFVyGjolGa4RLPFWB6hpdgHWk+SR8mlNaAKukfPQj5zHkMRr4 qAtg7kVNhdfbzFPo8eM835fFUWoXkZyMvhCG9BW3utz8lu7jMGtaVKjHzf2q75kA LNng0mgLIIHhvW4Jb7rIDiW9HiARnLNhELz/N8CXoQa+z3w2pAO7xJC2pJGOS7TR rvM8433P7fZTrC3DKWvAdI1RvmFCOzGBcwdQGWMe70K2z7oOlc8T295as7HKsghM Xg+qcvMKwoqRUWplFsqWcLPVt/cfe8SAqWxoWxfaKxixHE/q6XrMnZPeG+WaN7TP amMTg3JAnPG7OYfq4GoklVnfo/RhkKeZtRhsaGj8ACtPkpkAEQEAAYkBvAQYAQgA JgIbDBYhBJSlyaA8L+XKOwldjh/fcjz0YraxBQJfTfa9BQkSTU2oAAoJEB/fcjz0 YraxrZwL/1AhquNFRtMswxANItJGYENgJcYCWaS7TbpNVtSEPsue1SQuAol4jaLc cVVz9j5HxUJUO0DQps8MEV1J3tr7x+zwwEjNwmeyr9O6LPrh91p5M4/Ao5d2wi6h q5bt+90x6Jx0k+I7ziOXuFXJFOhxqyUTOJJm3RpxjQnetGEzUOUhn/R37Lvnt6bN Zsr5ltz7HsUsEG3xWoq5hCsGFsp84lNkLGlu2Igy1HlFFKWPjD9k3CN0X96gsoOR DWHyy8y9lkY5E5Fhrd6GZ3aoS3WGCZawgB+F59PrCDqHvzqOvVBXwRdtlQGnkiJN jEWoguEvfR/VsLiGoGIcty+ctB5xAOTqB9YuzIByeHpdNpKpKeiAdyRYy16zReVX MRaYrAkOJHGTTSyHD34pIeH/CivOFjSVp6drVaZ7xjtpA9pEzZDrm/cWx4hDCxgq hxD7tWX7BU58z7gor4zjN04Ce1egSUqgFDPGE5kP5nyk0tYDs7qLH4Z0mnPx1Pmz 3VFE/Af+RbhzBF8sFQsTCSskAwMCCAEBCwMDBBSypMBngGy3e29QRCpponytz3rS jdA9mMKbR9EAJvt/QJKoi+u60UetdazD6PX+rETXrzmmpqod8WG5WZrS4bLu1ffY Rz2GdfqDUfG3rA97yc8E/a+swIhcQ+MtOloV2YkCTQQYAQgAIBYhBJSlyaA8L+XK Owldjh/fcjz0YraxBQJfLBkpAhsCAKEJEB/fcjz0YraxliAEGRMJAB0WIQRRW8t9 Y1mHq6RG6xbvIFYqvzKQ5gUCXywZKQAKCRDvIFYqvzKQ5nqpAX4+seEU7EJ9yUnL en0dSOIhGUpVsUP0wf2LVkvbroBfbDwfZXwyFYNlL/HvCT2FKFoBewe4u0g1jRgt snwQldE4duwtgc4CplKh14U6twiZ1QJaSXrkkpqOVRB6vD+m41XcBGwZC/99yV+e YoOTiTH4jXL8EbmRQ7KTGv6lLPbTIHrdE09zeiRIRuianNPlVIXeTcsfAT70ZpbT twpRweq0cyYIZlL7NOMO7HQoXh83yWj8FRZjehRAKY+qIpiAcV7NII+h5leIp+jV FavyocVdWrdCii5UIg5SSQYKaH/U8CD+GtVAIwR0Vjxv7/WWoClGSxcSFporc8Rd 8iVkp6AS3pCNpAYr+fmoBUw4RTLeen2FbNSEuIkrYp6kViUhkQ/ZgGUhvyYUJCxj R8J1hQcp0EuapEvex9mgA8W+BmpOGRhQOc4QY2fyNg0XsatqiFIslyvfx03Ip05z B1Xbpj5tLh05lHYvHgp05O2tZ4hM+T1ujUJamgIZq0hq4XG/OgyNCV7CFidQh3yr ei/J3M23V+8H6VwBHMB2+u/SpUahQHzSr4xrbzvmDy/vCMfh0ohqBgy9NSO7WyOb snfCd9BecxJIkxuXVt5fvvAopUkMeJ+oerLzl0/AqxX6NzTDQ8QZ40k1mi24dwRf LB6aEgkrJAMDAggBAQsDAwRAV1i+YgVoDSOsy2MG/lF2vshFFQOy1hiaCAeC6cpJ udhFy4mSJ0NTezETvAiCsd1XiAww6ABreO6A4USRrBfnOq5eVNEZ6CK8v+WxYFgV P4lklQik0R9ijv2CWDhCFN0DAQkJiQG2BBgBCAAgFiEElKXJoDwv5co7CV2OH99y PPRitrEFAl8sHvoCGwwACgkQH99yPPRitrFS0gv/QxfTBAlVlwrwnpFvFjSCWT8X /bp4vPaDoGpwhzytEyfsgxVD39+Y+8WZY03o3oOrf0iyV7R+Fvv8U0CZ6FOEKDQ0 X//bXxshudanpt6cXVEM9fCTMP025YQAD4UJPrmoW4Y+/Rle41BvNxrycJILDLO4 kR9OPCcu60ZPqrGeF650LKmzRDMoljH61+4z0Re9Kg6Yogncch78VTxbal6t357K QP1jdGeGJFQUx+tTv3RtT1bXgc6iTdAplcRbEsaAG8GgSiuyor44hcScSoIFI83h s8v9+KCo5ozXEg+j4pQwjowVI1OcfVHcIGiDcHNNt0YmJ37ccvu/cD3FDCdLDKYo 2Fmm87mMTU4C773ly6lSu9WBHg3bAdjzuz6xkZFFJCurJMhhCQaC4YfFV5LMoAgt 5/N1N7OiOhKa0KMX7EHDPf/wWVyKY2pPhWq88sJ5sqpszTusj/wm8MLwL+zX+pC4 BOBs8EoTbabILrR4+PdsZHfJsufTmN6nqwn6C1bRAAoJEO8gViq/MpDmBbEBf1TA 6ZP7pgTdZ2DKZyYbkzMDLW3UzIxeOxdeKAciQhzwsKisluWPa4CpYefGVuShFAF/ YJW8QqVzeNvVWS29slg/GNpr5ok7bmoRgDb19+Z3/yE7pcao+JEKMj2BPpZWlY7n =lA61 -----END PGP SIGNATURE----- --nextPart2524963.Sgy9Pd6rRy--