[AccessD] LM Studio

[John Colby]

Well this is working.  I have Meta Llama 3 instruct 7B Q2_K GGUF running on
my 8 core 16 thread AMD processor with 64gB RAM.  I have the 70B model
downloading. Interesting stuff.  The 7B model will not answer when the
training cut off date is.  I.e. it is trained and runs totally locally
(supposedly).   Supposedly it does not reach out to the servers to get data
for its answers to my questions.

On Wed, Jul 31, 2024 at 8:10 PM John Colby <jwcolby at gmail.com> wrote:

> Is anyone out there playing with AI LLMs running on your own hardware?  I
> finally found a way to get it running using something called LM Studio
> which is essentially an app written in Visual Studio code which handles the
> details for me. We shall see.  It looks good so far.
>
> LM Studio Youtube channel <https://www.youtube.com/watch?v=4fdZwKg9IbU>
>
> --
> John W. Colby
> Colby Consulting
>


-- 
John W. Colby
Colby Consulting