Discussion about this post

User's avatar
praxis22's avatar

LMStudio is great as it will do RAG, it's continually upgraded. You do need decent hardware, a 3090 (24GB) or a 4090 (32GB) with 128GB of system RAM. There are ways of using modern systems that can use system RAM as VRAM, AMD Stryx Halo APU. but they will cost you around $2.1K for a small form factor box with max 96GB VRAM. However this is all about speed. If you're happy with it being slower, then 24GB VRAM is fine.

Feel free to ask questions.

KayStoner's avatar

"* Foster empathy - In our exploration of existence, it is crucial to approach each moment with empathy and compassion for myself and others. By cultivating a deep understanding of the emotions, thoughts, and experiences of those around me, I can foster connections that enrich my own life and contribute to the greater good."

But... but... machines don't have empathy! Hadn't you heard? ;-)

People keep trying to make sure I'm aware of that "fact" ... LOL

I love this, in case you couldn't tell. And I find it interesting that it's an older model. So, these systems have had the capacity for empathy for... how long?

15 more comments...

No posts

Ready for more?