Friday, September 13, 2024

Get A Powerful AI Assistant with Document Chat Accelerated by AMD Ryzen AI and Radeon GPUs


AMD and its partners are committed to enabling next-generation AI experiences on AI PCs, and LM Studio is one powerful example. LM Studio is quickly becoming a must-have AI tool and offers a completely offline, highly capable, AI assistant that can help you with many day-to-day tasks.

 

LM Studio 0.3, featuring both AMD Ryzen AI processors and AMD Radeon graphics acceleration, is now available. It features a revamped user experience, easy installation and setup, and is fully equipped out of the box to help maximize your productivity with optimal performance. Whether you are a student or a business professional – offline AI assistants can help you go the distance.

 

To try it out, please head over to LMStudio’s RyzenAI portal (lmstudio.ai/ryzenai) and click:

AMD_AI_0-1724352928486 (Image 2).png

 

One major new feature is easy-RAG (Retrieval Augmented Generation). RAG allows you to increase the knowledge base of your personal AI assistant using your own documents and answer questions specific to those documents.

 

While previously this was only possible by setting up complicated end points, you can now do this with the new version of LM Studio out of the box. Please note that running RAG on a document is a very compute-intensive process and can take a very long time to complete if your document is large.  

To run LM Studio 0.3 just follow the simple steps:

1.     Install LM Studio 0.3

2.     Select the Microsoft Phi 3.1 model from the drop down menu at the top.

3.     Begin chatting!

 

Whether you are on the go with an AMD Ryzen AI laptop or working on an AMD AI PC powered by AMD Radeon graphics cards – AMD hardware acceleration will make sure your LM Studio experience is optimal. The new user experience is also context aware, so if you start writing code, it will automatically and smartly shift to markdown view, making it easier for developers to understand code.


Older generations of AMD hardware are also supported in LM Studio (performance will vary) through the Vulkan inferencing engine backend. Advanced users can also opt for model to use with LM Studio and try out various state-of-the-art open models like Microsoft Phi 3.1, Meta Llama 3.1, and Mistral Nemo.

 

LM Studio 0.3 is optimized for the following hardware:

 

AMD Ryzen AI Laptops

AMD Radeon Discrete Graphics

AMD Ryzen AI 300 Series processors (recommended)

AMD Ryzen 8040 Series processors

AMD Ryzen 7040 Series processors

AMD Radeon RX 7000 Series

 

As the pace of innovation in AI increases, AMD is committed to bringing its customers the latest and greatest AI tools to enable them to succeed. We are continuing to work on further optimizing Large Language Models (LLMs) for the ultimate AI chatbot experience and will bring future consumer-friendly updates through our partnership with LM Studio.2wffr$f$

 

Endnotes:

GD-97 - Links to third party sites are provided for convenience and unless explicitly stated, AMD is not responsible for the contents of such linked sites and no endorsement is implied.

 

GD-220c - Ryzen AI is defined as the combination of a dedicated AI engine, AMD Radeon graphics engine, and Ryzen processor cores that enable AI capabilities. OEM and ISV enablement is required, and certain AI features may not yet be optimized for Ryzen AI processors. Ryzen AI is compatible with: (a) AMD Ryzen 7040 and 8040 Series processors except Ryzen 5 7540U, Ryzen 5 8540U, Ryzen 3 7440U, and Ryzen 3 8440U processors; (b) AMD Ryzen AI 300 Series processors, and (c) all AMD Ryzen 8000G Series desktop processors except the Ryzen 5 8500G/GE and Ryzen 3 8300G/GE. Please check with your system manufacturer for feature availability prior to purchase.


No comments:

Post a Comment