Revolutionizing AI with Nvidia’s Chat with RTX
In the realm of cutting-edge technology, Nvidia is paving the way for a new era of artificial intelligence innovation. Introducing “Chat with RTX,” a revolutionary tool that allows users to harness the power of AI right on their personal computers. While the concept of running AI locally is not entirely new, Nvidia’s initiative aims to streamline the process and make it more accessible to the masses.
A Glimpse into the World of AI
Powered by consumer-grade graphics cards, Chat with RTX is a text-based AI model that leverages a vast database of public text documents curated by Nvidia. While the model demonstrates proficiency in generating text, its knowledge base is limited, serving as a testament to the reliance of large language models on extensive data inputs. For instance, it can craft intricate limericks about printed circuit boards but struggles with basic historical inquiries.


Source: Michael Crider/Foundry
Empowering Users to Customize AI
Users have the option to enhance Chat with RTX’s capabilities by providing additional text sources for it to learn from. By directing the AI to folders containing .txt, .pdf, and .doc files, users can tailor its knowledge base to suit their specific requirements. This functionality proves invaluable for individuals scouring vast amounts of text for contextual insights.


Caption: My graphics card engaged in intensive processing tasks.
Source: Michael Crider/Foundry
Exploring the Boundless Potential
While the prospect of leveraging AI holds immense promise, practical implementation may pose some challenges. Running the beta version of Chat with RTX necessitates Windows 10 or 11 and an RTX 30- or 40-series GPU with a minimum of 8GB of VRAM. Moreover, the substantial 35GB download size coupled with server congestion could test the patience of eager users seeking to delve into the realm of AI.
For enthusiasts eager to explore the capabilities of AI within their own computing environments, Nvidia’s Chat with RTX serves as a beacon of innovation in the evolving landscape of artificial intelligence.

