Nvidia’s new app will let you run an AI chatbot on your RTX-powered PC
Chat with RTX can sum up long documents and YouTube clips
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
Nvidiais offering users the opportunity to try out their new AIchatbotthat runs natively on your PC called Chat with RTX.
Well, it’s not a chatbot in the traditional sense likeChatGPT. It’s more of an AI summarizer asChat with RTXdoesn’t come with its own knowledge base. The data it references has to come from documents that you provide. According to the company, their software supports multiple file formats including .txt, .pdf, .doc, and .xml. The way it works is you upload a single file or an entire folder onto Chat with RTX’s library. You then ask questions relating to the uploaded content or have it sum up the text into a bize-sized paragraph.
AsTheVergepoints out, the tool can help professionals analyze lengthy documents. And because it runs locally on your PC, you can ask Chat with RTX to process sensitive data without worrying about any potential leaks.
The software can also summarizeYouTubevideos. To do this, you’ll need to first change the dataset from Folder Path toYouTubeURL then paste said URL of the clip into Chat with RTX. It’ll then transcribe the entire video for the app to use as its knowledge base. URLs for YouTube playlists can be pasted as well. You can also list out how many videos are in the playlist. Regardless, the software will transcribe everything as normal.
Rough around the edges
Keep in mind Chat with RTX is far from perfect. As TheVerge puts it, “the app is a little rough around the edges”.
It’s reportedly pretty good at summarizing documents since it had “no problem pulling out all the key information.” However, it falters with YouTube videos. The publication uploaded one of their clips for Chat with RTX to transcribe. After looking through the summary, they discovered it was for a completely different video. Additionally, it doesn’t understand context. If you ask a follow-up question “based on the context of a previous question,” the AI won’t know what you’re talking about. Each prompt must be treated as a completely new one.
Requirements
The demo is free for everyone to try out, although your computer must meet certain requirements. It needs to have a GeForce RTX 30 Series or higher graphics card running on the latestNvidiadrivers, at least 8GB of VRAM, andWindows 10orWindows 11on board.
Get the best Black Friday deals direct to your inbox, plus news, reviews, and more.
Sign up to be the first to know about unmissable Black Friday deals on top tech, plus get all your favorite TechRadar content.
TheVerge claims it took about 30 minutes for Chat with RTX to finish installing on their PC which housed anIntelCore i9-14900K CPU and aGeForce RTX 4090 GPU. So even if you have a powerful machine, it’ll still take a while. The file size for the app is nearly 40GB and will eat up around 3GB of RAM when activated.
We reached out to Nvidia asking if there are plans to expand support to RTX 20 Series graphics cards and when the final version will launch (assuming there is one). This story will be updated at a later time.
Until then, check out TechRadar’s list of thebest graphics cards for 2024.
Update 02-14-2024:A Nvidia representative got back to us stating they have nothing to share regarding GeForce RTX 20-Series support. As for future upgrades, they told us Chat with RTX will remain a tech demo for now, but they’ll consider creating a final version if people really want it.
They go on to say that the demo was built on Nvidia’s open sourceTensorRT-LLM RAG developer reference projectwhich you can download from GitHub. If you’re a developer and want to improve Chat with RTX using the Tensor project on your own, you’re free to do so.
You might also like
Cesar Cadenas has been writing about the tech industry for several years now specializing in consumer electronics, entertainment devices, Windows, and the gaming industry. But he’s also passionate about smartphones, GPUs, and cybersecurity.
How to delete a character from Character AI
How to turn off Meta AI
Quordle today – hints and answers for Saturday, November 9 (game #1020)
