wordpress blog stats
Connect with us

Hi, what are you looking for?

NVIDIA launches an AI chatbot that you can run locally on your PC

The chatbot allows users to add YouTube links and integrate the knowledge from those videos into its knowledge for contextual queries.

Image source: NVIDIA press release

NVIDIA on February 13 released a new AI chatbot called Chat with RTX that you can download and run locally on your Windows computer. The chatbot is powered by open-source AI models like Mistral or Meta’s Llama 2 for general responses, but, more notably, users can also connect their own documents and get summaries and other contextual answers based on these files.

“Rather than searching through notes or saved content, users can simply type queries. For example, one could ask, ‘What was the restaurant my partner recommended while in Las Vegas?’ and Chat with RTX will scan local files the user points it to and provide the answer with context,” NVIDIA explained.

The chatbot also allows users to add YouTube links and integrate the knowledge from those videos into its knowledge for contextual queries. “For example, ask for travel recommendations based on content from favorite influencer videos, or get quick tutorials and how-tos based on top educational resources,” NVIDIA elaborated.

There are other ways to get an AI chatbot to answer queries based on your personal documents. For example, you can allow Google’s Gemini chatbot (formerly Bard) to access your Gmail, Google Docs, and Google Drive to provide answers based on content available there. You can also upload PDFs to ChatGPT Plus. But with NVIDIA’s chatbot, “rather than relying on cloud-based LLM services, Chat with RTX lets users process sensitive data on a local PC without the need to share it with a third party or have an internet connection,” NVIDIA stated.

Some caveats though: this is a demo version, so it has many bugs and issues; your PC will need to meet certain specifications including running an NVIDIA GeForce RTX 30 Series GPU or higher; and it will take tons of space and RAM on your computer.

For more on what it’s like to use Chat with RTX, check out this article by Tom Warren for The Verge where he puts Chat with RTX through various tests. “Although the app is a little rough around the edges, I can already see this being a valuable part of data research for journalists or anyone who needs to analyze a collection of documents,” Warren opined.

Also Read


STAY ON TOP OF TECH NEWS: Our daily newsletter with the top story of the day from MediaNama, delivered to your inbox before 9 AM. Click here to sign up today!


Written By

Free Reads


Tata Restart website was using the trademark of Tata Sons and the image of Ratan Tata.


The hackers used the fake Facebook ads to target people based in European countries, specially male users, said the report


GPT-4 Turbo with Vision builds upon the foundation of the GPT-4 model, integrating the enhanced token outputs introduced in the Turbo model, and now...

MediaNama’s mission is to help build a digital ecosystem which is open, fair, global and competitive.



NPCI CEO Dilip Asbe recently said that what is not written in regulations is a no-go for fintech entities. But following this advice could...


Notably, Indus Appstore will allow app developers to use third-party billing systems for in-app billing without having to pay any commission to Indus, a...


The existing commission-based model, which companies like Uber and Ola have used for a long time and still stick to, has received criticism from...


Factors like Indus not charging developers any commission for in-app payments and antitrust orders issued by India's competition regulator against Google could contribute to...


Is open-sourcing of AI, and the use cases that come with it, a good starting point to discuss the responsibility and liability of AI?...

You May Also Like


Google has released a Google Travel Trends Report which states that branded budget hotel search queries grew 179% year over year (YOY) in India, in...


135 job openings in over 60 companies are listed at our free Digital and Mobile Job Board: If you’re looking for a job, or...


By Aroon Deep and Aditya Chunduru You’re reading it here first: Twitter has complied with government requests to censor 52 tweets that mostly criticised...


Rajesh Kumar* doesn’t have many enemies in life. But, Uber, for which he drives a cab everyday, is starting to look like one, he...

MediaNama is the premier source of information and analysis on Technology Policy in India. More about MediaNama, and contact information, here.

© 2008-2021 Mixed Bag Media Pvt. Ltd. Developed By PixelVJ

Subscribe to our daily newsletter
Your email address:*
Please enter all required fields Click to hide
Correct invalid entries Click to hide

© 2008-2021 Mixed Bag Media Pvt. Ltd. Developed By PixelVJ