RTX chatbot

[Nexus18]

 

[Nexus18]

Looks interesting, will definitely check it out later. Did this come out of the blue or had NVIDIA announced they were releasing it?

First I heard/seen of it so seems like out of the blue.

 

[Nexus18]

I haven’t looked at it yet but what data are you providing to them? It looks like their main point in the video is it runs locally.

Exactly....

NVIDIA ChatRTX

Your Personalized AI Chatbot.

www.nvidia.com

Say What? Chat With RTX Brings Custom Chatbot to NVIDIA RTX AI PCs

New tech demo gives anyone with an NVIDIA RTX GPU the power of a personalized GPT chatbot, running locally on their Windows PC.

blogs.nvidia.com

Since Chat with RTX runs locally on Windows RTX PCs and workstations, the provided results are fast — and the user’s data stays on the device. Rather than relying on cloud-based LLM services, Chat with RTX lets users process sensitive data on a local PC without the need to share it with a third party or have an internet connection.

 

[Nexus18]

What you're seeing here is just a proprietary implementation of open source LLMs, which by their own marketing, are to be used with online accessible material, as without large amounts of data no model is useful.
If you truly think there won't be a metric ton of telemetry embedded then I've got a great deal for a fountain in Rome to sell you...

The whole point of this is to keep your data private.... Have you watched the video, read the documents? You have to link/upload the .pdf, .txt etc. to the tool as the source of information in order for it to work. And it works without an internet connection so how can your data be uploaded if there is no internet connection available?

If there is any sign of any your data being fed back, developers will find out and call it out:

GitHub - NVIDIA/trt-llm-rag-windows: A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM - NVIDIA/trt-llm-rag-windows

github.com