NVIDIA’s Neural Texture Compression - 90% Less VRAM Usage

[Dicehunter]

Doubt it'll be implemented soon but could do wonders for low VRAM cards.

NVIDIA’s Neural Texture Compression, Combined With Microsoft’s DirectX Cooperative Vector, Reportedly Reduces GPU VRAM Consumption by Up to 90%

NVIDIA's RTX NTC has seen massive improvements with Microsoft's DirectX 1.2, and the latest tests show a gigantic drop in VRAM consumption

wccftech.com

 

[Raelgun]

Compression means loss of image quality

 

[Armageus]

Compression means loss of image quality

Not necessarily.

Does 7zip lose information when you compress things?

Does mp3 or jpeg loose noticeable quality (when used at sensible settings)?

 

[Raelgun]

Not necessarily.

Does 7zip lose information when you compress things?

Does mp3 or jpeg loose noticeable quality (when used at sensible settings)?

The answer is yes .

I for one does own decent audio hardware and I use tidal instead of Spotify.

I also encode video and mess with settings.

 

[Dicehunter]

The answer is yes .

I for one does own decent audio hardware and I use tidal instead of Spotify.

I also encode video and mess with settings.

Spotify generally streams at 160kbps and then they artificially ups the bitrate to 320 for paid users which makes nearly no difference due to the music already being heavily compressed, So not really a good comparison.

The point of this tech is to reduce VRAM usage while not impacting visual quality or at the least to a point you'd find it incredibly difficult to tell the difference.

 

[Calin Banc]

Doubt it'll be implemented soon but could do wonders for low VRAM cards.

NVIDIA’s Neural Texture Compression, Combined With Microsoft’s DirectX Cooperative Vector, Reportedly Reduces GPU VRAM Consumption by Up to 90%

NVIDIA's RTX NTC has seen massive improvements with Microsoft's DirectX 1.2, and the latest tests show a gigantic drop in VRAM consumption

wccftech.com

Not only to low vRAM cards, but also enables more data to hold within the same vRAM buget of higher end cards.

 

[Armageus]

The answer is yes .

No it isn't as when you uncompress a 7zip then you get back out exactly what you started with

I for one does own decent audio hardware and I use tidal instead of Spotify.

Ah so you have focused on the mp3 part then rather than in general. However a 320Kbps MP3 produced by a modern encoder, will be indistinguishable to 99% of people compared to a lossless audio file.

In the same way that a jpeg at say 90% quality will be indistinguishable to 99% of people.


As long as neural texture compression produces results that are indistinguishable for 99% of people, that will be a huge win. Even if not just for the low end, but being able to compress much bigger textures (e.g. those needed for 8K and beyond) to sensible sizes benefits everyone, as long as the margin of error remains small.

 

[Raelgun]

No it isn't as when you uncompress a 7zip then you get back out exactly what you started with


Ah so you have focused on the mp3 part then rather than in general. However a 320Kbps MP3 produced by a modern encoder, will be indistinguishable to 99% of people compared to a lossless audio file.

In the same way that a jpeg at say 90% quality will be indistinguishable to 99% of people.


As long as neural texture compression produces results that are indistinguishable for 99% of people, that will be a huge win. Even if not just for the low end, but being able to compress much bigger textures (e.g. those needed for 8K and beyond) to sensible sizes benefits everyone, as long as the margin of error remains small.

Indistinguishable just means that's on the person.

Compression does affect quality negatively.

For audio, jumping from that crappy MP3 to 24 bit audio files is huge.

Image is the same, professional print studios want tiff files and not jpegs for this reason.

That margins become more apparent with better phepherial hardware which more people have then before.

Going from Spotify to tidal for the same modern track sounds fuller and notes distinguished on tidal.

I'm not against the use of compression, with my video editing I use it along with image editing but it needs to be the first thing to be said, compression is degradation.

 

[Raelgun]

Spotify generally streams at 160kbps and then they artificially ups the bitrate to 320 for paid users which makes nearly no difference due to the music already being heavily compressed, So not really a good comparison.

The point of this tech is to reduce VRAM usage while not impacting visual quality or at the least to a point you'd find it incredibly difficult to tell the difference.

A lot of older tracks have been stored and passed as lower quality, I get this but modern tracks aren't since they get published to these services sooner.

Not too mention more and more audio is being mastered at 24 bit audio.

My audio hardware picks up this difference.

I stand by compression is degradation, it's not the magic people think it is with no compromise.
And I will say it again, I'm not against compression but informing people what the negative is important.

 

[Armageus]

I stand by compression is degradation, it's not the magic people think it is with no compromise.

So 7zip archives are degrading the files I backup every day?



Close enough is often good enough - especially for the purpose of this topic: textures.

Does it actually matter if when the texture is "recreated" using AI, that a couple of pixels have RGB values that are off by single digits?



I could almost agree with you that differences in Audio files are more easily noticed, but then you rolled out the Audiophile bingo card with things like "fuller" and "distinguished"

 

[Dicehunter]

So 7zip archives are degrading the files I backup every day?



Close enough is often good enough - especially for the purpose of this topic: textures.

Does it actually matter if when the texture is "recreated" using AI, that a couple of pixels have RGB values that are off by single digits?



I could almost agree with you that differences in Audio files are more easily noticed, but then you rolled out the Audiophile bingo card with things like "fuller" and "distinguished"

Cousin of mine is an audiophile, I swapped out 1 of the albums he was listening to regularly that was "super mega high bit rate mega super" for one that was 320kbps and he didn't notice until I said something a year later

The amount of BS the audiophile community comes out with is quite entertaining

 

[G J]

If a game can implement this and it looks close to high/medium textures and has the hardware requirements of low textures I dont see what the problem is. Even better if its something the can be enabled or disabled from in game or the driver control panel to keep the purists happy.

 

[dave28]

Cousin of mine is an audiophile, I swapped out 1 of the albums he was listening to regularly that was "super mega high bit rate mega super" for one that was 320kbps and he didn't notice until I said something a year later

The amount of BS the audiophile community comes out with is quite entertaining

The thing with audiophiles is most of them are half deaf from loudspeakers, i do think i can tell mp3 from flac music but i never tried a blind test to see

 

[Dicehunter]

The thing with audiophiles is most of them are half deaf from loudspeakers, i do think i can tell mp3 from flac music but i never tried a blind test to see

I've got my own FLAC collection and there's definitely a difference between mediocre quality MP3 and high bit rate music but listening to my cousin come out with all the jargon he does is like listening to a salesman in the 1800's wildwest telling you why his snake venom tonic is the best... full of BS but entertaining

 

[Alt0153]

doesnt matter cause its going to be on the smallest bus nvidia can manage on its new 6090 with 4gb vram and a 64bit bus for the low price of 5k, the more you buy the more you save

 

[Dicehunter]

doesnt matter cause its going to be on the smallest bus nvidia can manage on its new 6090 with 4gb vram and a 64bit bus for the low price of 5k, the more you buy the more you save

Don't give them ideas !

 

[deviation]

doesnt matter cause its going to be on the smallest bus nvidia can manage on its new 6090 with 4gb vram and a 64bit bus for the low price of 5k, the more you buy the more you save

Don't give them ideas !

That's fine because it will use multi multi multi multi frame generation to generate the remaining 54 of 60 frames

 

[Blackjack Davy]

Doubt it'll be implemented soon but could do wonders for low VRAM cards.

NVIDIA’s Neural Texture Compression, Combined With Microsoft’s DirectX Cooperative Vector, Reportedly Reduces GPU VRAM Consumption by Up to 90%

NVIDIA's RTX NTC has seen massive improvements with Microsoft's DirectX 1.2, and the latest tests show a gigantic drop in VRAM consumption

wccftech.com

Translation: locked into Nvidia infrastructure and expect more low Vram cards in future to maximise profits

 

[robj20]

Compression means loss of image quality

Not always, lossy Vs lossless compression is a thing.
The trade off is usually the need for processing power to uncompress on the fly.

 

[wunkley]

Hmm. Believe it when I see it. Go to do something to allay my doubts going from a 3090 to a 5080. I am missing that additional 8GB in modded Skyrim VR. If I didn't do VR, 16GB is plenty though.