Does the "deep web" really exist?

well, according to my famously unreliable computer science lecturer, only about 16% of the internet is indexed by google, so its quite possible that this deep web exists.

however, if you've been in the CPU section recently, you'll know how reliable a source of info he is
 
of course there's vast swathes of the net that isn't indexed by google :confused:
they can generally be accessed by knowing the URL to them... not sure why you're talking about it like it's some great mystery. It's quite easy to prevent your site being indexed by search engines.
 
If the definition of "Deep Web" is sites that can't be indexed by search engines, then yes of course it exists.

It sounds more like you're trying to put a sinister spin on something that is in all reality a) a fairly easy occurence (eg pages that aren't search engine indexible) and b) fairly innocent.
 
platypus said:
If the definition of "Deep Web" is sites that can't be indexed by search engines, then yes of course it exists.

It sounds more like you're trying to put a sinister spin on something that is in all reality a) a fairly easy occurence (eg pages that aren't search engine indexible) and b) fairly innocent.
Click to expand...

Indeed, it's easy enough for a website to have robots.txt set up so that the site is not indexed...
 
Abraham said:
of course there's vast swathes of the net that isn't indexed by google :confused:
they can generally be accessed by knowing the URL to them... not sure why you're talking about it like it's some great mystery. It's quite easy to prevent your site being indexed by search engines.
Click to expand...

It's more than a server + web address that isn't indexed. There's massive P2P networks that exist off the radar where huge volumes of messageboards and filesharing (think viruses, botnet details, etc) exist. These aren't indexable 'servers'. Look up 'freenet' for the most well known 'darknet' network.

Two uni dons wrote a paper on this a couple of years ago which I'll have a guggle for.
 
Waits for the conspiracy theorists to turn up and tell us the “Deep Web” is part of a plot to control the world.
 
simulatorman said:
Waits for the conspiracy theorists to turn up and tell us the “Deep Web” is part of a plot to control the world.
Click to expand...

It's actually a fantastic way to distribute free media to oppressed countries such as China and Iran. For example, one of the most prominent 'sites' on freenet was (not sure if it still exists) was a place where those supporting democratic change and free speech shared ideas and organised meetings and rallies.
 
joxang said:
It's more than a server + web address that isn't indexed. There's massive P2P networks that exist off the radar where huge volumes of messageboards and filesharing (think viruses, botnet details, etc) exist. These aren't indexable 'servers'. Look up 'freenet' for the most well known 'darknet' network.

Two uni dons wrote a paper on this a couple of years ago which I'll have a guggle for.
Click to expand...
Plus there's the scene, only the products of which are publicly available (it's amazing how many people unknowingly have content that originates in the scene) ;)
 
Of course it exists and is very easy to access if you have the tools, as said above though it is still IP traceable and because of it's secretive nature you tend to get the scum of the world hanging out there,

I heard about it a while back so researched to see what the fuss was about, I found a hidden page once that could only be connected to through certain proxies and on the very front page there were link to buy drugs of all kinds, and pornography that is openly illegal, the page I found was only a bunch of links and I didn't click any so no idea if they actually worked but it was enough to make me not go any deeper and stopped looking into it
 
You must log in or register to reply here.
Back
Top Bottom