Website URL Word Counter / Lister

[oHUTCHYo]

Does a tool exist which when provided with a website URL will span the ENTIRE website and its pages to pull all words in to a list format? A bonus would be also showing frequency of those words too.

 

[roccles]

You could look into Web Scraping https://en.wikipedia.org/wiki/Web_scraping loads of tools out there that will do it, you could pay for a service or build your own. You could then do a search on a particular word from the outputted data for frequency etc.

 

[roccles]

This site https://wordcounter.net/website-word-count gives a word frequency but it is on a page by page basis rather than whole website

 

[roccles]

The R programming language might be a good place to look also - " R is used among data miners and statisticians for data analysis "

And this looks like a good place to start - https://stackoverflow.com/questions...tent-and-then-count-frequencies-of-words-in-r

or using Python

https://www.geeksforgeeks.org/python-program-crawl-web-page-get-frequent-words/

 

[oHUTCHYo]

This site https://wordcounter.net/website-word-count gives a word frequency but it is on a page by page basis rather than whole website

Thanks, yes this is very much what I need but as you say is page specific. Love how it splits common/non-common words too.