Associate
Does a tool exist which when provided with a website URL will span the ENTIRE website and its pages to pull all words in to a list format? A bonus would be also showing frequency of those words too.
Website URL Word Counter / Lister
- Thread starter oHUTCHYo
- Start date
You could look into Web Scraping https://en.wikipedia.org/wiki/Web_scraping loads of tools out there that will do it, you could pay for a service or build your own. You could then do a search on a particular word from the outputted data for frequency etc.
This site https://wordcounter.net/website-word-count gives a word frequency but it is on a page by page basis rather than whole website
The R programming language might be a good place to look also - " R is used among data miners and statisticians for data analysis "
And this looks like a good place to start - https://stackoverflow.com/questions...tent-and-then-count-frequencies-of-words-in-r
or using Python
https://www.geeksforgeeks.org/python-program-crawl-web-page-get-frequent-words/
And this looks like a good place to start - https://stackoverflow.com/questions...tent-and-then-count-frequencies-of-words-in-r
or using Python
https://www.geeksforgeeks.org/python-program-crawl-web-page-get-frequent-words/
Thanks, yes this is very much what I need but as you say is page specific. Love how it splits common/non-common words too.