Search Within Files

Danger Phoenix · 9 Mar 2011 at 12:34

Does anyone know of a program that will allow me to search within a bunch of text files for any words in a list which are stored in another text file?

SiriusB · 9 Mar 2011 at 12:55

Do you need to know just which files contain those words, or do you require more info?

Danger Phoenix · 9 Mar 2011 at 14:27

I basically want to end up with a list of words which are not in any of those files

anything I don't mind · 9 Mar 2011 at 14:43

windows grep

SiriusB · 9 Mar 2011 at 17:42

Powershell!

get-wordmatches.ps1

Code:

param(
[Parameter(Mandatory = $true, Position = 0)]
[string]$directory,
[Parameter(Mandatory = $false, Position = 1)]
[string]$wordFile = "C:\Scripts\files\words.txt"
)
$words = get-content $wordFile
$regex = "(?i)" + ($words -join "\b|") + "\b"
$matched = get-childitem $directory -filter *.txt | get-content | foreach {[regex]::matches($_, $regex)} | %{ $_.Groups[0].Value } | select -Unique
$not_matched = @()
foreach($word in $words)
{
    if($matched -notcontains $word)
    {   $not_matched += $word }
}

Write-Host "`nSearching all text files found in '$directory' for the words:"
Write-Host "`n$words" -fore cyan

Write-Host "`n`nWords Found" -fore green
Write-Host $matched 

Write-Host "`nWords NOT Found" -fore red
Write-Host $not_matched

Danger Phoenix · 9 Mar 2011 at 22:36

Cheers for that SiriusB. I will give it a try when I get to work tomorrow

SiriusB · 9 Mar 2011 at 22:49

I assume you have used PowerShell before. If not let me know and I will write the couple of steps you need to do. I would link to a post where ive explained it before, but can't find any!

MikeHunt79 · 10 Mar 2011 at 03:53

Danger Phoenix said:
Does anyone know of a program that will allow me to search within a bunch of text files for any words in a list which are stored in another text file?

Notepad++ almost does this....

Danger Phoenix · 10 Mar 2011 at 06:55

SiriusB said:
I assume you have used PowerShell before. If not let me know and I will write the couple of steps you need to do. I would link to a post where ive explained it before, but can't find any!

I have never used it before, so any help would be great please

Danger Phoenix · 10 Mar 2011 at 10:04

I had to set the security to Unrestricted (found this out with a bit of Googling) and I changed it to search in *.xml files. It is running now and taking up 50% of CPU... been like that for a few minutes now, so lets see what happens

Danger Phoenix · 10 Mar 2011 at 10:36

SiriusB... I love you!

SiriusB · 10 Mar 2011 at 10:40

MikeHunt79 said:
Notepad++ almost does this....

Mine exactly does this!

Danger Phoenix said:
I had to set the security to Unrestricted (found this out with a bit of Googling) and I changed it to search in *.xml files. It is running now and taking up 50% of CPU... been like that for a few minutes now, so lets see what happens

If you want to improve the security of your computer slightly, you can set

Code:

Set-ExecutionPolicy RemoteSigned

Which only lets scripts created locally run unless it has been digitally signed.

50% CPU :eek:

How many files did it have to go through?

Danger Phoenix said:
SiriusB... I love you!

Danger Phoenix · 10 Mar 2011 at 10:55

There were about 500 files... and after 5 minutes of processing it was done. I only have a 3GHz Pentium 4 CPU at work, so it would have been a lot faster if it was any good. I also set it to output the results to a text file.

You have saved me about 2 days of work, because I do not have to run a search for each of the 200 words manually

SiriusB · 10 Mar 2011 at 11:09

I am glad it helped. Also, don't tell your boss you did it in 5 minutes! You have two days to slack off now!