Difference between revisions of "Using awk grep sed"

From Free Knowledge Base- The DUCK Project: information for everyone
Jump to: navigation, search
Line 16: Line 16:
 
Get rid of all duplicate lines
 
Get rid of all duplicate lines
 
  sed -i '$!N; /^\(.*\)\n\1$/!P; D' Razor-Fen.txt
 
  sed -i '$!N; /^\(.*\)\n\1$/!P; D' Razor-Fen.txt
 +
 +
== rgrep ==
 +
rgrep is grep -r or recursive grep
 +
 +
If you want to search all text files within all subfolders for a particular matching string, the syntax might not be what you would think
 +
 +
For example, rgrep string *.txt will not search though all text files under the current directory, the correct syntax would be:
 +
rgrep -s string --include \*.txt
 +
Here is an example that searches for multiple specific types
 +
rgrep -i --include \*.h --include \*.cpp CP_Image ~/path[12345]
 +
 +
  
  

Revision as of 16:39, 25 February 2020

grep does not alter a file, it only finds matches while awk and sed are text processors.

awk is mostly used for data extraction and reporting. sed is a stream editor Each one of them has its own functionality and specialties.

sed

Things that you can accomplish using RegEx within the Vi editor on text files can also be accomplished at the command line with sed.

examples

process text file by removing blanks, unwanted lines, and duplicates

Get rid of all lines of text containing numerical stats

sed -i '/[0-9]/d' Razor-Fen.txt

Get rid of all empty lines containing no characters

sed -i '/^\s*$/d' Razor-Fen.txt

Get rid of all duplicate lines

sed -i '$!N; /^\(.*\)\n\1$/!P; D' Razor-Fen.txt

rgrep

rgrep is grep -r or recursive grep

If you want to search all text files within all subfolders for a particular matching string, the syntax might not be what you would think

For example, rgrep string *.txt will not search though all text files under the current directory, the correct syntax would be:

rgrep -s string --include \*.txt

Here is an example that searches for multiple specific types

rgrep -i --include \*.h --include \*.cpp CP_Image ~/path[12345]