Using awk grep sed

Revision as of 13:59, 14 January 2020 by Admin (Talk | contribs)

grep does not alter a file, it only finds matches while awk and sed are text processors.

awk is mostly used for data extraction and reporting. sed is a stream editor Each one of them has its own functionality and specialties.

sed

Things that you can accomplish using RegEx within the Vi editor on text files can also be accomplished at the command line with sed.

examples

process text file by removing blanks, unwanted lines, and duplicates

Get rid of all lines of text containing numerical stats

sed -i '/[0-9]/d' Razor-Fen.txt

Get rid of all empty lines containing no characters

sed -i '/^\s*$/d' Razor-Fen.txt

Get rid of all duplicate lines

sed -i '$!N; /^\(.*\)\n\1$/!P; D' Razor-Fen.txt
Last modified on 14 January 2020, at 13:59