The views expressed in this blog are those of the owner and do not reflect the views or opinions of the owner’s employer. All content provided on this blog is for informational purposes only. The owner of this blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site. The owner will not be liable for any errors or omissions in this information nor for the availability of this information. The owner will not be liable for any losses, injuries, or damages from the display or use of this information. This policy is subject to change at any time. The owner is not an attorney, and nothing posted on this site should be construed as legal advice. Litigation Support Tip of the Night does not provide confirmation that any e-discovery technique or conduct is compliant with legal, regulatory, contractual or ethical requirements.
Running the regular expression search:
\S+\s*$
. . . in a text editor like NotePad++ will generate a count of the number of non-empty lines in a text file. The number of hits will be shown in the results pane below the transcript.
In order to get a count of the number of empty lines you can run this RegEx search: ^\s*$
. . . but note that it will count consecutive lines with only whitespace as a single line.
Tonight's tip features a regular expression script created by The fourth bird of the Netherlands on stack overflow. I posted looking for a regular expression that would find the text on a line repeated from the prior line after a time code at the beginning of the both lines that might be different. See this example:
(11:12:21) [Tom]: Hello this is Tom. Who is it?
(11:14:08) [Tom]: Hello this is Tom. Who is it?
The goal was to find when consecutive lines were the same after the first 10 characters. The fourth bird came up with a solution that would find when parts of two lines matched. In a text editor like NotePad++ run this find and replace search:
FIND: ^(\([^][]*\))(.*)(?:\r?\n\([^][]*\)\2)+
REPLACE: $1$2
^(\([^][]*\)) will find the first part of the string - the time code in parentheses. So the caret ^ matches the beginning of the line, and the rest then finds the rest of the text between the parentheses.
(.*) matches to the end of the line after the parenthetical information at the beginning.
(?:\r?\n this then matches a new group on a new line
\([^][]*\) this matches from the first part of the previous line.
\2)+ this then matches with the second part of the previous line.
As you can see in this demonstration a find and replace in the text editor can easily remove the duplicate lines.
You can run a Regex search which will find consecutive lines that begin with the same characters. This search:
^((.{10}).*)(?:\r?\n\2.*)+
. . . will check the first 10 characters at the beginning of a line and check to see if the same 10 characters appear at the start of the next line.
. . . adding $1 in the replace window will remove each duplicate line.
