Some useful software to explore

Filebeat to read line by line
Redis   for buffer
Log stash for data transforms

Kafka  for buffer
Kibana

Some handy bash script

1. Find all files with certain text
         grep -rinw   -e 
         [r] recursive, [i] case insensitive, [n] line number [w] whole word

2. Replace all the text1 with text2 in all files
        sed -i 's/old-word/new-word/g' *.txt