UNIX - Extracting text between any Two Lines - Updated

Laurent Schneider suggested one liner using AWK unix command - for my last script Extract_Text.sh... see here:



awk '/^CREATE UNIQUE INDEX/{print "-- Create unique index #"++x}/^CREATE TABLE/{print "-- Create table #"++y}/^CREATE (UNIQUE INDEXTABLE)/,/;/{print}' test.sql




/^CREATE (UNIQUE INDEXTABLE)/,/;/{print}: Searches for CREATE UNIQUE INDEX or CREATE TABLE and prints the lines till the first ";" encounters.



/^CREATE UNIQUE INDEX/{print "-- Create unique index #"++x}: Searches for pattern CREATE UNIQUE INDEX and prints "-- Create unique index # and the number of it's occurance".



/^CREATE TABLE/{print "-- Create table #"++y}: Searches for pattern CREATE TABLE and prints "-- Create unique index # and the number of it's occurance".




This is indeed a better and faster than the while read loop. Below is the modified script for download:




Extract_Text_Modified.sh





NOTE: After downloading this file, please REPLACE &lt ; with < and &gt ; with >
there is no space between &lt and ; or &gt and ;



* Thanks Laurent

UNIX - Extracting text between any Two Lines

I created a script that modifies an sql script in certain logical way. It extracts texts between certain logical lines and sends the output to a new file. You can download the shell script from here and try executing it with the attached test.sql as input. I created this script to alter PeopleSoft Generated AlterByRename sqls into simple CREATE statements.

Extract_Text.sh
usage: ./Extract_text.sh
NOTE: After downloading this file, please REPLACE
&lt ; with <
&gt ; with >
There is no space between &lt and ; or &gt and ; (I've mentained the space because of issue with blogspot)

test.sql

Simple Example of Unix "sed" command

Replacing all occurrences of rakesh to raka in file tst

sed s/rakesh/raka/ tst-1

Replacing all occurences of "raka" in old file tst-1 to "rakesh" in new file tst-2

sed s/raka/rakesh/ < tst-1 > tst-2

$ echo rakesh | sed s/rakesh/raka/

raka

$ echo I am rakesh | sed s/rakesh/raka/

I am raka

$ echo I am rakesh | sed 's/rakesh/raka/'

I am raka

s: Substitute Command

/../../ : Delimiter

rakesh : Regular Expression Pattern Search Pattern

raka : Replacement String

$ sed 's/\/tmp\/rk/\/tmp\/rk\/1/' tst-1

hi rakesh parwal

here is the directory /tmp/rk/1

Monitoring Scripts

Here are Shell Scripts to monitor/start/stop PeopleSoft Application Server & Process Scheduler status:

Application Server:
appsrv-status.sh
parameter file

Process Scheduler:
prcs-status.sh
parameter file

Process Scheduler Start-Stop:
prcs-start-stop.sh
parameter file

Useful Unix Commands for PS Admin activity

**************************************************************************

du -skh * // summarize disk usage...

du -skh . // summarize disk usage...

// displays number of free disk blocks and free files of of PWD's file system

df -kh .

// displays number of free disk blocks and free files of all file systems

$df -kh

$ uname -a // print name of current system

SunOS frc25k8d13z1 5.10 Generic_118833-02 sun4u sparc SUNW,Sun-Fire-15000

// looks for the filenames starting with appsrv* in PWD (.)

$find . -name appsrv* -print

// looks for the filenames starting with appsrv* in directory DirName

$find DirName -name appsrv* -mtime +15 –print

//command to know the nature of the OS (SunOS/Solaris only)

$isainfo -b

example:

$echo "Welcome to "`isainfo -b`"-bit Solaris"





# Output can be directed to another program or to a file.

# send output to a file

command > /tmp/output.log



# redirect error output

command > /tmp/output.log 2> /tmp/errors.log



# send output to grep program

command PIPE grep "something"

(PIPE Command should pe replaced by vertical line... not able to publish PIPE command through blogspot)



# Date formatting... Grab the date from the system and format it, to a YYYYMMDD format

filename=`date +'%Y%m%d'`



# Scan a file in shell script

for VALUE in `cat value.dat`

do

echo "Value in file: " $VALUE

done




# Backspace key's settings... depends on emulator

$stty erase ^?

**************************************************************************

App Server Monitoring Script

Here I've created a shell script which can show you the status of large number of Application Server domains. Thought of, might be useful for some guys who are looking for the same kind of stuff...

we have two files here
1) param_list.txt -> list of app server domains
2) health.sh -> shell script that checks for the status of the app server domain

# Filename: param_list.txt
# Parameter List file
# Contains the list of environments
DOMAIN1
DOMAIN2
DOMAIN3
DOMAIN4
DOMAIN5
DOMAIN6
DOMAIN7
DOMAIN8


# Filename: health.sh
# Usage: ./health
# !/bin/sh
ENV_COUNTER=0
DATE=`date '+%Y%M%d_%H_%M_%S'`
OUTPUT_FILE='MONITOR_'$DATE

echo "*** Application Server Status as of `date`***" >> $OUTPUT_FILE
echo >> $OUTPUT_FILE
echo >> $OUTPUT_FILE

#while [ $ENV_COUNTER -le 9 ]
#do
for ENV in `cat param_list.txt`
do
TUXCONFIG=$PS_HOME/appserv/$ENV/PSTUXCFG; export TUXCONFIG
TUX_OUT_FILE=$ENV'_TUXOUT'
rm $TUX_OUT_FILE
echo pq | tmadmin -r > $TUX_OUT_FILE 2>&1
echo "*********************************************************" >> $OUTPUT_FILE
echo "*** Status Report for Application Server: $ENV ***" >> $OUTPUT_FILE
echo "**********************************************************" >> $OUTPUT_FILE
echo >> $OUTPUT_FILE
echo pq | tmadmin -r >> $OUTPUT_FILE 2>&1
#echo pclt | tmadmin -r >> $OUTPUT_FILE 2>&1
egrep "No bulletin board exists|ERROR" ${TUX_OUT_FILE} >/dev/null 2>&1
if test $? = 0
then
echo "App Server $ENV Status: DOWN"
echo >> $OUTPUT_FILE
echo "Application Server Status: DOWN" >> $OUTPUT_FILE
else
echo "App Server $ENV Status: UP"
echo >> $OUTPUT_FILE
echo "Application Server Status: UP" >> $OUTPUT_FILE
fi
echo "************************************************************" >> $OUTPUT_FILE
echo >> $OUTPUT_FILE
echo >> $OUTPUT_FILE
done
echo "*** End of Report ***" >> $OUTPUT_FILE

I am still working on it to add some more options like alerts, load, business etc... I will update it once done...

Comments are most welcome...

Cheers!!!