Adding two positive floating point numbers as strings

Interview Question

Q: Assume there are 2 numbers like 2.39 and 0.9 in string format "2.39" and "0.9". Without using any standard string-to-numeric conversion library functions, try to sum the two numbers and represent the output also as a string. Both numbers are assumed to be always positive.

n1 = "12.39"
n2 = "9.999"

(a, b) = n1.split('.')
(c, d) = n2.split('.')

l1 = abs(len(a) - len(c))
if len(a) > len(c):
    c = ''.join(['0'] * l1) + c  # 0000...
else:
    a = ''.join(['0'] * l1) + a

l1 = abs(len(b) - len(d))
if len(b) > len(d):
    d = d + ''.join(['0'] * l1)
else:
    b = b + ''.join(['0'] * l1)

M = '0'+ a + "." + b # Overflow of carry possible - padding with leading zero
N = '0'+ c + "." + d # Overflow of carry possible - padding with leading zero

print("->", M, N)

OUTPUT = []
carry = 0
for i in range(len(M) - 1, -1, -1):
    if M[i] == '.':
        OUTPUT.append('.')
        continue
    else:
        tmp = carry + (ord(M[i]) - 48) + (ord(N[i]) - 48)
        carry = tmp // 10
        OUTPUT.append(str(tmp % 10))

OUTPUT = OUTPUT[::-1]  # reverse the list
if OUTPUT[0] == '0':
    OUTPUT.pop(0)
print(OUTPUT[0])
OUTPUT = ''.join(OUTPUT)
print (OUTPUT)

Remote Desktop to AWS GPU instances

If you are looking to run Jupyter notebooks from AWS and leverage their EC2 instances which are compatible for GPU computing then you will invariably try to do a remote desktop connection to their Ubuntu instances using RDP or VNC viewer

1. Install VNC viewer on your windows host
2. On the EC2 GPU instance install the following:

sudo apt-get install ubuntu-gnome-desktop tightvncserver xtightvncviewer tightvnc-java  xfonts-75dpi xfonts-100dpi gnome-panel  metacity light-themes ubuntu-settings indicator-applet-complete gnome-session-flashback indicator-applet-appmenu

sudo locale-gen de_DE.UTF-8 && touch ~/.Xresources && vncpasswd

3. Ensure that the contents of your ~/.vnc/xstartup file look like this below:

################### CONTENTS OF ~/.vnc/xstartup  #######################
#!/bin/sh

xrdb $HOME/.Xresources
xsetroot -solid grey
x-terminal-emulator -geometry 80x24+10+10 -ls -title "$VNCDESKTOP Desktop" &
export XKL_XMODMAP_DISABLE=1
export XDG_CURRENT_DESKTOP="GNOME-Flashback:GNOME"
export XDG_MENU_PREFIX="gnome-flashback-"
/etc/X11/Xsession


gnome-session --session=gnome-flashback-metacity --disable-acceleration-check &
gnome-panel &
gnome-settings-daemon &
metacity &
nautilus --force-desktop --no-default-window

Then you are all set!

-----------------------
When you use tightvnc client on Windows ensure that you enter the IP address of your AWS host with the server instance as suffix. Also ensure that the GPU server instance has the tightvncserver instance started as follows:
$ tightvncserver -geometry 1920x1200

Frustrated with phpmyadmin setup in Ubuntu 16.04?

After spending about 5 hours trying to get phpmyadmin to work with mysql on ubuntu I finally switched gears and started looking at an alternative - mywebsql

This link below explains step by step how to install this lightweight web interface to the mysql and the configuration is much simpler than phpmyadmin. So bye-bye phpmyadmin and hello mywebsql


https://www.linuxhelp.com/how-to-install-mywebsql-on-ubuntu/

OpenCV 3.1 Build commands

OpenCV 3.1

sudo apt-get update -y

sudo apt-get upgrade -y

sudo apt-get install build-essential cmake pkg-config  -y

sudo apt-get install libjpeg8-dev libtiff5-dev libjasper-dev libpng12-dev -y

sudo apt-get install libavcodec-dev libavformat-dev libswscale-dev libv4l-dev -y

sudo apt-get install libxvidcore-dev libx264-dev -y

sudo apt-get autoclean

sudo apt-get install libgtk-3-dev -y

sudo apt-get install libatlas-base-dev gfortran -y

sudo apt-get install python2.7-dev -y

sudo apt-get install tree unzip -y

sudo apt-get install python-pip -y

sudo -H pip install pip -U

sudo apt-get remove python3 --purge -y

sudo -H pip install numpy -U

sudo  apt-get install --upgrade ipython

sudo -H pip install jupyter -U



##############################################################
cd ~
wget -O opencv.zip https://github.com/Itseez/opencv/archive/3.1.0.zip
rm -rf ~/opencv-3.1.0
unzip opencv.zip
rm -rf ~/opencv_contrib-3.1.0
wget -O opencv_contrib.zip https://github.com/Itseez/opencv_contrib/archive/3.1.0.zip
unzip opencv_contrib.zip


#########################################################
cd ~/opencv-3.1.0/
rm -rf build
mkdir build
cd build
cmake -D CMAKE_BUILD_TYPE=RELEASE \
    -D CMAKE_INSTALL_PREFIX=/usr/local \
    -D INSTALL_PYTHON_EXAMPLES=ON \
    -D INSTALL_C_EXAMPLES=OFF \
    -D OPENCV_EXTRA_MODULES_PATH=~/opencv_contrib-3.1.0/modules \
    -D PYTHON_EXECUTABLE=/usr/bin/python \
    -D BUILD_EXAMPLES=OFF  ..


###############################################################

make -j4

sudo make install

sudo ldconfig

sudo ln -sf /home/ubuntu/opencv-3.1.0/build/lib/cv2.so  /usr/local/lib/python2.7/site-packages/cv2.so

Python and OpenCV 3.1

First you need Jupyter and AWS ubuntu 16.04
https://www.rosehosting.com/blog/how-to-install-jupyter-on-an-ubuntu-16-04-vps/

All the powerful feature descriptors are 3rd party extensions which need special build of OpenCV

Prior to installing OpenCV, resolve some dependencies like Tesseract, PyVTK etc.,
https://medium.com/@lucas63/installing-tesseract-3-04-in-ubuntu-14-04-1dae8b748a32
https://lucacerone.net/2017/install-tesseract-3-0-5-in-ubuntu-16-04/

Then proceed with OpenCV build
http://www.pyimagesearch.com/2016/10/24/ubuntu-16-04-how-to-install-opencv/

You will run into a snag with the OpenCV build. Here is how to resolve it:
https://github.com/opencv/opencv/issues/6016

locate the file:modules/python/common.cmake and append 2 lines of code 
find_package(HDF5)

include_directories(${HDF5_INCLUDE_DIRS})


The way to access the features has changed from OpenCV 2.4 days to OpenCV 3.1
Reference: http://www.pyimagesearch.com/2015/07/16/where-did-sift-and-surf-go-in-opencv-3/#comment-431206


Some great descriptors are DCT, GLCM, FLANN, LUCID, ORB, BRIEF, SURF and SIFT, Gabor

https://www.researchgate.net/post/I_want_to_extract_Haralick_texture_features_in_openCV2
https://stackoverflow.com/questions/19556538/how-to-find-glcm-of-an-image-in-opencv-or-numpy
http://docs.opencv.org/3.0-beta/doc/py_tutorials/py_feature2d/py_orb/py_orb.html
http://docs.opencv.org/3.1.0/d5/d51/group__features2d__main.html
http://docs.opencv.org/3.0-beta/doc/py_tutorials/py_feature2d/py_matcher/py_matcher.html
http://answers.opencv.org/question/63517/how-to-successfully-implement-a-gabor-filtering/
http://docs.opencv.org/3.0-beta/modules/imgproc/doc/filtering.html
https://gist.github.com/odebeir/5237529

Finding the best features which are rotation invariant, scale invariant, resolution invariant, robust against blurring etc., is a challenge.


Of course going with a deep-learning way of classification would imply that there is no need to explicitly do feature extraction

http://www.wolfib.com/Image-Recognition-Intro-Part-1/
https://research.googleblog.com/2016/03/train-your-own-image-classifier-with.html
https://github.com/rdcolema/tensorflow-image-classification/blob/master/cnn.ipynb

Finally, remember to run Jupyter from this location so that the cv2 version is set to 3.1.0

~/.virtualenvs/cv/lib/python2.7/site-packages$

Setting up R Server Connect

R Server Connect is a great piece of software!
It allows data scientists to publish their static or interactive dashboards which might be RMarkdown or Shiny applications

But one is bound to run into installation problems like I did.

Please ensure that the following dependencies are met.

Rstudio IDE:
install.packages('rsconnect')

install.packages("devtools", dependencies=TRUE)

Linux Shell:
sudo apt-get install r-cran-rserve
sudo apt-get install openssl
sudo apt-get install libssl-dev
sudo apt-get install libcurl4-gnutls-dev
sudo apt-get install libxml2-dev

Python Threads (lifesaver!)

https://pymotw.com/2/threading/

Gitlab server

This gave me some pain! How to set up gitlab server for my team and then be able to use just the IP address and not the DNS name. I had to use the IP address since the network admin policy was that unless a static ethernet cable-based IP address was allotted to my desk they would not be able to provide me DNS name. So until then I decided to use Virtual Box with Bridged-adapter network configuration and then use the IP address that the network switch would allocate to my virtual machine as though it were a separate node in the network to run my gitlab server on.

There was one little thing that took 2 days to figure out.
Where do you set up the IP address for gitlab server?

Add this following line to the file gitlab.rb:

sudo vim /etc/gitlab/gitlab.rb
external_url 'http://xxx.xxx.xxx.xxx'

VirtualBox VMDK from VMWare

Copy paste the following into a shell script and run:
[Reference: https://github.com/caskroom/homebrew-cask/issues/3333]

Quite useful tips!
http://brianflove.com/2014/06/09/vmware-fusion-to-virtual-box/

(
  cd /tmp;
  vbox_full_version=$(brew cask info virtualbox | head -1 | cut -d' ' -f2);
  vbox_short_version=${vbox_full_version/-*};
  curl -L -O http://download.virtualbox.org/virtualbox/${vbox_short_version}/Oracle_VM_VirtualBox_Extension_Pack-${vbox_full_version}.vbox-extpack;
  sudo VBoxManage extpack install --replace Oracle_VM_VirtualBox_Extension_Pack-${vbox_full_version}.vbox-extpack;
  rm *.vbox-extpack;
)

VirtualBox and networking

Today I had a rather interesting requirement - I needed to run a gitlab instance for my team. I decided I would use one of the servers' hardware and install a virtual machine using VMWare's client for Mac OS called Fusion. In the past I had encountered difficulties in being able to spin up a VM which was visible and ping-able in the intranet using VMWare clients. Yet I tried to go down that path again. It was a bit frustrating and I hopped from one stackoverflow article to another and finally gave up. I switched to VirtualBox and brought up a simple webserver in one line :

python -m SimpleHTTPServer 8000

Once I did this, I made sure this was accessible from browser as http://localhost:8000. I wanted to be able to access this from browser running on another host. So in order to do that I enabled a bridged adapter configuration on the network adapter. Some organizations do not support it. But I was lucky that my organization supported this - awarding an IP address to a VM's network adapter. Then it worked!
On the Mac OS window after launching the VirtualBox go to Machine-> Settings and then choose Network. Select Bridged Adapter and the default settings in Advanced menu. That should do it.

References:
How to set up a firewall  in Ubuntu:
https://www.digitalocean.com/community/tutorials/how-to-set-up-a-firewall-with-ufw-on-ubuntu-16-04

Predictive Analytics as Micro-services

Running R-as-a-service was something I was obsessed about for a while. I managed to search quite a few websites to come up with the strategy as below:





# GET THE CODE (Please do NOT skip this step and try to install using APTITUDE)

# ----------------------------------------------------------------------------




mkdir rApache

git init

git remote add origin https://github.com/jeffreyhorner/rapache

git pull origin master

sudo apt-get install r-base-dev apache2-mpm-prefork apache2-prefork-dev

# BUILD THE CODE
# ----------------
./configure --with-apxs=/usr/bin/apxs2
sudo make clean
sudo make
sudo make install


# CREATE 2 FILES:
#-----------------------------------------------------
sudo touch /etc/apache2/mods-available/r.conf
sudo touch /etc/apache2/mods-available/r.load


# ENTER THE FOLLOWING CONTENTS INTO THE r.conf FILE
#-----------------------------------------------------
<Location /R>
ROutputErrors
SetHandler r-script
RHandler sys.source
</Location>
<Location /RApacheInfo>
SetHandler r-info
</Location>


# ENTER THE FOLLOWING CONTENTS INTO THE r.load FILE
# -----------------------------------------------------
LoadModule R_module /usr/lib/apache2/modules/mod_R.so


# ENABLE THE RAPACHE MODULE
#----------------------------
sudo a2enmod r


# RESTART WEBSERVER
#----------------------------
#/etc/init.d/apache2 restart
sudo service apache2 restart


# TEST WEBSERVER
#----------------
# ENTER THE FOLLOWING CONTENTS INTO THE /var/www/R/test FILE
# ----------------------------------------------------------

y = rnorm(100)
print(y)


# OPEN BROWSER AND VISIT THE FOLLOWING URL:
# -----------------------------------------
http://localhost/R/test


# THE OUTPUT SHOULD LOOK SOMETHING LIKE THIS:
# ----------------------------------------------------------------

  [1] -1.11999180  0.77388394  0.47741262  0.59742444 -0.90835401 -0.73759768
  [7] -0.98358905  0.17164534 -0.30633769 -0.26356790 -0.72520593  1.09611240
 [13] -0.87002950 -0.68221878 -0.19672396  0.27719816  0.35486869 -2.62321997
 [19]  0.09403267 -0.59546938 -0.71671409 -0.37427584  0.22468514  0.39514394
 [25] -0.02668597 -0.04376564 -0.46238028 -0.26864170  0.55945746  0.18677297
 [31] -0.13377996 -0.14030508  0.02584913  2.25083262  0.10285414 -0.58769284
 [37]  0.88162455 -0.60222629 -0.19106042 -0.33075772  0.88249825  0.20592161
 [43] -0.53860098 -0.29864930 -0.34677542 -1.13457872 -0.52058656 -1.05854668
 [49] -0.87010347  0.47185953 -0.07035073 -0.61571393 -1.53781353 -1.48808031
 [55]  1.70151404  0.55821896 -0.86341586  1.01017915 -1.11602614  1.25460339
 [61] -0.07592987 -0.66240349  0.42753736 -0.87203214  1.13069688  1.10198204
 [67] -0.62701037 -0.91552938  1.34857229  2.00109074 -0.34138944  1.00038689
 [73]  1.94789712 -1.28643020  1.01272894  1.36189124  1.33133999 -0.37285196
 [79] -1.97906684 -1.47064465  1.54959469  1.34553324 -0.59611516  0.47388310
 [85]  2.42228484  0.66866070 -0.40705464 -0.48787802 -0.71283698  1.53617890
 [91]  1.02509900  0.87506909  0.79658073  1.97578280 -0.31492661  0.88690593
 [97]  1.02348963  1.75672929 -1.18559266  0.56992037

# Static Graphics can be created in R and transferred on HTTP response too!
# --------------------------------------------------------------------------

# Change the contents of /var/www/R/test file above and add the following:

setContentType ("image/png")
temp <- tempfile ()
y = rnorm (100)
png (temp, type="cairo")
plot (1:100, y, t='l')
dev.off ()
sendBin (readBin (temp, 'raw', n=file.info(temp)$size))
unlink (temp)


# -----------------------------------------------------------------------


#Of course one can handle other HTTP request methods and pass JSON back and forth
# ------------------------------------------------------------------------------


# Ensure that RJSONIO package is installed in R!
# Change the contents of the /var/www/R/test file above to be:

setContentType("application/json")

library(RJSONIO)
library(utils)
print(GET$data)
#json <- fromJSON(URLdecode(GET$data))
#print (json)
#print(toJSON(rnorm(10)))

#Interactive Graphics?
#-----------------------
# You just need a new apache module that supports ggplot (more on this for later...)



REFERENCES:
https://dzone.com/articles/building-json-webservice-r
https://binfalse.de/2011/05/28/r-for-the-web/

My .bashrc

My .bashrc
[Thanks to jeffguy77's blog on this forum: http://www.linuxquestions.org/questions/linux-general-1/ultimate-prompt-and-bashrc-file-4175518169/#post5235872
]
#######################################################
#!/bin/bash
iatest=$(expr index "$-" i)

#######################################################
# SOURCED ALIAS'S AND SCRIPTS
#######################################################

# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi

# Enable bash programmable completion features in interactive shells
if [ -f /usr/share/bash-completion/bash_completion ]; then
. /usr/share/bash-completion/bash_completion
elif [ -f /etc/bash_completion ]; then
. /etc/bash_completion
fi

#######################################################
# EXPORTS
#######################################################

# Disable the bell
if [[ $iatest > 0 ]]; then bind "set bell-style visible"; fi

# Expand the history size
export HISTFILESIZE=10000
export HISTSIZE=500

# Don't put duplicate lines in the history and do not add lines that start with a space
export HISTCONTROL=erasedups:ignoredups:ignorespace

# Check the window size after each command and, if necessary, update the values of LINES and COLUMNS
shopt -s checkwinsize

# Causes bash to append to history instead of overwriting it so if you start a new terminal, you have old session history
shopt -s histappend
PROMPT_COMMAND='history -a'

# Allow ctrl-S for history navigation (with ctrl-R)
stty -ixon

# Ignore case on auto-completion
# Note: bind used instead of sticking these in .inputrc
if [[ $iatest > 0 ]]; then bind "set completion-ignore-case on"; fi

# Show auto-completion list automatically, without double tab
if [[ $iatest > 0 ]]; then bind "set show-all-if-ambiguous On"; fi

# Set the default editor
export EDITOR=nano
export VISUAL=nano
alias pico='edit'
alias spico='sedit'
alias nano='edit'
alias snano='sedit'

# To have colors for ls and all grep commands such as grep, egrep and zgrep
export CLICOLOR=1
export LS_COLORS='no=00:fi=00:di=00;34:ln=01;36:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.gz=01;31:*.bz2=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.avi=01;35:*.fli=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.ogg=01;35:*.mp3=01;35:*.wav=01;35:*.xml=00;31:'
export GREP_OPTIONS='--color=auto'

# Color for manpages in less makes manpages a little easier to read
export LESS_TERMCAP_mb=$'\E[01;31m'
export LESS_TERMCAP_md=$'\E[01;31m'
export LESS_TERMCAP_me=$'\E[0m'
export LESS_TERMCAP_se=$'\E[0m'
export LESS_TERMCAP_so=$'\E[01;44;33m'
export LESS_TERMCAP_ue=$'\E[0m'
export LESS_TERMCAP_us=$'\E[01;32m'

#######################################################
# MACHINE SPECIFIC ALIAS'S
#######################################################

# Alias's for SSH
# alias SERVERNAME='ssh YOURWEBSITE.com -l USERNAME -p PORTNUMBERHERE'

# Alias's to change the directory
alias web='cd /var/www/html'

# Alias's to mount ISO files
# mount -o loop /home/NAMEOFISO.iso /home/ISOMOUNTDIR/
# umount /home/NAMEOFISO.iso
# (Both commands done as root only.)

#######################################################
# GENERAL ALIAS'S
#######################################################
# To temporarily bypass an alias, we preceed the command with a \
# EG: the ls command is aliased, but to use the normal ls command you would type \ls

# Add an "alert" alias for long running commands.  Use like so:
#   sleep 10; alert
alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"'

# Edit this .bashrc file
alias ebrc='edit ~/.bashrc'

# Show help for this .bashrc file
alias hlp='less ~/.bashrc_help'

# alias to show the date
alias da='date "+%Y-%m-%d %A %T %Z"'

# Alias's to modified commands
alias cp='cp -i'
alias mv='mv -i'
alias rm='rm -iv'
alias mkdir='mkdir -p'
alias ps='ps auxf'
alias ping='ping -c 10'
alias less='less -R'
alias cls='clear'
alias apt-get='sudo apt-get'
alias multitail='multitail --no-repeat -c'
alias freshclam='sudo freshclam'
alias vi='vim'
alias svi='sudo vi'
alias vis='vim "+set si"'

# Change directory aliases
alias home='cd ~'
alias cd..='cd ..'
alias ..='cd ..'
alias ...='cd ../..'
alias ....='cd ../../..'
alias .....='cd ../../../..'

# cd into the old directory
alias bd='cd "$OLDPWD"'

# Remove a directory and all files
alias rmd='/bin/rm  --recursive --force --verbose '

# Alias's for multiple directory listing commands
alias la='ls -Alh' # show hidden files
alias ls='ls -aFh --color=always' # add colors and file type extensions
alias lx='ls -lXBh' # sort by extension
alias lk='ls -lSrh' # sort by size
alias lc='ls -lcrh' # sort by change time
alias lu='ls -lurh' # sort by access time
alias lr='ls -lRh' # recursive ls
alias lt='ls -ltrh' # sort by date
alias lm='ls -alh |more' # pipe through 'more'
alias lw='ls -xAh' # wide listing format
alias ll='ls -Fls' # long listing format
alias labc='ls -lap' #alphabetical sort
alias lf="ls -l | egrep -v '^d'" # files only
alias ldir="ls -l | egrep '^d'" # directories only

# alias chmod commands
alias mx='chmod a+x'
alias 000='chmod -R 000'
alias 644='chmod -R 644'
alias 666='chmod -R 666'
alias 755='chmod -R 755'
alias 777='chmod -R 777'

# Search command line history
alias h="history | grep "

# Search running processes
alias p="ps aux | grep "
alias topcpu="/bin/ps -eo pcpu,pid,user,args | sort -k 1 -r | head -10"

# Search files in the current folder
alias f="find . | grep "

# Count all files (recursively) in the current folder
alias countfiles="for t in files links directories; do echo \`find . -type \${t:0:1} | wc -l\` \$t; done 2> /dev/null"

# To see if a command is aliased, a file, or a built-in command
alias checkcommand="type -t"

# Show current network connections to the server
alias ipview="netstat -anpl | grep :80 | awk {'print \$5'} | cut -d\":\" -f1 | sort | uniq -c | sort -n | sed -e 's/^ *//' -e 's/ *\$//'"

# Show open ports
alias openports='netstat -nape --inet'

# Alias's for safe and forced reboots
alias rebootsafe='sudo shutdown -r now'
alias rebootforce='sudo shutdown -r -n now'

# Alias's to show disk space and space used in a folder
alias diskspace="du -S | sort -n -r |more"
alias folders='du -h --max-depth=1'
alias folderssort='find . -maxdepth 1 -type d -print0 | xargs -0 du -sk | sort -rn'
alias tree='tree -CAhF --dirsfirst'
alias treed='tree -CAFd'
alias mountedinfo='df -hT'

# Alias's for archives
alias mktar='tar -cvf'
alias mkbz2='tar -cvjf'
alias mkgz='tar -cvzf'
alias untar='tar -xvf'
alias unbz2='tar -xvjf'
alias ungz='tar -xvzf'

# Show all logs in /var/log
alias logs="sudo find /var/log -type f -exec file {} \; | grep 'text' | cut -d' ' -f1 | sed -e's/:$//g' | grep -v '[0-9]$' | xargs tail -f"

# SHA1
alias sha1='openssl sha1'

#######################################################
# SPECIAL FUNCTIONS
#######################################################

# Use the best version of pico installed
edit ()
{
if [ "$(type -t jpico)" = "file" ]; then
# Use JOE text editor http://joe-editor.sourceforge.net/
jpico -nonotice -linums -nobackups "$@"
elif [ "$(type -t nano)" = "file" ]; then
nano -c "$@"
elif [ "$(type -t pico)" = "file" ]; then
pico "$@"
else
vim "$@"
fi
}
sedit ()
{
if [ "$(type -t jpico)" = "file" ]; then
# Use JOE text editor http://joe-editor.sourceforge.net/
sudo jpico -nonotice -linums -nobackups "$@"
elif [ "$(type -t nano)" = "file" ]; then
sudo nano -c "$@"
elif [ "$(type -t pico)" = "file" ]; then
sudo pico "$@"
else
sudo vim "$@"
fi
}

# Extracts any archive(s) (if unp isn't installed)
extract () {
for archive in $*; do
if [ -f $archive ] ; then
case $archive in
*.tar.bz2)   tar xvjf $archive    ;;
*.tar.gz)    tar xvzf $archive    ;;
*.bz2)       bunzip2 $archive     ;;
*.rar)       rar x $archive       ;;
*.gz)        gunzip $archive      ;;
*.tar)       tar xvf $archive     ;;
*.tbz2)      tar xvjf $archive    ;;
*.tgz)       tar xvzf $archive    ;;
*.zip)       unzip $archive       ;;
*.Z)         uncompress $archive  ;;
*.7z)        7z x $archive        ;;
*)           echo "don't know how to extract '$archive'..." ;;
esac
else
echo "'$archive' is not a valid file!"
fi
done
}

# Searches for text in all files in the current folder
ftext ()
{
# -i case-insensitive
# -I ignore binary files
# -H causes filename to be printed
# -r recursive search
# -n causes line number to be printed
# optional: -F treat search term as a literal, not a regular expression
# optional: -l only print filenames and not the matching lines ex. grep -irl "$1" *
grep -iIHrn --color=always "$1" . | less -r
}

# Copy file with a progress bar
cpp()
{
set -e
strace -q -ewrite cp -- "${1}" "${2}" 2>&1 \
| awk '{
count += $NF
if (count % 10 == 0) {
percent = count / total_size * 100
printf "%3d%% [", percent
for (i=0;i<=percent;i++)
printf "="
printf ">"
for (i=percent;i<100;i++)
printf " "
printf "]\r"
}
}
END { print "" }' total_size=$(stat -c '%s' "${1}") count=0
}

# Copy and go to the directory
cpg ()
{
if [ -d "$2" ];then
cp $1 $2 && cd $2
else
cp $1 $2
fi
}

# Move and go to the directory
mvg ()
{
if [ -d "$2" ];then
mv $1 $2 && cd $2
else
mv $1 $2
fi
}

# Create and go to the directory
mkdirg ()
{
mkdir -p $1
cd $1
}

# Goes up a specified number of directories  (i.e. up 4)
up ()
{
local d=""
limit=$1
for ((i=1 ; i <= limit ; i++))
do
d=$d/..
done
d=$(echo $d | sed 's/^\///')
if [ -z "$d" ]; then
d=..
fi
cd $d
}

#Automatically do an ls after each cd
# cd ()
# {
# if [ -n "$1" ]; then
# builtin cd "$@" && ls
# else
# builtin cd ~ && ls
# fi
# }

# Returns the last 2 fields of the working directory
pwdtail ()
{
pwd|awk -F/ '{nlast = NF -1;print $nlast"/"$NF}'
}

# Show the current distribution
distribution ()
{
local dtype
# Assume unknown
dtype="unknown"

# First test against Fedora / RHEL / CentOS / generic Redhat derivative
if [ -r /etc/rc.d/init.d/functions ]; then
source /etc/rc.d/init.d/functions
[ zz`type -t passed 2>/dev/null` == "zzfunction" ] && dtype="redhat"

# Then test against SUSE (must be after Redhat,
# I've seen rc.status on Ubuntu I think? TODO: Recheck that)
elif [ -r /etc/rc.status ]; then
source /etc/rc.status
[ zz`type -t rc_reset 2>/dev/null` == "zzfunction" ] && dtype="suse"

# Then test against Debian, Ubuntu and friends
elif [ -r /lib/lsb/init-functions ]; then
source /lib/lsb/init-functions
[ zz`type -t log_begin_msg 2>/dev/null` == "zzfunction" ] && dtype="debian"

# Then test against Gentoo
elif [ -r /etc/init.d/functions.sh ]; then
source /etc/init.d/functions.sh
[ zz`type -t ebegin 2>/dev/null` == "zzfunction" ] && dtype="gentoo"

# For Mandriva we currently just test if /etc/mandriva-release exists
# and isn't empty (TODO: Find a better way :)
elif [ -s /etc/mandriva-release ]; then
dtype="mandriva"

# For Slackware we currently just test if /etc/slackware-version exists
elif [ -s /etc/slackware-version ]; then
dtype="slackware"

fi
echo $dtype
}

# Show the current version of the operating system
ver ()
{
local dtype
dtype=$(distribution)

if [ $dtype == "redhat" ]; then
if [ -s /etc/redhat-release ]; then
cat /etc/redhat-release && uname -a
else
cat /etc/issue && uname -a
fi
elif [ $dtype == "suse" ]; then
cat /etc/SuSE-release
elif [ $dtype == "debian" ]; then
lsb_release -a
# sudo cat /etc/issue && sudo cat /etc/issue.net && sudo cat /etc/lsb_release && sudo cat /etc/os-release # Linux Mint option 2
elif [ $dtype == "gentoo" ]; then
cat /etc/gentoo-release
elif [ $dtype == "mandriva" ]; then
cat /etc/mandriva-release
elif [ $dtype == "slackware" ]; then
cat /etc/slackware-version
else
if [ -s /etc/issue ]; then
cat /etc/issue
else
echo "Error: Unknown distribution"
exit 1
fi
fi
}

# Automatically install the needed support files for this .bashrc file
install_bashrc_support ()
{
local dtype
dtype=$(distribution)

if [ $dtype == "redhat" ]; then
sudo yum install multitail tree joe
elif [ $dtype == "suse" ]; then
sudo zypper install multitail
sudo zypper install tree
sudo zypper install joe
elif [ $dtype == "debian" ]; then
sudo apt-get install multitail tree joe
elif [ $dtype == "gentoo" ]; then
sudo emerge multitail
sudo emerge tree
sudo emerge joe
elif [ $dtype == "mandriva" ]; then
sudo urpmi multitail
sudo urpmi tree
sudo urpmi joe
elif [ $dtype == "slackware" ]; then
echo "No install support for Slackware"
else
echo "Unknown distribution"
fi
}

# Show current network information
netinfo ()
{
echo "--------------- Network Information ---------------"
/sbin/ifconfig | awk /'inet addr/ {print $2}'
echo ""
/sbin/ifconfig | awk /'Bcast/ {print $3}'
echo ""
/sbin/ifconfig | awk /'inet addr/ {print $4}'

/sbin/ifconfig | awk /'HWaddr/ {print $4,$5}'
echo "---------------------------------------------------"
}

# IP address lookup
alias whatismyip="whatsmyip"
function whatsmyip ()
{
# Dumps a list of all IP addresses for every device
# /sbin/ifconfig |grep -B1 "inet addr" |awk '{ if ( $1 == "inet" ) { print $2 } else if ( $2 == "Link" ) { printf "%s:" ,$1 } }' |awk -F: '{ print $1 ": " $3 }';

# Internal IP Lookup
echo -n "Internal IP: " ; /sbin/ifconfig eth0 | grep "inet addr" | awk -F: '{print $2}' | awk '{print $1}'

# External IP Lookup
echo -n "External IP: " ; wget http://smart-ip.net/myip -O - -q
}

# View Apache logs
apachelog ()
{
if [ -f /etc/httpd/conf/httpd.conf ]; then
cd /var/log/httpd && ls -xAh && multitail --no-repeat -c -s 2 /var/log/httpd/*_log
else
cd /var/log/apache2 && ls -xAh && multitail --no-repeat -c -s 2 /var/log/apache2/*.log
fi
}

# Edit the Apache configuration
apacheconfig ()
{
if [ -f /etc/httpd/conf/httpd.conf ]; then
sedit /etc/httpd/conf/httpd.conf
elif [ -f /etc/apache2/apache2.conf ]; then
sedit /etc/apache2/apache2.conf
else
echo "Error: Apache config file could not be found."
echo "Searching for possible locations:"
sudo updatedb && locate httpd.conf && locate apache2.conf
fi
}

# Edit the PHP configuration file
phpconfig ()
{
if [ -f /etc/php.ini ]; then
sedit /etc/php.ini
elif [ -f /etc/php/php.ini ]; then
sedit /etc/php/php.ini
elif [ -f /etc/php5/php.ini ]; then
sedit /etc/php5/php.ini
elif [ -f /usr/bin/php5/bin/php.ini ]; then
sedit /usr/bin/php5/bin/php.ini
elif [ -f /etc/php5/apache2/php.ini ]; then
sedit /etc/php5/apache2/php.ini
else
echo "Error: php.ini file could not be found."
echo "Searching for possible locations:"
sudo updatedb && locate php.ini
fi
}

# Edit the MySQL configuration file
mysqlconfig ()
{
if [ -f /etc/my.cnf ]; then
sedit /etc/my.cnf
elif [ -f /etc/mysql/my.cnf ]; then
sedit /etc/mysql/my.cnf
elif [ -f /usr/local/etc/my.cnf ]; then
sedit /usr/local/etc/my.cnf
elif [ -f /usr/bin/mysql/my.cnf ]; then
sedit /usr/bin/mysql/my.cnf
elif [ -f ~/my.cnf ]; then
sedit ~/my.cnf
elif [ -f ~/.my.cnf ]; then
sedit ~/.my.cnf
else
echo "Error: my.cnf file could not be found."
echo "Searching for possible locations:"
sudo updatedb && locate my.cnf
fi
}

# For some reason, rot13 pops up everywhere
rot13 () {
if [ $# -eq 0 ]; then
tr '[a-m][n-z][A-M][N-Z]' '[n-z][a-m][N-Z][A-M]'
else
echo $* | tr '[a-m][n-z][A-M][N-Z]' '[n-z][a-m][N-Z][A-M]'
fi
}

# Trim leading and trailing spaces (for scripts)
trim()
{
local var=$@
var="${var#"${var%%[![:space:]]*}"}"  # remove leading whitespace characters
var="${var%"${var##*[![:space:]]}"}"  # remove trailing whitespace characters
echo -n "$var"
}

#######################################################
# Set the ultimate amazing command prompt
#######################################################

alias cpu="grep 'cpu ' /proc/stat | awk '{usage=(\$2+\$4)*100/(\$2+\$4+\$5)} END {print usage}' | awk '{printf(\"%.1f\n\", \$1)}'"
function __setprompt
{
local LAST_COMMAND=$? # Must come first!

# Define colors
local LIGHTGRAY="\033[0;37m"
local WHITE="\033[1;37m"
local BLACK="\033[0;30m"
local DARKGRAY="\033[1;30m"
local RED="\033[0;31m"
local LIGHTRED="\033[1;31m"
local GREEN="\033[0;32m"
local LIGHTGREEN="\033[1;32m"
local BROWN="\033[0;33m"
local YELLOW="\033[1;33m"
local BLUE="\033[0;34m"
local LIGHTBLUE="\033[1;34m"
local MAGENTA="\033[0;35m"
local LIGHTMAGENTA="\033[1;35m"
local CYAN="\033[0;36m"
local LIGHTCYAN="\033[1;36m"
local NOCOLOR="\033[0m"

# Show error exit code if there is one
if [[ $LAST_COMMAND != 0 ]]; then
# PS1="\[${RED}\](\[${LIGHTRED}\]ERROR\[${RED}\])-(\[${LIGHTRED}\]Exit Code \[${WHITE}\]${LAST_COMMAND}\[${RED}\])-(\[${LIGHTRED}\]"
PS1="\[${DARKGRAY}\](\[${LIGHTRED}\]ERROR\[${DARKGRAY}\])-(\[${RED}\]Exit Code \[${LIGHTRED}\]${LAST_COMMAND}\[${DARKGRAY}\])-(\[${RED}\]"
if [[ $LAST_COMMAND == 1 ]]; then
PS1+="General error"
elif [ $LAST_COMMAND == 2 ]; then
PS1+="Missing keyword, command, or permission problem"
elif [ $LAST_COMMAND == 126 ]; then
PS1+="Permission problem or command is not an executable"
elif [ $LAST_COMMAND == 127 ]; then
PS1+="Command not found"
elif [ $LAST_COMMAND == 128 ]; then
PS1+="Invalid argument to exit"
elif [ $LAST_COMMAND == 129 ]; then
PS1+="Fatal error signal 1"
elif [ $LAST_COMMAND == 130 ]; then
PS1+="Script terminated by Control-C"
elif [ $LAST_COMMAND == 131 ]; then
PS1+="Fatal error signal 3"
elif [ $LAST_COMMAND == 132 ]; then
PS1+="Fatal error signal 4"
elif [ $LAST_COMMAND == 133 ]; then
PS1+="Fatal error signal 5"
elif [ $LAST_COMMAND == 134 ]; then
PS1+="Fatal error signal 6"
elif [ $LAST_COMMAND == 135 ]; then
PS1+="Fatal error signal 7"
elif [ $LAST_COMMAND == 136 ]; then
PS1+="Fatal error signal 8"
elif [ $LAST_COMMAND == 137 ]; then
PS1+="Fatal error signal 9"
elif [ $LAST_COMMAND -gt 255 ]; then
PS1+="Exit status out of range"
else
PS1+="Unknown error code"
fi
PS1+="\[${DARKGRAY}\])\[${NOCOLOR}\]\n"
else
PS1=""
fi

# Date
PS1+="\[${DARKGRAY}\](\[${CYAN}\]\$(date +%a) $(date +%b-'%-m')" # Date
PS1+="${BLUE} $(date +'%-I':%M:%S%P)\[${DARKGRAY}\])-" # Time

# CPU
PS1+="(\[${MAGENTA}\]CPU $(cpu)%"

# Jobs
PS1+="\[${DARKGRAY}\]:\[${MAGENTA}\]\j"

# Network Connections (for a server - comment out for non-server)
PS1+="\[${DARKGRAY}\]:\[${MAGENTA}\]Net $(awk 'END {print NR}' /proc/net/tcp)"

PS1+="\[${DARKGRAY}\])-"

# User and server
local SSH_IP=`echo $SSH_CLIENT | awk '{ print $1 }'`
local SSH2_IP=`echo $SSH2_CLIENT | awk '{ print $1 }'`
if [ $SSH2_IP ] || [ $SSH_IP ] ; then
PS1+="(\[${RED}\]\u@\h"
else
PS1+="(\[${RED}\]\u"
fi

# Current directory
PS1+="\[${DARKGRAY}\]:\[${BROWN}\]\w\[${DARKGRAY}\])-"

# Total size of files in current directory
PS1+="(\[${GREEN}\]$(/bin/ls -lah | /bin/grep -m 1 total | /bin/sed 's/total //')\[${DARKGRAY}\]:"

# Number of files
PS1+="\[${GREEN}\]\$(/bin/ls -A -1 | /usr/bin/wc -l)\[${DARKGRAY}\])"

# Skip to the next line
PS1+="\n"

if [[ $EUID -ne 0 ]]; then
PS1+="\[${GREEN}\]>\[${NOCOLOR}\] " # Normal user
else
PS1+="\[${RED}\]>\[${NOCOLOR}\] " # Root user
fi

# PS2 is used to continue a command using the \ character
PS2="\[${DARKGRAY}\]>\[${NOCOLOR}\] "

# PS3 is used to enter a number choice in a script
PS3='Please enter a number from above list: '

# PS4 is used for tracing a script in debug mode
PS4='\[${DARKGRAY}\]+\[${NOCOLOR}\] '
}

PROMPT_COMMAND='__setprompt'