Build AWS RedHat AMI for OmicSoft Cloud Computing

From Array Suite Wiki

Warning.png WARNING: This section documents functions or features that are not being developed or managed, information is included for reference only.


Build AWS AMI for OmicSoft Cloud Computing

Although all computing nodes in Omicsoft Cloud use Ubuntu AMIs, admin can build a Red Hat machine in AWS for their ArrayServer server, or use one of OmicSoft's pre-configured images.

Steps here are based on Red Hat Enterprise Linux 7.2 (HVM) as backbone; follow steps outlined on Getting Started for Ubuntu 20 and RHEL 8.

Use sudo to run commands below.

Here are final public AMI in East Coast and West Coast regions, with all required packages installed and configured: 

## East Virginia
Ami=ami-a34c8ace
AmiSnapshot=snap-faf63b1d

## Oregon
Ami=ami-3df3355d
AmiSnapshot=snap-498191b4

Install Required Linux packages

Make sure you have some basic packages installed: CentOS/RHEL: 

    yum install gcc gcc-c++ bison pkgconfig libtool libstdc++-devel \
       glib2-devel gettext make freetype-devel fontconfig-devel \
       libXft-devel libpng-devel libjpeg-devel libtiff-devel giflib-devel \
       ghostscript-devel libexif-devel libX11-devel python3 cmake

or Ubuntu: 

apt-get install -f
apt-get update
apt-get install gcc g++ bison make git autoconf libtool automake build-essential gettext cmake python3 curl libtool-bin libgdiplus zlib1g-dev libglib2.0-dev
apt-get install libpng-dev libjpeg-dev libtiff5-dev libgif-dev libgs-dev libexif-dev libx11-dev fontconfig
apt-get install unzip

Install Mono

yum install wget bzip2

Install Mono 4.0.4

  • Download Mono 4.0.4
    wget -c http://download.mono-project.com/sources/mono/mono-4.0.4.1.tar.bz2

The bz2 file can be saved to a temporary location, e.g. ~/temp/

  • Compile and install. On the command line, type
    tar jxvf mono-4.0.4.1.tar.bz2
    cd  mono-4.0.4
    ./configure  --prefix=/opt/mono-4.0.4 --with-large-heap=yes
    make
    make  install

Note:

  • The location of mono installed is set by the option "--prefix" in the configure step, which can be changed to another location.
  • The option --with-large-heap=yes is to enable support for GC heaps larger than 3gb, which is required for NGS alignment, as well as some Array Server functions)

Double check mono installation and version 

ls /opt/mono-4.0.4/bin/mono* -all
/opt/mono-4.0.4/bin/mono --version
/opt/mono-4.0.4/bin/mono-sgen --version


Install Mono 4.8.1

  • Download Mono 4.8.1
    wget -c http://download.mono-project.com/sources/mono/mono-4.8.1.0.tar.bz2

The bz2 file can be saved to a temporary location, e.g. ~/temp/

  • Compile and install. On the command line, type
    tar jxvf mono-4.8.1.0.tar.bz2
    cd  mono-4.8.1
    ./configure  --prefix=/opt/mono-4.8.1 --with-large-heap=yes
    make
    make  install

Note:

  • The location of mono installed is set by the option "--prefix" in the configure step, which can be changed to another location.
  • The option --with-large-heap=yes is to enable support for GC heaps larger than 3gb, which is required for NGS alignment, as well as some Array Server functions)
  • if you get an error like "processes.c:1672:12: error: implicit declaration of function ‘makedev’ [-Werror=implicit-function-declaration]":
add
#include <sys/sysmacros.h>
to mono/io-layer/processes.c

Double check mono installation and version 

ls /opt/mono-4.8.1/bin/mono* -all
/opt/mono-4.8.1/bin/mono --version
/opt/mono-4.8.1/bin/mono-sgen --version


To review previous instructions on installing mono-2.10.9 (previous version), visit Install mono 2.10.9

use sudo.



Install libgdiplus

sudo yum install yum-utils
sudo rpm --import "http://keyserver.ubuntu.com/pks/lookup?op=get&search=0x3FA7E0328081BFF6A14DA29AA6A19B38D3D831EF"
sudo yum-config-manager --add-repo http://download.mono-project.com/repo/centos/
sudo yum install libgdiplus

Add "/usr/lib64/libgdiplus.so" to

/MonoPrefix/etc/mono/config: Add the following line at the end of the file before </configuration> 

<dllmap dll="gdiplus.dll" target="/usr/lib64/libgdiplus.so"/>

Add to both 2.10.9 and 4.0.4

Sqlite

Install SQLite v3.7.14.1 (2012-10-04) by building it from source: 

# Download SQLite source archive:
$ cd /opt
$ sudo wget -c http://www.sqlite.org/sqlite-autoconf-3071401.tar.gz
$ sudo tar zxvf sqlite-autoconf-3071401.tar.gz
$ sudo mv sqlite-autoconf-3071401 sqlite
$ cd sqlite

# Build and install:
$ sudo ./configure --prefix=/opt/sqlite
$ sudo make
$ sudo make install

# Check SQLite was installed successfully:
$ sudo ./sqlite3 --version

# Clean up:
$ sudo rm /opt/sqlite-autoconf-3071401.tar.gz
$ cd ~

use sudo in ubuntu.

Set ulimit

Make sure the ulimit for "max user processes" and "open files" are set to the max value: 65536. You can check the values by typing: ulimit -a. 

$ ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 515184
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 65536
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 10240
cpu time               (seconds, -t) unlimited
max user processes              (-u) 65536
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

Modify ulimit in two config files following ulimit setup wiki.



Install Oshell

cd /opt
sudo mkdir oshell
cd oshell
sudo wget -c  http://omicsoft.com/software_update/OmicsoftUpdater.exe
sudo touch oshell.exe
sudo /opt/mono-2.10.9/bin/mono ./OmicsoftUpdater.exe

Install AWS CLI

sudo curl "https://bootstrap.pypa.io/get-pip.py" -o "get-pip.py"
sudo python get-pip.py
sudo pip install awscli


Related Articles

EnvelopeLarge2.png

Retrieved from "https://wiki.arrayserver.com/wiki/index.php?title=Build_AWS_RedHat_AMI_for_OmicSoft_Cloud_Computing&oldid=30634"