Features of MongoDB

One of the  main reasons  to use NOSQL database is built in sharing capabilities.

Sharing allows to distribute single database across cluster of machines.

It means, distribute the load rather than purchasing the large server. 

Sharing also help in server handling big data. The data stored in database is increasing exponentially. 

Some databases are very large for each server. So distribution across cluster is necessary. 

No sql databases are lot easier to maintain with the administration tools.

It also supports aggregation (Batch data processing ) and aggregate calculations using the native operations.

It is a schema less database.

It supports map reduce (Large volume of data into useful aggregated data.)

It also supports geospatial and secondary indexes on the collections.

Indexes are efficient execution of queries.Create a simple and complex indexes which will be used for speeding up the query execution.

Read More

What is Amazon ElasticCache ?

Many applications getting popular which is great, but when it comes to performance under heavy load, it is very bad. At the peak times, users are just giving up.
How we can solve this issue without re-engineering the application?

Amazon ElasticCache will solve the problem. It improves the performance of web applications by allowing the retrive the information fast, in-memory caches instead of relying on slow disk based databases.
It automates the time consuming tasks such as infrastructure provisioning, managing persistance,installing the software and patch management etc.

Amazon ElasticCache are managed in-memory service. You can define a cluster of nodes. You have the option for redis as well.
AWS will take care of the cluster management, in-memory cache etc.

Read More

Install Nodejs on Ubuntu 16.04

Node.js is a platform built on chrome's Javascript runtime for easily bulding fast and scalabale apps.
It uses an event driven, non blocking I/O model that makes it light weight and efficient for data intensive apps that run across distributed devices.

first update api package

$sudo apt-get update

Using apt package manager,   then   $sudo apt-get install nodejs

Install npm package 
$sudo apt-get install npm 

Read More

Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?

sudo dockerd \
      --storage-opt dm.datadev=/dev/sda1 \
      --storage-opt dm.metadatadev=/dev/sdf

INFO[0000] libcontainerd: previous instance of containerd still alive (1271)
INFO[0000] [graphdriver] using prior storage driver: aufs
Error starting daemon: error while opening volume store metadata database: timeout

$ systemctl daemon-reload
$ sudo service docker restart
$ sudo service docker status (should see active (running))
$ sudo docker run hello-world

Read More

Docker Machine

It is a tool thats lets you install Docker Engine on virtual hosts.

It creates servers, installs docker and then configures the docker client to take to them.


Linux :

ubuntu@ip-192.33.33.22:~$ docker-machine ls
docker-machine: command not found

Install docker machine

$ curl -L https://github.com/docker/machine/releases/download/v0.12.1/docker-machine-`uname -s`-`uname -m` >/tmp/docker-machine &&
chmod +x /tmp/docker-machine &&
sudo cp /tmp/docker-machine /usr/local/bin/docker-machine

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   617    0   617    0     0    428      0 --:--:--  0:00:01 --:--:--   428
100 25.1M  100 25.1M    0     0   490k      0  0:00:52  0:00:52 --:--:-- 1211k

ubuntu@ip-192.33.33.22:~$ docker-machine version
docker-machine version 0.12.1, build c8b17e8

Example :

$ docker-machine create -d digitalocean --digitalocean-access-token=secret dev

$ docker-machine ls

NAME      ACTIVE   DRIVER       STATE     URL                         SWARM   DOCKER   ERRORS

dev   -          digitalocean   Running   tcp://253.1.113.91:4366             v1.8.9

Read More

Install AWS Cli

Installing AWS Cli on Mac

Installing with Homebrew is easy. It is a popular package manager for MAC OSX.

To install Homebrew, 

Check , ruby is installed in your mac ,

ruby -v

Install homebrew 

Once homebrew installed, install python. To install Python, Gcc to be installed. you need xcode or commandline tools to be installed

you can download and install xcode or commandline tool.

https://developer.apple.com/download/more/

Step1 : brew install python

Install with Homebrew. It is a popular package manager for MAC OSX.

To install Homebrew, you must install xcode first.

Then install homebrew

ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

$ brew doctor

to check brew installed properly.

Step2 :pip install awscli

Terminal output is here

Updating Homebrew...

==> Auto-updated Homebrew!

Updated 1 tap (homebrew/core).

==> New Formulae

apache-arrow        freedink            ipython@5           overmind

asdf                get_iplayer         jose                packetq

bitcoin             git-cinnabar        kubectx             pycodestyle

dcm2niix            gradle-completion   libmypaint          rustup-init

docker2aci          grakn               libnice             tectonic

dwarf               haste-client        libopusenc          tokei

erlang@19           iamy                mruby-cli           vips

faas-cli            insect              neovim              wpscan

fd                  ipython             openfortivpn        zork

==> Updated Formulae

abcl                                     libextractor

advancemame                              libgcrypt

afflib                                   libgit2

afl-fuzz                                 libgit2-glib

allure                                   libgosu

amazon-ecs-cli                           libgphoto2

      zurl

libepoxy

==> Renamed Formulae

osh -> etsh                              speedtest_cli -> speedtest-cli

==> Deleted Formulae

kibana@4.1          node@0.10           node@0.12           snescom




==> Installing dependencies for python: sqlite

==> Installing python dependency: sqlite

==> Downloading https://homebrew.bintray.com/bottles/sqlite-3.19.3.el_capitan.bo

######################################################################## 100.0%

==> Pouring sqlite-3.19.3.el_capitan.bottle.tar.gz

==> Using the sandbox

==> Caveats

This formula is keg-only, which means it was not symlinked into /usr/local,

because macOS provides an older sqlite3.




If you need to have this software first in your PATH run:

  echo 'export PATH="/usr/local/opt/sqlite/bin:$PATH"' >> ~/.bash_profile




For compilers to find this software you may need to set:

    LDFLAGS:  -L/usr/local/opt/sqlite/lib

    CPPFLAGS: -I/usr/local/opt/sqlite/include

For pkg-config to find this software you may need to set:

    PKG_CONFIG_PATH: /usr/local/opt/sqlite/lib/pkgconfig




==> Summary

🍺  /usr/local/Cellar/sqlite/3.19.3: 12 files, 3MB

==> Installing python

Warning: Building python from source:

  The bottle needs the Apple Command Line Tools to be installed.

  You can install them, if desired, with:

    xcode-select --install




==> Downloading https://www.python.org/ftp/python/2.7.13/Python-2.7.13.tar.xz

######################################################################## 100.0%

==> ./configure --prefix=/usr/local/Cellar/python/2.7.13 --enable-ipv6 --dataroo

==> make

==> make install PYTHONAPPSDIR=/usr/local/Cellar/python/2.7.13

==> make frameworkinstallextras PYTHONAPPSDIR=/usr/local/Cellar/python/2.7.13/sh

==> Downloading https://files.pythonhosted.org/packages/26/d1/dc7fe14ce4a3ff3fae

######################################################################## 100.0%

==> Downloading https://files.pythonhosted.org/packages/11/b6/abcb525026a4be042b

######################################################################## 100.0%

==> Downloading https://files.pythonhosted.org/packages/c9/1d/bd19e691fd4cfe908c

######################################################################## 100.0%

==> /usr/local/Cellar/python/2.7.13/bin/python -s setup.py --no-user-cfg install

==> /usr/local/Cellar/python/2.7.13/bin/python -s setup.py --no-user-cfg install

==> /usr/local/Cellar/python/2.7.13/bin/python -s setup.py --no-user-cfg install

==> Caveats

Pip and setuptools have been installed. To update them

  pip install --upgrade pip setuptools




You can install Python packages with

  pip install <package>




They will install into the site-package directory

  /usr/local/lib/python2.7/site-packages




See: http://docs.brew.sh/Homebrew-and-Python.html

==> Summary

🍺  /usr/local/Cellar/python/2.7.13: 6,337 files, 86.7MB, built in 6 minutes 19 seconds
pip install awscli

Collecting awscli

  Downloading awscli-1.11.120-py2.py3-none-any.whl (1.2MB)

    100% |████████████████████████████████| 1.2MB 79kB/s 

Collecting botocore==1.5.83 (from awscli)

  Downloading botocore-1.5.83-py2.py3-none-any.whl (3.5MB)

    100% |████████████████████████████████| 3.6MB 23kB/s 

Collecting rsa<=3.5.0,>=3.1.2 (from awscli)

  Downloading rsa-3.4.2-py2.py3-none-any.whl (46kB)

    100% |████████████████████████████████| 51kB 43kB/s 

Collecting docutils>=0.10 (from awscli)

  Downloading docutils-0.13.1-py2-none-any.whl (537kB)

    100% |████████████████████████████████| 542kB 72kB/s 

Collecting PyYAML<=3.12,>=3.10 (from awscli)

  Downloading PyYAML-3.12.tar.gz (253kB)

    100% |████████████████████████████████| 256kB 181kB/s 

Collecting colorama<=0.3.7,>=0.2.5 (from awscli)

  Downloading colorama-0.3.7-py2.py3-none-any.whl

Collecting s3transfer<0.2.0,>=0.1.9 (from awscli)

  Downloading s3transfer-0.1.10-py2.py3-none-any.whl (54kB)

    100% |████████████████████████████████| 61kB 28kB/s 



  Running setup.py bdist_wheel for PyYAML ... done

  Stored in directory: /Users/srinivas/Library/Caches/pip/wheels/2c/f7/79/13f3a12cd723892437c0cfbde1230ab4d82947ff7b3839a4fc

Successfully built PyYAML

Installing collected packages: six, python-dateutil, docutils, jmespath, botocore, pyasn1, rsa, PyYAML, colorama, futures, s3transfer, awscli

Successfully installed PyYAML-3.12 awscli-1.11.120 botocore-1.5.83 colorama-0.3.7 docutils-0.13.1 futures-3.1.1 jmespath-0.9.3 pyasn1-0.2.3 python-dateutil-2.6.1 rsa-3.4.2 s3transfer-0.1.10 six-1.10.0

Read More

Online training

We provide training on Amazon Web Services

1. AWS Architecture and different models of Cloud Computing 

2. Compute Services: AWS EC2, Auto Scaling and Load Balancing, AWS Lambda, Elastic Beanstalk

3. Storage Services : AWS S3, AWS EBS,  AWS Glacier, AWS CloudFront, Storage Gateway,AWS Snowball

4. Database Services: AWS RedShift, AWS RDS,  ElastiCache, AWS DynamoDB

5. Security and Identity Services: IAM, KMS

6. Networking Services: Route 53, Amazon VPC, Direct Connect

7. Management Tools: AWS CloudTrail, Trusty Advisor, AWS CloudWatch, CloudFormation, OpsWorks

We also provide training on Angular, NodeJS, MongoDB, MySQL, Android, iOS

you can reach us:    srinivas.n462@gmail.com. 

Read More