Your Auto Scaling policy ScaleOutPolicy could not be found at this time. Please try reselecting this alarm. If the policy does not exist you may modify this alarm to set up a valid action.
Monday, 21 August 2017
August 21, 2017
Cloud Watch Alarms- policy issue
Sunday, 20 August 2017
August 20, 2017
AWS S3 Tutorial
Amazon Simple Storage Service is also known as Amazon S3. It is highly scalable object storage in the cloud securely.
It is used to store any amount of data.
MultiPart form uploading to AWS
S3 is Object Storage with a simple web service interface to store and retrive any amount of data from anywhere on the web.
What is multi part upload ?
1. Initiate the Multi part Upload
2. Seperate the object into multiple parts.
3. Upload the parts in any order, one at a time or in the parallel.
Date transmission - Browser going to App server and going to S3.
https://s3.amazonaws.com/upload-demo-images/5e64truyt47653745tr46tr736t4rt4r3t46
Nodejs code :
Install the dependencies.
npm install s3-stream-upload
var UploadStream = require("s3-stream-upload");
var S3 = require("aws-sdk").S3;
var key = "file.mp3";
var s3 = new S3();
fs.readFileStream(__dirname + "/file.mp3")
.pipe(UploadStream(s3, { Bucket: "my-S3-bucket", Key: key }))
.on("error", function (err) {
console.error(err);
})
.on("finish", function () {
console.log("File uploaded!");
});
my sample s3 url - 'https://s3.amazonaws.com/upload-demo-images/';
It is used to store any amount of data.
MultiPart form uploading to AWS
S3 is Object Storage with a simple web service interface to store and retrive any amount of data from anywhere on the web.
What is multi part upload ?
1. Initiate the Multi part Upload
2. Seperate the object into multiple parts.
3. Upload the parts in any order, one at a time or in the parallel.
Date transmission - Browser going to App server and going to S3.
https://s3.amazonaws.com/upload-demo-images/5e64truyt47653745tr46tr736t4rt4r3t46
Nodejs code :
Install the dependencies.
npm install s3-stream-upload
var UploadStream = require("s3-stream-upload");
var S3 = require("aws-sdk").S3;
var key = "file.mp3";
var s3 = new S3();
fs.readFileStream(__dirname + "/file.mp3")
.pipe(UploadStream(s3, { Bucket: "my-S3-bucket", Key: key }))
.on("error", function (err) {
console.error(err);
})
.on("finish", function () {
console.log("File uploaded!");
});
my sample s3 url - 'https://s3.amazonaws.com/upload-demo-images/';
Saturday, 19 August 2017
August 19, 2017
Aws Security Groups
The very first thing to ensure that the unwanted or unauthorized traffic doesn't get in into the instances using Security Group.
What is a Security Group?
It is a AWS firewall solution which filters the incoming and outgoing traffic from an instance.
Filtering is done based upon the ip protocols,ports and source/destination ip addresses.
At the backend requires X.509 certificate and key to authorise changes.
How to configure security groups while creating instance.
You can configure security groups while creating instance or anytime after creating instance.
What is a Security Group?
It is a AWS firewall solution which filters the incoming and outgoing traffic from an instance.
Filtering is done based upon the ip protocols,ports and source/destination ip addresses.
At the backend requires X.509 certificate and key to authorise changes.
How to configure security groups while creating instance.
You can configure security groups while creating instance or anytime after creating instance.
Figure 1.0
Figure 1.1
Here you can configure security group.
Start configure security rules. Security rules for set of firewall rules that control the traffic. what kind of traffic can reach the instance.
The rules we are going to configure are Inbound rules.
SSH/RDP:
If we use linux based machine, configure SSH. SSH stands for secure shell. Secure access to the remote machine.It always communicates over port 22.It is static and you cannot change the port.
If it is Windows based machine, configure RDP. By default it will give root access to the machine.
If we select source anywhere, across internet can access the machine via SSH. This is quite dangerous.
You can choose custom ip for security purpose.
Web Traffic:
Web traffic can come from any source.
0.0.0.0/0 -> allows all the traffic.which is not secure.
HTTP communicates over port 80.
HTTPS always communicates over port 443.
Depends on what traffic you want to allow in, you can add rule here.
Figure 1.2
Figure 1.3
Thursday, 17 August 2017
August 17, 2017
aws instance types
General Purpose (T2, M3, M4 class):
These provides overall balance of Ram, CPU and provide burstable performance.
IOP starts from 100 and upto 3000.
Compute Optimized (C3 and C4 class):
It is meant for hude traffic.
Storage Optimized(I3 and D2 class):
It is for large datawarehouse.
Memory Optimized(X1, R3 and R4 class):
It is for Memcached and enterprise apps.
Accelerated Computing(P2, G3 and F1 class):
It is for general-purpose GPU compute applications,graphics-intensive applications and FPGAs.
These provides overall balance of Ram, CPU and provide burstable performance.
IOP starts from 100 and upto 3000.
Compute Optimized (C3 and C4 class):
It is meant for hude traffic.
Storage Optimized(I3 and D2 class):
It is for large datawarehouse.
Memory Optimized(X1, R3 and R4 class):
It is for Memcached and enterprise apps.
Accelerated Computing(P2, G3 and F1 class):
It is for general-purpose GPU compute applications,graphics-intensive applications and FPGAs.
Wednesday, 16 August 2017
August 16, 2017
Unabme to run docker without sudo
I am unable to run docker without sudo.
Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get http://%2Fvar%2Frun%2Fdocker.sock/v1.25/containers/json: dial unix /var/run/docker.sock: connect: permission denied
I added docker to user group
Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get http://%2Fvar%2Frun%2Fdocker.sock/v1.25/containers/json: dial unix /var/run/docker.sock: connect: permission denied
I added docker to user group
sudo usermod -aG docker $USER
Still i am unable to run without sudo.
Sunday, 13 August 2017
August 13, 2017
docker Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
Warning: failed to get default registry endpoint from daemon (Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?). Using system default: https://index.docker.io/v1/
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
Monday, 7 August 2017
August 07, 2017
Jupyterhub is not running on ubuntu 16.04
$ jupyterhub
/home/ubuntu/jupyterhub_config.py:6: UserWarning: IPython.utils.localinterfaces has moved to jupyter_client.localinterfaces
from IPython.utils.localinterfaces import public_ips
[I 2017-08-07 18:36:18.545 JupyterHub app:724] Loading cookie_secret from /home/ubuntu/jupyterhub_cookie_secret
[W 2017-08-07 18:36:18.576 JupyterHub app:365]
Generating CONFIGPROXY_AUTH_TOKEN. Restarting the Hub will require restarting the proxy.
Set CONFIGPROXY_AUTH_TOKEN env or JupyterHub.proxy_auth_token config to avoid this message.
[W 2017-08-07 18:36:18.579 JupyterHub app:864] No admin users, admin interface will be unavailable.
[W 2017-08-07 18:36:18.580 JupyterHub app:865] Add any administrative users to `c.Authenticator.admin_users` in config.
[I 2017-08-07 18:36:18.580 JupyterHub app:892] Not using whitelist. Any authenticated user will be allowed.
[I 2017-08-07 18:36:18.593 JupyterHub app:1453] Hub API listening on http://172.31.28.236:8081/hub/
[W 2017-08-07 18:36:18.596 JupyterHub app:1174] Running JupyterHub without SSL. I hope there is SSL termination happening somewhere else...
[I 2017-08-07 18:36:18.596 JupyterHub app:1176] Starting proxy @ http://*:8000/
/usr/bin/env: ‘node’: No such file or directory
[C 2017-08-07 18:36:19.605 JupyterHub app:1459] Failed to start proxy
Traceback (most recent call last):
File "/home/ubuntu/miniconda3/lib/python3.6/site-packages/jupyterhub/app.py", line 1457, in start
yield self.start_proxy()
File "/home/ubuntu/miniconda3/lib/python3.6/site-packages/jupyterhub/app.py", line 1197, in start_proxy
_check()
File "/home/ubuntu/miniconda3/lib/python3.6/site-packages/jupyterhub/app.py", line 1193, in _check
raise e
RuntimeError: Proxy failed to start with exit code 127
solution:
sudo apt-get install npm nodejs-legacy
