RMIT Classification: Trusted

RMIT Classification: Trusted
RMIT University
© School of Science, RMIT (formerly Computer Science and IT)
Slide 1
Cloud Computing
COSC 2626/2640
Supporting Information for Assignment 2
RMIT Classification: Trusted
Where cloud is used?
© School of Science, RMIT (formerly Computer Science and IT)
Slide 2
❑ Strategic Systems (Defense / Intelligence)
❑ Bioinformatics
❑ Visualization and Graphics
❑ Economics and Finance
❑ Scientific Computing
❑ …many more
RMIT Classification: Trusted
Case Study: Salesforce.com
❑ Perhaps the first truly successful “software as a service”
platform
❑ What is the software being provided?
 “Customer Relationship Management” (CRM) – tools for sales people to
find customers, keep in contact with them.
 Gives a bird’s-eye view of customers’ status, in-flight orders,
order history, leads, approvals, etc.
❑ How it works?
 ‘Only’ about 1000 mirrored machines for 55K enterprise customers,
1.5M subscribers
 10 Oracle databases across 50 servers
 AJAX Web interface with various communication services
© School of Science, RMIT (formerly Computer Science and IT)
Slide 3
RMIT Classification: Trusted
Case Study: Facebook
© School of Science, RMIT (formerly Computer Science and IT)
Slide 4
❑ Facebook provides some PaaS capabilities to application
developers
 Web services – remote APIs – that allow access to social network
properties, data, “Like” button, etc.
 Many third-parties run their apps off Amazon EC2, and interface to
Facebook via its APIs – PaaS + IaaS
❑ Facebook itself makes heavy use of PaaS services for their own
private cloud
 Key problems: how to analyze logs, make suggestions, determine which
ads to place
RMIT Classification: Trusted
Facebook APIs
© School of Science, RMIT (formerly Computer Science and IT)
Slide 5
❑ Read data from profiles and pages
❑ Navigate the graph (e.g., via friends lists)
❑ Issue queries (for posts, people, pages, …)
❑ Add or modify data (e.g., create new posts)
❑ real-time updates, issue batch requests, …
❑ How you can access it?
 Graph API
 FQL (Facebook Query Language)
 Legacy REST API
RMIT Classification: Trusted
Heroku ( PaaS)
❑ A new way of building and deploying web apps.
© School of Science, RMIT (formerly Computer Science and IT)
Slide 6
RMIT Classification: Trusted
Heroku
© School of Science, RMIT (formerly Computer Science and IT)
Slide 7
❑ Instant Deployment with Git push – build of your application is
performed by Heroku using your build scripts
❑ Plenty of Add-on services (applications, databases etc.)
❑ Processes scaling – independent scaling for each component of
your app without affecting functionality and performance
❑ Isolation – each process is completely isolated from each other
❑ Full Logging and Visibility – easy access to all logging output
from every component of your app and each process
❑ A simple web application written in node.js can handle around
60 – 70 requests per second.
Assignment 2
© School of Science, RMIT (formerly Computer Science and IT)
Slide 8
Uses Cloud platforms and technologies
RMIT Classification: Trusted
Publicly available data
© School of Science, RMIT (formerly Computer Science and IT)
Slide 9
❑ City of Melbourne public data: https://data.melbourne.vic.gov.au/
❑ Vicroads data
http://vicroadsopendata.vicroadsmaps.opendata.arcgis.com/
❑ Example Summarization
 Average vehicle count in a month in a road
 Which time of the day has most accidents
 Average car flows in freeways
❑ BOM data: http://www.bom.gov.au/climate/data-services/
 Find high temperature zones
 Find low rainfall zones
 Find seasons with highest rainfall in a year
RMIT Classification: Trusted
More public data source
Slide 10
❑ PTV Data: https://www.ptv.vic.gov.au/footer/data-andreporting/datasets/
❑ Spatial Data: https://www.data.vic.gov.au/data/group/spatial-data
❑ AWS Public dataset: https://aws.amazon.com/public-data-sets/
❑ Google book Ngram:
http://storage.googleapis.com/books/ngrams/books/datasetsv2.html
❑ Watson Analytics: https://dataplatform.cloud.ibm.com/community
❑ UCI Irvine Machine Learning repository: http://archive.ics.uci.edu/ml/
RMIT Classification: Trusted
Use of APIs
© School of Science, RMIT (formerly Computer Science and IT)
Slide 11
❑ Twitter API: https://dev.twitter.com/overview/api
❑ Twitter streaming API: https://dev.twitter.com/streaming/
❑ Facebook: https://developers.facebook.com/docs/apis-and-sdks
❑ Instagram API: https://www.instagram.com/developer/
❑ Youtube API: https://developers.google.com/youtube/v3/
❑ Soundcloud API: https://developers.soundcloud.com/docs/api/guide
❑ PTV API: https://discover.data.vic.gov.au/dataset/ptv-timetable-api
❑ Google map API: https://developers.google.com/maps/documentation/
❑ API for different online Games
❑ RIOT Game API: https://developer.riotgames.com/
RMIT Classification: Trusted
Past Students’ Submissions
Provide you some ideas about
❑Possible cloud applications
❑How to design cloud application architecture
❑What cloud services you can use
Notes:
❑Some works may not meet the current A2 requirements
❑Some technologies may be out-of-date
❑Some past technologies may be replaced by new advanced
technologies
RMIT Classification: Trusted
Real-time analysis of FitBit Data
Slide 13
RMIT Classification: Trusted
Real-time analysis of FitBit Data
Slide 14
RMIT Classification: Trusted
Electroencephalogram (EEG) brainwave Analysis
Slide 15
RMIT Classification: Trusted
Wellness calculator app
❑ Health wellbeing calculator ( an Andriod app)
❑ Uses AWS Lambda
Slide 16
RMIT Classification: Trusted
Health application
© School of Science, RMIT (formerly Computer Science and IT)
Slide 17
❑ Example: diet watcher
 Different kind of information per user ( daily intake of Food ) –
dynamoDB?
 User can set a goal for calories intake
 Compare daily intakes
 Recommend future intakes
❑ Example: Sleep Quality tracker
 Time user goes to bed, Time of wake up, total time of sleep, total time of
awake, …
RMIT Classification: Trusted
Road Traffic data analysis – A distributed model
© School of Science, RMIT (formerly Computer Science and IT)
Slide 18
RMIT Classification: Trusted
Road Traffic data analysis
❑ Tier 1 – Hosted website on IBM Bluemix
Server
❑ Tier 2 – Jersey server included as part of
the IBM Java Library. Handles routing for
all the API calls made in tier 1
❑ Tier 3 – a thirdparty MongoLab ( a free
MongoDB (NoSQL) on cloud database).
❑ Outcome: A summarized information
about traffic congestions
Slide 19
RMIT Classification: Trusted
VicRoads data analysis
❑ Dangerous areas
for accident in
Victoria
❑ Age group
causing most
accidents
❑ Which time of
the day has
more accidents
Slide 20
RMIT Classification: Trusted
PTV API
g
❑ Report train delays using
PTV API
❑ PTV doesn’t like to tell you
that their trains are runnin
late.
Slide 21
RMIT Classification: Trusted
PTV API
Slide 22
RMIT Classification: Trusted
El-nino/La-nina predictor
❑ compare the rainfall data provided
for public use by the Australian
“Bureau of Meteorology” to the
“Oceanic Nino Index” data provided
by NASA.
Slide 23
RMIT Classification: Trusted
Weather recommendation system
© School of Science, RMIT (formerly Computer Science and IT)
Slide 24
❑ Use your calendar event ( Google calendar API)
❑ Use any Forecast API ( forecast.io )
❑ Recommend weather of your event day
❑ Static information ( in cloud storage )
❑ Dynamic modules ( in cloud hosting )
❑ Speed up computation ( load balancing )
RMIT Classification: Trusted
Free Rider
❑ Share free ride via social app to help
people during trip
❑ Uses facebook API
Slide 25
RMIT Classification: Trusted
Schedule social app posting
❑ Provide facilities to user to
schedule their post on
social app
❑ Schedule personal post so
it will appear your/your
friends timeline at the time
you want.
❑ Use of facebook API
Slide 26
RMIT Classification: Trusted
Trending Tweets
❑ Which geographical locations are tweeting the most popular
hashtags and words.
❑ Use of twitter streaming API and
Google Map API
❑ Beanstalk for hosting
© School of Science, RMIT (formerly Computer Science and IT)
Slide 27
RMIT Classification: Trusted
Restaurant finder
❑ Find nearby popular
restaurants from instagram
posts
❑ Uses Alchamy API and
Instagram APi
Slide 28
RMIT Classification: Trusted
Google books n-gram data analyser
❑ Retrieve most popular 30
countries from Big data
using MapReduce
❑ Show summarization
using Google visualization
APIs (i.e. Google Heat
Map, Google Table,
Google BarChart,
PieChart)
Lecture 1
Cloud Computing 2018 Ibrahim Khalil by
Abdur Forkan Slide 29
RMIT Classification: Trusted
Mobile Application usage tracker System
❑ Track usage of app of an android
mobile user
❑ Predict: What type of person he/she
is (e.g. if use of sports app is high
then he is a sports lover)
Slide 30
RMIT Classification: Trusted
Mobile Application usage tracker System
Slide 31
RMIT Classification: Trusted
IoT: Processing sensor data in real-time
❑ Real-time data processing of
distributed sensor network
Slide 32
RMIT Classification: Trusted
Data centre provisioning
❑ Allows users to register and
provide virtual machines to
new users so that they can
access from a graphical
interface via an web
application
Slide 33
RMIT Classification: Trusted
Shop Alert
❑ User makes a list of their
desired product list
❑ Alert users when nearby
products in their whish-list
are available in nearby shops
Slide 34
RMIT Classification: Trusted
Steganography
❑ hiding of secret data
within exposable data
❑ Example: we can take
the readings of a
house meter from a
particular individual
and conceal secretive
details such as their
date of birth, name,
address and so forth,
without ever showing
signs of this data
being there
Slide 35
RMIT Classification: Trusted
Home automation
Slide 36
RMIT Classification: Trusted
Home automation
Slide 37
RMIT Classification: Trusted
Temperature sensor logger
Slide 38
RMIT Classification: Trusted
Finding nearby movies
Slide 39
RMIT Classification: Trusted
Location based public wall chat application
Slide 40
RMIT Classification: Trusted
Android Remote Controller App for Robot
Slide 41
RMIT Classification: Trusted
Weather data analytics
Slide 42
RMIT Classification: Trusted
Video encoding
© School of Science, RMIT (formerly Computer Science and IT)
Slide 43
❑ Encode a video file into another format using ffmpeg.
❑ Normally takes long time if encoding is done in one machine
❑ Different chunks of the video file will be processed on several
VM instances/nodes in a cluster simultaneously and then
reassembled.
❑ Saved the generated file in cloud storage.
❑ Makes the process faster
RMIT Classification: Trusted
Event scheduler
© School of Science, RMIT (formerly Computer Science and IT)
Slide 44
❑ Schedule information from different apps
❑ The events only you are interested
❑ Birthday reminder
❑ Send you reminder
RMIT Classification: Trusted
More ideas about application
Slide 45
❑ Multi-Server online Game / Multiplayer game
❑ Play the most popular music of a city using GPS tracking
❑ Menu Planner: Organise cooking menu and plan meals based on
ingredients and diets for the upcoming days.
❑ Game matchmaking
❑ Many more……………
RMIT Classification: Trusted
About data visualization
Slide 46
❑ Making data visual is a big part of making it understandable and
useful.
❑ For all the excitement about novel data sources like social
computing or the Internet of Things (IoT), data analysis will
eventually flow into a report or dashboard where someone must
make sense of it.
❑ For better judgement you need tools for building clearer and
sharper visualizations.
❑ Spend more time working on visualizations because someone
else is taking care of the infrastructure
RMIT Classification: Trusted
About data visualization
Slide 42
❑ Instead of spending their time optimizing SQL queries or data
warehouse configuration you can consider whether a bar, line,
or pie graph is the best way to convey information.
❑ when it makes sense to stick with a tabular presentation but use
typography and white space to make data easier to scan.
❑ Hadoop, which make it possible to store very large volumes of
information without users knowing in advance how they’ll query
it. But how you will show the query result to the user?
RMIT Classification: Trusted
Sample visualization
Slide 48
RMIT Classification: Trusted
Sample visualization
Slide 49
RMIT Classification: Trusted
Sample visualization
Slide 50
RMIT Classification: Trusted
Sample visualization
Slide 51
RMIT Classification: Trusted
Sample visualization
Slide 52
RMIT Classification: Trusted
Google cloud DataLab
Slide 53
❑ A powerful interactive tool created to explore, analyze and visualize data
with a single click on Google Cloud Platform.
❑ It runs on Google App Engine and orchestrates multiple services
automatically so you can focus on exploring your data.
❑ Cloud Datalab enables analysis of your data on Google BigQuery, Google
Compute Engine, and Google Cloud Storage using Python, SQL, and
JavaScript.
❑ Once you are satisfied with your transformation and analysis models,
deploy them to BigQuery with the click of a button.
❑ Use Cloud Datalab to gain insight from your data. Interactively explore,
transform, analyze, and visualize your data
❑ https://cloud.google.com/datalab/
RMIT Classification: Trusted
Amazon Quicksight
Slide 54
❑https://aws.amazon.com/quicksight/
❑ You get very fast, easy to use business intelligence for your
big data at low cost
RMIT Classification: Trusted
Tools for Data visualization
Slide 55
❑ Google chart API: https://developers.google.com/chart/
❑ Jgraph: http://jpgraph.net/
❑ Chart JS: http://www.chartjs.org/
❑ Angular Chart JS: http://jtblin.github.io/angular-chart.js/
❑ Kibana: https://www.elastic.co/products/kibana
Google chart API <html>
<head>
https://www.gstatic.com/charts/loader.js
<script type=”text/javascript”>
google.charts.load(‘current’, ‘packages’:[‘corechart’]);
google.charts.setOnLoadCallback(drawChart);
function drawChart()
var data = google.visualization.arrayToDataTable([
[‘Task’, ‘Hours per Day’],
[‘Work’, 11],
[‘Eat’, 2],
[‘Commute’, 2],
[‘Watch TV’, 2],
[‘Sleep’, 7]
]);
var options =
title: ‘My Daily Activities’
;
var chart = new google.visualization.PieChart(document.getElementById(‘piechart’));
chart.draw(data, options);

</script>
</head>
<body>
<div id=”piechart” style=”width: 900px; height: 500px;”></div>
</body>
</html>
Slide 51
RMIT Classification: Trusted
Google Map
Slide 57
❑ Geocoding
http://www.findlatitudeandlongitude.com/batchgeocode
❑ Google Fusion Table: https://www.google.com/fusiontables
❑ Google MAP API:
https://developers.google.com/maps/documentation/javascript/e
xamples/
RMIT Classification: Trusted
Google MAP API
Slide 58