Program Studi: Manajemen Bisnis Telekomunikasi & Informatika Mata Kuliah: Big Data And Data Analytics Oleh: Tim Dosen
UNDERSTANDING BIG DATA
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
BIG DATA and DATA ANALYTICS 1. 2. 3. 4. 5. 6.
RPS / Course Plan (13 weeks) Lab Activity (week 3-week 12) Grade Percentage TASK1:UTS:TASK2:UAS -> 25%:25%:25%:25% Class Rules : Be Active, On Time (Before Time) Class Coordinator (pick one) Lab Activity using the following tools : R Language (R Studio), Orange, Weka, RapidMiner, Gephi
2
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
COURSE OBJECTIVE Understand conceptual, framework, opportunity and challenge of Big Data 2. Understand concept, theory, framework from Data Analytics activities 3. Able to choose and perform Data Analytics activities based on the contextual business problem 4. Able to build description model and prediction model using available data 1.
3
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
o o o o
OUTLINE
o o o
Introduction, Background & Definitions Data Driven Decision Making Big Data Properties Big Data Complexity Big Data Framework and State of the Art Big Data for Business Case Study
4
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Large Scale Data Telkom University
5
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Large Scale Data
6
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Background We are generating huge amounts of data (from UGC to mobile habit) o Our society is leaving behind a digital footprint (so our behavior / attitudes) o Finding unexpected pattern is so exciting (also useful for predictive analytics) o The need to find the usage of Large Scale of Data Warehouse (internal data) o
7
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
8
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Definition Telkom University
Big Data : It is a term for data sets that are so large or complex that traditional data processing tools are inadequate to process. The challenges include analysis, capture, data curation, search, sharing, storage, transfer, visualization, querying, updating and information privacy (wikipedia) o Data Analytics : It is the science of examining raw data with the purpose of drawing conclusions about that information. Data Analytics is used in may industries to allow companies and organization to make better business decisions and in the sciences to verify or disprove existing models or theories (wikipedia) o
9
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Definition Social Computing: It is an area of computer science that is concerned with the intersection of social behavior and computational systems. It is based on creating or recreating social conventions and social contexts through the use software and technology (wikipedia) o Data Science : It is interdisciplinary field about processes and system to extract knowledge or insight from data in various forms, either structured or unstructured. This field is continuation of some the data analysis field such as statistics, data mining, and predictive analytics(wikipedia) o
10
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Example (in a supermarket) :
1. Descriptive : Total Product A, B, C, D sold. Retailer will know which product are sold / popular 2. Predictive : People who buy product A, mostly also buy product B. Retailer know / predict the future event 3. Prescriptive : Giving recommendation what product to buy based on our profile / requirement. Giving recommendation how to achieve the goal
11
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Data Driven Decision Making Telkom University
• Data science involves principles, processes, and techniques for understanding phenomena via the (automated) analysis of data • The ultimate goal of data science as improving decision making, as this generally is of direct interest to business • Statistically, the more data-driven a firm is, the more productive it is—even controlling for a wide range of possible confounding factors. And the differences are not small. One standard deviation higher on the DDD scale is associated with a 4%–6% increase in productivity. • DDD also is correlated with higher return on assets, return on equity, asset utilization, and market value, and the relationship seems to be causal
12
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data Maturity Model
13
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Big Data Properties Telkom University
14
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data Complexity
15
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data Analytics Constructor
16
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data Approach Framework Some people prefer 3Vs, 6Vs or 7Vs even 12Vs to explain big data. But the original “bigness” measurement metrics are volume, velocity, and variety. For example 7Vs: 1. Volume 2. Velocity 3. Variety 4. Variability 5. Veracity 6. Visualitazion 7. Value 17
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Big Data State of The Art Telkom University
The.Jungle.Book.2016.720p.BluRay.x264-[YTS.AG].mp4
18
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data for Business
19
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Big Data for Business
• Given a set of transactions, find rules that will predict the occurrence of an item based on the occurrences of other items in the transaction Market-Basket transactions TID
Items
1
Bread, Milk
2 3 4 5
Bread, Diaper, Beer, Eggs Milk, Diaper, Beer, Coke Bread, Milk, Diaper, Beer Bread, Milk, Diaper, Coke
20
Example of Association Rules {Diaper} {Beer}, {Milk, Bread} {Eggs,Coke}, {Beer, Bread} {Milk},
Implication means co-occurrence, not causality!
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Big Data Use Case by Industry Telkom University
Energy
Telecommunication
Retail
• •
• • • •
• • • •
•
Smart Meter Analytics Distribution Load Forecasting and Scheduling Condition-Based Maintenance
Network Performance New Products and Service Creation Call Detail Records (CDRs) Analysis Customer Relationship Management
Dynamic Price Optimization Localized Assortment Supply-Chain Management Customer Relationship Management
Manufacturing
Banking
Insurance
• • • •
• • • •
• • • •
Supply Chain Management Customer Care Call Centre Preventive Maintenance and Repairs Customer Relationship Management
Fraud Detection Trade Surveillance Compliance and Regulatory Customer Relationship Management
Catastrophe Modeling Claims Fraud Reputation Management Customer Relationship Management
Public
Media
Healthcare
• • • •
• • •
• •
Fraud Detection Fighting Criminality Threats Detection Cyber Security
•
Large-Scale Clickstream Analytics Abuse and Click Fraud Prevention Social Graph Analysis and Profile Segmentation Campaign Management and Loyalty Programs 21
• •
Clinical Trials Data Analysis Patient Care Quality and Program Analysis Supply Chain Management Drugs Discovery and Development Analysis
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Example Data Science Model Construction Telkom University
22
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
23
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Business Intelligence Vs Data Science Telkom University
Based on data analytics types, Data Science’s practices focuses on prediction and prescription.
24
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Case Study : Hurricane Frances “Hurricane Frances was on its way, barreling across the Caribbean, threatening a direct hit on Florida’s Atlantic coast. Residents made for higher ground, but far away, in Bentonville, Ark., executives at Wal-Mart Stores decided that the situation offered a great opportunity for one of their newest data-driven weapons … predictive technology A week ahead of the storm’s landfall, Linda M. Dillman, Wal-Mart’s chief information officer, pressed her staff to come up with forecasts based on what had happened when Hurricane Charley struck several weeks earlier. Backed by the trillions of bytes’ worth of shopper history that is stored in Wal-Mart’s data warehouse, she felt that the company could ‘start predicting what’s going to happen, instead of waiting for it to happen,’ as she put it. (Hays, 2004)”
25
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Case Study : Customer Voice (Telco)
XL
Telkomsel 26
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
Research Roadmap
27
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Telkom University
To wrap up, Why Big Data Analytics Matters 1.
NEW DATA Example: eCommerce capturing clickstream
2.
UNLOCKING VALUE Example: Sentiment analysis from social networkds
3.
SHAPING THE FUTURE Example: modelling the future, anticipating & incluencing
28
Creating the great business leaders
Fakultas Ekonomi dan Bisnis
Program Studi:
Dosen:
School Economic and Business
MANAJEMEN BISNIS TELEKOMUNIKASI & INFORMATIKA
Yudi Priyadi, M.T.
Assignment Telkom University
o
o
Find a Case Study of Big Data Implementation / Application for Business or others o
State the objective, problems, solution idea
o
State the methodology used
o
State the model, measurement, accuracy
Learn Big Data online free course (www.bigdatauniversity.com)
29
Creating the great business leaders