Data HUB
solution
Big Data platform for
a Media Company
(C) Increase Technology Ltd.
Project features
INDUSTRY:
Media/Broadcasting
SCALE: 300 000 households
LOAD: 200 000 connections
Goal
Find and solve problems in
CDN streaming and balancing
Clickstream analytics to
optimize audience and
advertising strategies
Optimization of IT
infrastructure costs
(C) Increase Technology Ltd.
Challenge
Collect data from various
sources - CRM, billing, CMS, CDN
logs.
Analyze data on user
profile(number, cost,
consumption, channel), user
behavior (player events, video
path, device, billing), and
technical (speed, errors, traffic).
Provide data to different
consumers - BI systems,
monitoring tools, dashboards,
Help departments with data
insights - sales conversions for
Sales, communication history for
Maintenance, click-stream
analytics for Content/UX,
delivery speed and consumption
for Technical, service metrics for
Management
(C) Increase Technology Ltd.
Solution
We built the Data HUB
system for big data analytics.
It analyzes the data from our
subscribers’ life cycle and
creates reports, forecasts and
supply plans for new products.
Tools
Kafka Message Broker,
Flink,
Hive database
(C) Increase Technology Ltd.
Data HUB pipeline
Other
systems
CDN
systems
Data
Logs
Syslog
collector
Parser
Kafka Message Broker
Data
ETL
Flink
Data
Hive
DB
Data
Data Showcases
(C) Increase Technology Ltd.
Results
Created a unified system for
data collection and log
processing from multiple
sources
Monitoring and reporting on
the CDN status
Visualization and personalized
access to data for
management and analytics
Tracking, analysis and
forecasting of customer
actions
Development of a
recommendation system for
end users
(C) Increase Technology Ltd.