Description
Advanced physical database modeling and design.
IBM Business Intelligence (BI) and
Analytics Update
Mike Biere
IBM
March 2
nd
, 2011 8am – 9am
By 2013, 33% of business intelligence functionality will be
consumed via handheld devices.
By 2013, 15% of BI deployments will combine BI, collaboration
and social software into decision-making environments.
Analysts forecast next generation analytics systems
• By 2014, externalizing BI will increasingly become an expected
aspect of most companies' relationships with customers and
partners.
• Externally focused BI programs will frequently go beyond information
dissemination by facilitating a collaborative decision-making process
that breaks through the firewall to involve stakeholders from
organizations in a broad ecosystem.
.
Source : Gartner, Prepare for Customer-Facing Business Intelligence, Kurt Schlegel ,October 2010
Source : Gartner, Predicts 2011: New Relationships Will Change BI and Analytics, November 2010 ,
Bill Gassman, Rita L. Sallam, Andreas Bitterer, John Hagerty, Neil Chandler
By 2012, BI Platform capabilities will be embedded as
a service within 75% of new business applications
By 2012, emerging technologies will significantly
drive adoption of BI to 50% of business users
(e.g. interactive visualization, in-memory analytics, search,
SaaS and SOA )
.
Source : Gartner BI Summit 2008, 4/2008
Embedded Analytics
Mash ups
What Matters …is changing
New Intelligence Enterprise Survey of 3,000 executives
Historic trend analysis
And forecasting
Standardized
reporting
Data
visualization
Analytics applied within
Business processes
Simulations and
Scenario development
Clustering and
segmentation
Regression analysis,
Discrete choice modeling and
Mathematical optimization
Historic trend analysis
And forecasting
Standardized
reporting
Data
visualization
Analytics applied within
Business processes
Simulations and
Scenario development
Clustering and
segmentation
Regression analysis,
Discrete choice modeling and
Mathematical optimization
Source: MIT Sloan Management Review,10 Data Points: Information and Analytics at Work,
N Kruschwitz and R Shockley, Fall 2010
Respondents were asked to
identify the top three
analytic techniques creating
value for the organization
and predict which three
would be creating the most
value in 24 months.
IBM customers have demanded …
…and we have responded
• Data Warehousing technologies for System z from IBM
InfoSphere Information Server
InfoSphere Warehouse
IBM Smart Analytics System 9600
• Database enhancements for BI/BA
DB2 for z/OS V10
ISAO – IBM Smart Analytics Optimizer
• Business Intelligence and Business Analytics
Cognos 10 for Linux on System z
SPSS for Linux on System z
IBM Smart Analytics Cloud (a result of IBM’s Blue Insight Project)
The IBM InfoSphere Vision …
defining an infrastructure
An Industry Unique Information
Platform
• Simplify the delivery of Trusted
Information
• Accelerate client value
• Promote collaboration
• Mitigate risk
• Modular but Integrated
• Scalable – Project to Enterprise
Global Name
Recognition
Warehouse Warehouse
Cognos
BI
InfoSphere
Information
Server
ETL ETL
Data Quality Data Quality
C
o
m
m
o
n
M
e
t
a
D
a
t
a
C
o
m
m
o
n
M
e
t
a
D
a
t
a
Dynamic Warehousing
The Integrated Stack for System z
InfoSphere
Industry Models
InfoSphere
Warehouse
Cubing Cubing
InfoSphere
MDM Server
Information
Services
Director
Data Synchronization
Replication
Server
Classic Event
Publisher
Classic
Federation
Federation
Change Data
Capture
Operational Source Systems
Structured/ Unstructured Data
Operational
Applications
Global
Name
Recognition
Master Master
Data Data
Smart
Analytics
Optimizer
Smart Analytics
System 9600
SPSS
Continuous business
operations
Reduce
business risk
Green strategy
Energy and space
Secure Cloud
Services
High business
growth
HIGH SCALABILITY
Flexibility and
speed to respond
EXTREME
VIRTUALIZATION
SECURITY EFFICIENCY
CLOUD
HIGH AVAILABILITY
/RELIABILITY
System z selected to meet critical business needs
Data Warehousing Enhancements
InfoSphere Information Server - for Linux on
System z
Business Glossary DataStage
Parallel Processing
Rich Connectivity to Applications, Data, and Content
Enterprise Data
Dictionary
Extract, Transform, and
Load in Batch or Real-
time
Information Services Director
Metadata Workbench / FastTrack
Publish SOA services for information
integration and access
Information Analyzer
Data Source Profiling &
Problem Diagnosis
Manage and track consistent metadata across information integration
tasks and automate generation of data flow logic
Federation Server
Virtualize access to
disparate information
CDC & Replication
Deliver and replicate
changed data
QualityStage
Global Name Recognition
Recognize & Classify
Multi-cultural names
Data Quality: Standardize,
Correct & Match Data
InfoSphere Information Server & Foundation Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand Cleanse Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Understand the impact
of making changes to
the information
environment
Visualize and trace
information flows across
the enterprise landscape
Access and report on
operational metadata
Increase compliance to
standards
Increase confidence and
trust in your information
Requirements
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand
Cleanse Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Requirements
Capture business terms
and classifications
Link business terms and
classifications to IT assets
Perform data quality
assessment
Define business rules to
monitor data quality
Discover data
transformation rules and
heterogeneous
relationships
Identify hidden sensitive
data for privacy
Define business object for
archival and test data
applications
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand
Cleanse
Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Effectively manage
complex challenges of
multicultural names
Support initiatives for
CRM, threat and fraud,
and more
Manage complex
multicultural names
Support initiatives that
depend on consistent
data like:
- CRM
- fraud detections
- threat management,
Requirements
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand Cleanse
Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Integrate and transform
multiple, complex, and
disparate sources of
information to feed:
- data warehouses
- MDM initiatives
- Business analytics
- eCommerce, …
Deliver critical information
to the point of action
Minimize impact on
production systems
Guarantee data integrity
Enable data delivery in
batch or real time based
on resource and latency
constraints
Seamlessly support
mainframe, distributed,
structured and
unstructured data sources
Requirements
InfoSphere Warehouse on System z
Delivers Data Warehouse Suite on System z -
• Advanced physical database modeling and design – Design Studio
• In-database data movement and manipulation capabilities of
SQL Warehouse Tool (SQW)
• Optimize multidimensional reporting and analysis of data with
Cubing Services
Cubing Cubing
Services Services
SQW SQW
Operational Source Systems
Warehouse Warehouse
DB2 z/OS DB2 z/OS
DB2 & Other DB2 & Other
Sources Sources
MS Excel
Other
MDX
IW Design Studio
Linux on System z
SQW SQW
Key Component Overview - Warehouse for tooling DB2 for z/OS
• Data Server Component – Prerequisite
• DB2 for z/OS -- Not included in the offering, prerequisite
Application Server Components – Linux on System z Partition
• WebSphere Application Server
• Manages/executes the SQW runtime processes
• Server for the browser-based Admin Console
• SQW Runtime
• Execution engine for SQW jobs (control flows, data flows)
• Runs in the WAS environment
• Cubing Services engine
• Cube server providing cube access to MDX clients through ODBO and XMLA
• Cubing engine and cube optimizer ported to Linux on System z.
• Design and Administration Client Components – Windows, Linux
• Design Studio, Eclipse-based design tool
• Physical modeling based on Rational Data Architect (RDA)
• SQW Data flow, control flow editor – extension of RDA
• Cubing Services cube model editor, optimization tool – extension of RDA
• Admin Console, browser-based administration tool
• Common admin tasks, data source, role-based security assignments
• Cube metadata management (import/export)
• Cube Server management (configure / start / stop, etc.)
• SQW runtime job administration
15
IBM Smart Analytics System 9600
Unprecedented Value in Deploying New Business Analytics
How is it different?
Secure, Available Business Analytics
– Rapidly delivers analytic information to decision makers
at the time of decision.
– New environment for the availability, reliability and
scalability necessary to stay aligned with the operational
systems
Simplified administration
– Appliance-like delivery
– Faster deployment at lower cost.
– Leverages customers existing disaster recovery, and
backup processes
Proven Operational Characteristics
– Extends the qualities of service of System z.
– Reduces risk through extending System z manageability
and security across the entire system.
High Value Operational BI
– Cost effective way to drive daily operational decisions
What is it?
The IBM Smart Analytics System 9600 is an
integrated solution of hardware, software and
services that enables customers to rapidly deploy
cost effective game changing analytics across their
business.
Delivering business results in days, not months
Optional Value Priced Add-ons
Tivoli OMEGAMON for DB2 Performance Expert
DB2 Connect
Tivoli Directory Server
InfoSphere Information Server
InfoSphere Replication Server
Q-Rep, CDC and Event Publisher eligible
InfoSphere Federation Server plus Classic Federation on System z
SPSS
Tivoli ITCAM, ITUAM
Cognos Now! For Linux on System z
Cognos Blueprints for Healthcare, Banking and others…
BI User on-boarding application (as proposed for Smart Analytics Cloud)
Powerful Data Warehouse and BI Software
DB2 for z/OS Value Unit Edition (primary) V9
Option for MLC
DB2 Utilities Suite V9
InfoSphere Warehouse on System z V9.5.2
Cognos 8 BI for Linux on System z V8.4
z/OS Operating System Stack V11
17
IBM Smart Analytics System 9600 Software
Deeply Optimized by IBM Experts…Flexible Growth…
Database Enhancements
Ve vill pump you
up! Sissy boy!!
• Versioned data or temporal queries
• pureXML and SQL enhancements
Applications
• More online schema changes
• Concurrency for catalog & utilities
• Improved security controls and audit
Resiliency
• CPU reduced: transactions & queries
• Ten to twenty times more
concurrent users
Efficiency
DB2 V10 for z/OS What’s exciting?
Productivity improved for DBAs, application
programmers, & systems – ability to ‘leap’ from V8 V10
IBM Smart Analytics Optimizer
Technology Preview for System z
How is it different
Deep integration with
IBM data management systems
High performance query software,
based on advanced data in-
memory technologies
Leveraging existing data system
investment and values without any
changes to applications
For System z, extends gold-
standard manageability, security,
and availability to high-
performance analytic applications
What is it?
A high performance extension that
is integrated with IBM DB2 for
z/OS delivering predictable, order-
of-magnitude faster, analytic query
response times, while lowering
operating costs
21
Orders of Magnitude Faster for Queries
Beta Customer Results
... and its acceleration factor : :
163 s
2311 s
25 s
1593 s
35 s 8s
5435 s
48
Runtime of queries w/o ISAO
with ISAO
511
12
206
4
1424
Factor
8s
4s
2s
5s
3s
For customers who have struggled with
gaining the required performance out their
complex queries of full table scans, multiple
compares, and complex logic – the results
are astounding!
CLIENT
Disk
Storage
Fibre Channel
HMC HMC
Ethernet Switch
OSA-Express3
10 GbE
BladeCenter
IBM Smart Analytics Optimizer Product Components
Private Service Network
Private Data Network
Data Warehouse application
DB2 for z/OS enabled for
Smart Analytics Optimizer
Data Studio
Foundation
Smart Analytics
Optimizer Admin
Plug-in
zEnterprise
IBM Smart
Analytics
Optimizer
DS5020
Disk
zBX
Business Analytics Enhancements
C O G N O S
Measure and Monitor to See “How” You’re Doing
Dashboards
• Provide at-a-glance, high impact views of complex
information
• Help quick focus on issues that need attention and action
• Combine information across disparate sources
• Benefit from range of highly visual personalized,
managed, or self-assembled dashboards
• Gain personalized views of operations with continuous
monitoring
H
Real-time Monitor Business Operations
• Continuously monitor and alert when
exceptions occur to take immediate action
• Detect events, anomalies and trends in data streams
flowing through transactional and messaging systems
• Aggregate data streams across multiple transactional
systems and data sources
• Enable self-service with user-defined dashboards,
operational KPIs, and alerts
• Address full operational decision cycle from detection to
action
Moni t or
Moni t or Moni t or
Al er t
Al er t Al er t
Anal yze
Anal yze Anal yze
Respond
Respond Respond
Understand the “Why” Behind
Business Performance
• Address full breadth of report needs (personalized,
transactional, management, statutory, production…)
• Deliver consistent information across all types of output
• Personalize and target to each department/individual
without having to re-author
• Re-use queries, analyses, express author reports in
business and collaborate on design with IT
• Easy access to data lineage, definitions of terms, and
annotations
Ad-hoc Query
• Intuitive, self-service reporting
• Access to all data; drag and drop query creation
• Easy sorting and filtering
• Corporate templates for consistency
• Share ad-hoc or promote for professional distribution
J
Reporting
Dig Deeper - Investigate Possible Better Outcomes
Analysis
• Compare and contrast to reveal symptoms and
causes behind trends
• Gain same analysis experience on Web or in Excel
interfaces
• Perform personal exploration across multiple
dimensions of information
• Move from summary level to detail effortlessly
J
Enhance decisions with Statistics and Predictors
of “What Might Happen”
• High-performance data mining and text
analytics workbench
• Quickly delivers positive ROI by creating the
predictive intelligence
• Set of mining algorithms that provide insight and
prediction
• Enables the discovery of key insights, patterns
and trends in data that can be used to optimize
business decisions
• Advanced statistics and data management
for analysts researching business problems
• Analysis, interpretation, explanation and presentation
of data
• Provides insight into a sample of data and tools for
prediction and forecasting based on the data
• Flexible enterprise foundation for managing
and deploying analytics throughout the
organization
Predictive Analytics
H
Flexible Access Wherever and Whenever Needed
• Receive in any format (PDF, HTML, Excel, XML…)
• Deliver in any language with robust Unicode support
• Access refreshable BI content in any location that best
serves the individual (Excel, PowerPoint, Word, Enterprise
Search, Portal)
• Search to find instant answers, related content and to
author based on search terms
• Browse BI content on mobile devices including
BlackBerry, Windows Mobile and Symbian devices
• Automate personal alerts, email bursting, scheduled report
production
• Mashup within applications and in processes
J
BI Anywhere
Deploy and Manage your BA environment
• Deliver information in terms business understands
• Combine data into a single view across multiple
disparate sources, including OLAP and relational
• Optimize models with built-in advisor, impact
analysis, and integration with 3
rd
party metadata
• Easily manage multi-lingual, multi-tier models with
reusable objects, versioning and retargeting
• Flexibly deploy model packages to deliver relevant
views securely to different communities
Administer the Deployment
• Complete view of system activity
• Task-oriented system monitoring
• Integration with 3
rd
party EMS
• Proactive administration before business impact
• Comprehensive security down to data layer
• Visual upgrade with automated
environment validation
J
Model Information Services
The Top 10 of Cognos 10
1. Unified workspace with greater power, intuitive
navigation and cleaner look
2. Breadth of analytics across historical, real-time
and predictive information
3. Collaborative BI through built-in collaboration and
social networking
4. Easy data inclusion by the business from one
value, to entire data sets and external files
5. Analytics on the go for more devices and
disconnected interaction
6. Faster performance with in-memory processing
7. Seamless upgrade and ease of ongoing
management
8. Trusted expertise with built-in training videos,
‘how-to’ books and user communities
9. Expanded deployment options include Cloud,
System z, and Power
10. Cognos 10 Ready added value of TM1, Planning,
Analytic Applications and SPSS Modeler
Cognos working with CICS (in progress)
33
3
3
IMS Integration with Cognos
IMS V11 Open Database:
•IMS V11 allows distributed access over TCP/IP using the IMS Universal Database Driver
(JDBC)
•IMS Connect and Open Database Manager now work together as a DRDA server for
IMS data
• Shipped with IMS V11 – requires System Programmer for initial setup
Windows, Linux, Unix, and zLinux
z/OS
Cognos
IMS
Universal
Database
Driver
T
C
P
I
P
T
C
P
I
P
IMS Connect
S
C
I
ODBM
S
C
I
O
D
B
A
CTL IMS
DB
PC
IMS
TCPIP
L100RP01# SQL Activities
0
200
400
600
800
1000
1200
13:28 :00
13:30:00
13:32:00
13:34:00
13:36:00
13:38:00
13:40:00
13:42:00
13:44:0 0
13:46:0 0
13:48:0 0
13 :50:0 0
13 :52:0 0
13 :54 :00
13 :56 :00
13 :58:00
14 :00 :00
14 :02 :00
14:04:00
14:06 :00
14:08:00
14:10:00
14:12:00
14:14:00
SQL
Cognos 8 BI for Linux on System z
….Performance Testing
• Customer provided the need:
• Processes operational and financial data for
10.000 other companies and exchanges info with
250 B2B partners.
• Faced with performance & stability issues and
could not expand it’s BI any further.
• IBM Provided the Test Infrastructure:
• Cognos 8 BI v3 and Websphere set-up on a
zLinux and a DB2 instance on z/OS.
• Numius Provided the Expertise:
• Ported existing application from the distributed to
System z:
• Cognos 8 BI
• Oracle on HP-UX to DB2 on z/OS
• MS-SQL on Wintel to DB2 on zLinux)
• MS-IIS on Wintel to WebSphere on
zLinux).
• Cognos Provided the Flexibility:
• Cognos 8 BI - open to Operating Systems and
Database Systems, no redevelopment was
required
The Results
Cognos 8 BI for Linux on System z
• By adhering to our best practises could
support more users and deliver faster
performance.
• There was no change in functionality at the
Cognos 8 BI level, so no impact whatsoever
for the end-user.
• Not one report timed out, not one user was
rejected. Even when the system slowed
down, it remained stable.
• No redesign was needed to achieve his
objective of reaching out to a large
community.
• System z was 400x faster in
this case!!!
Cognos 10 is showing even greater
improvements on System z – work underway
IBM Cognos 8 BI within a z/VM environment
“Distributed” Deployment with Over-commit
Total allocation of real IFLs to z/VM remains the same = 8
Number of virtual Cognos instances similar to other platforms’ physical servers or partitions
Individual Cognos components distributed on individual Linux “guest” servers
Number of virtual CPs /Cognos = 11 : instance increased on high CPU instances to enable use of excess capacity from low
CPU instances
Number of virtual CPs/Cognos instance should be less than or equal to number of GPs/IFLs assigned to z/VM LPAR
Over-commit ratio (sum of virtual resource type/real resource type assigned to z/VM LPAR) varies from 1.5/1 to 20/1 or more
– highly dependent upon
how active the guest server is
Content Manager
Content Manager
Cognos
CM
Cognos
CM
WAS
WAS
Content Store
Content Store
DB2
DB2
z/VM
vCP
vCP
vCP
vCP
vCP
vCP
vCP
vCP vCP
vCP
vCP
vCP
vCP
vCP
Report Server 1
Report Server 1
Cognos RS
Cognos RS
WAS
WAS
Report Server 2
Report Server 2
Cognos RS
Cognos RS
WAS
WAS
HTTP Server
HTTP Server
Linux 1 Linux 2 Linux 3 Linux 4 Linux 5
vCP
vCP
GP zAAP zAAP zIIP zIIP IFL IFL GP GP GP GP GP IFL IFL IFL IFL IFL IFL
IBM System z Mainframe
HTTP Server
HTTP Server
Cognos
Gateway
Cognos
Gateway
WAS
WAS
vCP
vCP
vCP
vCP
vCP
vCP
Multiple Linux systems
– virtualization with CPU over-allocation
0
200
400
600
800
1000
1200
1400
T
x
n
/
m
i
n
OpBI 50 OpBI 75 Saved Rep 75 Saved Rep 150 Mixed 60-30-10 Mixed 30-60-10
0
1
2
3
4
5
6
7
8
9
R
e
s
p
o
n
s
e
T
i
m
e
OpBI 50 OpBI 75 Saved Rep 75 Saved Rep 150
Multiple Linux Sys
Multiple Linux Sys
(overallocated)
Avg. txn duration (lower is better) Throughput (txn/min) (higher is better)
• With additional virtual CPU capacity available to the Report Server and HTTP Server, response times were lowered, and more transactions
could be processed.
IBM’s Pains:
• Segmented investments in
BI tooling and infrastructure
• Silo’d development,
redundant and possibly
competing
• Lack of tooling
standardization
• Limited visibility to the total
cost of business
intelligence costs for the
enterprise
• Organizational reluctance
to a centralized service
IBM’s Blue Insight
In the spotlight
Our commitment to informed decision making led us to consider private
cloud delivery of Cognos via System z, which is the enabling foundation
that makes possible +$25M savings over 5 years.
-IBM CIO Office
IBM’s Results:
Consolidating 115 multi-product,
departmental BI deployments to 1
Cognos 8 BI on System z
Support for our global workforce
2009 – 72K
2010 – 130K
2011 – 200K
Realizing value from +60 data
sources across IBM
Projected $25M in savings
60% Consolidation
35% Standardization
5% Automation
IBM’s Strategy:
Common BI “appliance
like” service for delivering
BI to IBM
Common service definition
and boarding process
Business intelligence
experts to assist adopters
Start with BI, grow to:
Predictive Analytics
Data Warehouse
Learn more: ibm.com/software/systemz/telecon/1jun
What Exactly is Blue Insight?
Transformational technology delivery matched with process and solution delivery model
changes
• Common BI “appliance like” service for delivering Business Intelligence to IBM
• Common extensible infrastructure ( HW & SW)
• Common operational support
• Common management of Cognos 8 BI licensing and Level 3 support
• Common service definition and boarding process
• Defined BI tooling service scope (Reports, Adhoc, cubing, pervasive, etc)
• Defined standard security and LDAP management
• Common operational processes
• Business intelligence experts to assist adopters
• BICC - (Business Intelligence Center of Competence)
• Consultants available to assist in solution definition and consumption of service
• Blue Insight is NOT an enterprise data strategy or a portal strategy
• Assumes data consumed by reports is a trusted part of the enterprise data strategy
• Initial scope of Blue Insight was to use the standard Cognos portal delivery
Initial Business case
> $25M Savings over 5 years…
• Business case
categorization
• Infrastructure
• Operations
• Skill efficiency
VIRTUALIZATION
+
STANDARDIZATION AUTOMATION
+
Increased
Flexibility
=
Reduced
Cost
Increased
Flexibility
5%
•Adopter administration
35%
•Operations efficiency
•Development efficiency
•Improved time to value
60%
•HW Consolidations
•SW Costs
•3
rd
Party vendor savings
Automated provisioning Common operations
process
Shared Cognos V8
Predictive planning Common promotion
process
Shared middleware
Automated
choreography &
administration
Common security Shared peripheral
infrastructure
Web 2.0 Boarding
application
Common service
definition
Z10 Infrastructure
* - Future focus
Smart
Analytics
Cloud
A private cloud within
the enterprise
A solution for delivering business
intelligence to the entire organization
Creates … That delivers …
The Smart Analytics Cloud solution offering
Open, enterprise-class BI platform
Web Office Search
Mobile
Cognos 8 BI
A broad range of BI capabilities
IBM System z
Centralize, Virtualize & Simplify the BI
infrastructure
IBM software
IBM hardware
• Phase 1: Create
awareness of, a strategy
for and a governance
foundation for BI across
the organization
• Phase 2: Preparation for
the Smart Analytics Cloud
IBM Services
Phase 3: Install the base cloud, integrate into the
corporate enterprise and test the cloud use cases
Phase 4: Educate the enterprise for on-going
success with the Smart Analytics Cloud
The solution components …
Report Authors
Cloud Administrators
BI Administrators
Smart Analytics Cloud is optimized for the enterprise
This offering transforms the delivery of business intelligence and performance
management into a service that is readily available and affordable to corporate users.
Smart Analytics Cloud
p
r
o
d
u
c
t
i
o
n
L
P
A
R
WAS
z/VM
Cognos
Linux
DB2
D
e
v
/
t
e
s
t
L
P
A
R
WAS
z/VM
Cognos
Linux
DB2
Marketing
Line of Business ‘A’
R&D
Data Mart/
Warehouse
HR
Data Mart/
Warehouse
Data Mart/
Warehouse
Finance
Operations
Data Mart/
Warehouse
Line of Business ‘B’
Marketing
R&D
Data Mart/
Warehouse
Senior
Executives
Large enterprise organization
Tivoli
Monitoring &
Metering
Tivoli
Monitoring &
Metering
Cloud
boarding
application
View the demo:http://ibmurl.hursley.ibm.com/JQ4
SPSS Solutions - Modeler
Predictive Analytics
Predictive Analytics helps connect data to effective
action by drawing reliable conclusions about current
conditions and future events.
—Gareth Herschel, Research Director, Gartner Group
Predictive Analytics with Modeler
Data mining uses existing data to:
– Predict
• Category membership
• Numeric Value
– Group / Find Outliers
• Cluster (group) things together based
on their characteristics/attributes
– Associate
• Find events that occur together
– Sequence
• Forecasting/ Time-dependent events
Modeler Key Features
• Ease of use
• Openness
• Productivity
• Automatic Model Selection
• Powerful Data Manipulation/Transformation Functionality
• Multiple Levels of Model Deployment
• Very Scalable*
• Leverages existing database functionality*
• SQL Pushback
• In-Database Mining
*Server
Customers use Modeler when they want to…
• Integrate and analyze data from a range of data sources
• Apply complex pre-/post-processing steps
• Build and evaluate predictive models
• Perform advanced “predictive” analysis for deep insight
e.g. segmentations, sequence detection, anomaly
detection
• Score cases in an ad hoc or straightforward batch manner
• Create predictive models and results for deployment through
other products
• Enable all of the above in a way that is:
• intuitive
• accessible to users without “expert” credentials
• supports the most demanding requirements of advanced
users
• minimizes time taken to deliver a best-fit solution
SPSS on System z
zSeries
LPAR-1 SLES 10
WAS 7
C&DS Server
LPAR-2 SLES 10
Modeler or Stats Server
LPAR-3 z/OS
DB2 z/OS
TCP/IP (HiperSockets)
LPAR z/OS
IMS, VSAM, ISAM, ...
Classic Federation
TCP/IP
ODBC/JDBC
TLS/SSL
Legend
External Data Sources
`
Workbenches
Summary
• IBM has heard you and responded
• Information Server
• InfoSphere Warehouse
• Cognos 8 BI for Linux on System z
• Cognos Now! for Linux on System z
• Smart Analytics Optimizer
• Smart Analytics Cloud
• ISAS 9600
• SPSS
• We have invested billions in new technologies and building a new
information-led infrastructure
• BI has evolved from a static, report-centric environment to a more real-
time and embedded analytics model – Business Analytics
• Data Warehousing has evolved to a more global, federated, real-time
environment
• We are using our own technology to change our business
External Websites
IBM Smart Analytics System 9600 Webpage:http://www.ibm.com/software/data/infosphere/smart-analytics-system/
IBM Smart Analytics System Optimizer Webpage:http://www.ibm.com/software/data/infosphere/smart-analytics-optimizer-z/
Data Warehousing and Analyticshttp://www.ibm.com/software/data/infosphere/data-warehousing/
Data Warehousing and Business Intelligence on System zhttp://www.ibm.com/software/data/businessintelligence/systemz/
Terabyte Club for System z BI customershttp://www.ibm.com/software/data/businessintelligence/systemz/terabyte-
club.html
Data Governance on System zhttp://www.ibm.com/software/data/db2imstools/solutions/compliance.html
doc_561911173.pdf
Advanced physical database modeling and design.
IBM Business Intelligence (BI) and
Analytics Update
Mike Biere
IBM
March 2
nd
, 2011 8am – 9am
By 2013, 33% of business intelligence functionality will be
consumed via handheld devices.
By 2013, 15% of BI deployments will combine BI, collaboration
and social software into decision-making environments.
Analysts forecast next generation analytics systems
• By 2014, externalizing BI will increasingly become an expected
aspect of most companies' relationships with customers and
partners.
• Externally focused BI programs will frequently go beyond information
dissemination by facilitating a collaborative decision-making process
that breaks through the firewall to involve stakeholders from
organizations in a broad ecosystem.
.
Source : Gartner, Prepare for Customer-Facing Business Intelligence, Kurt Schlegel ,October 2010
Source : Gartner, Predicts 2011: New Relationships Will Change BI and Analytics, November 2010 ,
Bill Gassman, Rita L. Sallam, Andreas Bitterer, John Hagerty, Neil Chandler
By 2012, BI Platform capabilities will be embedded as
a service within 75% of new business applications
By 2012, emerging technologies will significantly
drive adoption of BI to 50% of business users
(e.g. interactive visualization, in-memory analytics, search,
SaaS and SOA )
.
Source : Gartner BI Summit 2008, 4/2008
Embedded Analytics
Mash ups
What Matters …is changing
New Intelligence Enterprise Survey of 3,000 executives
Historic trend analysis
And forecasting
Standardized
reporting
Data
visualization
Analytics applied within
Business processes
Simulations and
Scenario development
Clustering and
segmentation
Regression analysis,
Discrete choice modeling and
Mathematical optimization
Historic trend analysis
And forecasting
Standardized
reporting
Data
visualization
Analytics applied within
Business processes
Simulations and
Scenario development
Clustering and
segmentation
Regression analysis,
Discrete choice modeling and
Mathematical optimization
Source: MIT Sloan Management Review,10 Data Points: Information and Analytics at Work,
N Kruschwitz and R Shockley, Fall 2010
Respondents were asked to
identify the top three
analytic techniques creating
value for the organization
and predict which three
would be creating the most
value in 24 months.
IBM customers have demanded …
…and we have responded
• Data Warehousing technologies for System z from IBM
InfoSphere Information Server
InfoSphere Warehouse
IBM Smart Analytics System 9600
• Database enhancements for BI/BA
DB2 for z/OS V10
ISAO – IBM Smart Analytics Optimizer
• Business Intelligence and Business Analytics
Cognos 10 for Linux on System z
SPSS for Linux on System z
IBM Smart Analytics Cloud (a result of IBM’s Blue Insight Project)
The IBM InfoSphere Vision …
defining an infrastructure
An Industry Unique Information
Platform
• Simplify the delivery of Trusted
Information
• Accelerate client value
• Promote collaboration
• Mitigate risk
• Modular but Integrated
• Scalable – Project to Enterprise
Global Name
Recognition
Warehouse Warehouse
Cognos
BI
InfoSphere
Information
Server
ETL ETL
Data Quality Data Quality
C
o
m
m
o
n
M
e
t
a
D
a
t
a
C
o
m
m
o
n
M
e
t
a
D
a
t
a
Dynamic Warehousing
The Integrated Stack for System z
InfoSphere
Industry Models
InfoSphere
Warehouse
Cubing Cubing
InfoSphere
MDM Server
Information
Services
Director
Data Synchronization
Replication
Server
Classic Event
Publisher
Classic
Federation
Federation
Change Data
Capture
Operational Source Systems
Structured/ Unstructured Data
Operational
Applications
Global
Name
Recognition
Master Master
Data Data
Smart
Analytics
Optimizer
Smart Analytics
System 9600
SPSS
Continuous business
operations
Reduce
business risk
Green strategy
Energy and space
Secure Cloud
Services
High business
growth
HIGH SCALABILITY
Flexibility and
speed to respond
EXTREME
VIRTUALIZATION
SECURITY EFFICIENCY
CLOUD
HIGH AVAILABILITY
/RELIABILITY
System z selected to meet critical business needs
Data Warehousing Enhancements
InfoSphere Information Server - for Linux on
System z
Business Glossary DataStage
Parallel Processing
Rich Connectivity to Applications, Data, and Content
Enterprise Data
Dictionary
Extract, Transform, and
Load in Batch or Real-
time
Information Services Director
Metadata Workbench / FastTrack
Publish SOA services for information
integration and access
Information Analyzer
Data Source Profiling &
Problem Diagnosis
Manage and track consistent metadata across information integration
tasks and automate generation of data flow logic
Federation Server
Virtualize access to
disparate information
CDC & Replication
Deliver and replicate
changed data
QualityStage
Global Name Recognition
Recognize & Classify
Multi-cultural names
Data Quality: Standardize,
Correct & Match Data
InfoSphere Information Server & Foundation Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand Cleanse Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Understand the impact
of making changes to
the information
environment
Visualize and trace
information flows across
the enterprise landscape
Access and report on
operational metadata
Increase compliance to
standards
Increase confidence and
trust in your information
Requirements
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand
Cleanse Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Requirements
Capture business terms
and classifications
Link business terms and
classifications to IT assets
Perform data quality
assessment
Define business rules to
monitor data quality
Discover data
transformation rules and
heterogeneous
relationships
Identify hidden sensitive
data for privacy
Define business object for
archival and test data
applications
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand
Cleanse
Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Effectively manage
complex challenges of
multicultural names
Support initiatives for
CRM, threat and fraud,
and more
Manage complex
multicultural names
Support initiatives that
depend on consistent
data like:
- CRM
- fraud detections
- threat management,
Requirements
InfoSphere Information Server & Foundation
Tools
IBM InfoSphere Information Server
Platform Services
Parallel
processing
services
Connectivity
services
Metadata
services
Administration
services
Deployment
services
Understand Cleanse
Transform Deliver
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Replicate, virtualize
and move information
for in-line delivery
Integrate and transform
multiple, complex, and
disparate sources of
information to feed:
- data warehouses
- MDM initiatives
- Business analytics
- eCommerce, …
Deliver critical information
to the point of action
Minimize impact on
production systems
Guarantee data integrity
Enable data delivery in
batch or real time based
on resource and latency
constraints
Seamlessly support
mainframe, distributed,
structured and
unstructured data sources
Requirements
InfoSphere Warehouse on System z
Delivers Data Warehouse Suite on System z -
• Advanced physical database modeling and design – Design Studio
• In-database data movement and manipulation capabilities of
SQL Warehouse Tool (SQW)
• Optimize multidimensional reporting and analysis of data with
Cubing Services
Cubing Cubing
Services Services
SQW SQW
Operational Source Systems
Warehouse Warehouse
DB2 z/OS DB2 z/OS
DB2 & Other DB2 & Other
Sources Sources
MS Excel
Other
MDX
IW Design Studio
Linux on System z
SQW SQW
Key Component Overview - Warehouse for tooling DB2 for z/OS
• Data Server Component – Prerequisite
• DB2 for z/OS -- Not included in the offering, prerequisite
Application Server Components – Linux on System z Partition
• WebSphere Application Server
• Manages/executes the SQW runtime processes
• Server for the browser-based Admin Console
• SQW Runtime
• Execution engine for SQW jobs (control flows, data flows)
• Runs in the WAS environment
• Cubing Services engine
• Cube server providing cube access to MDX clients through ODBO and XMLA
• Cubing engine and cube optimizer ported to Linux on System z.
• Design and Administration Client Components – Windows, Linux
• Design Studio, Eclipse-based design tool
• Physical modeling based on Rational Data Architect (RDA)
• SQW Data flow, control flow editor – extension of RDA
• Cubing Services cube model editor, optimization tool – extension of RDA
• Admin Console, browser-based administration tool
• Common admin tasks, data source, role-based security assignments
• Cube metadata management (import/export)
• Cube Server management (configure / start / stop, etc.)
• SQW runtime job administration
15
IBM Smart Analytics System 9600
Unprecedented Value in Deploying New Business Analytics
How is it different?
Secure, Available Business Analytics
– Rapidly delivers analytic information to decision makers
at the time of decision.
– New environment for the availability, reliability and
scalability necessary to stay aligned with the operational
systems
Simplified administration
– Appliance-like delivery
– Faster deployment at lower cost.
– Leverages customers existing disaster recovery, and
backup processes
Proven Operational Characteristics
– Extends the qualities of service of System z.
– Reduces risk through extending System z manageability
and security across the entire system.
High Value Operational BI
– Cost effective way to drive daily operational decisions
What is it?
The IBM Smart Analytics System 9600 is an
integrated solution of hardware, software and
services that enables customers to rapidly deploy
cost effective game changing analytics across their
business.
Delivering business results in days, not months
Optional Value Priced Add-ons
Tivoli OMEGAMON for DB2 Performance Expert
DB2 Connect
Tivoli Directory Server
InfoSphere Information Server
InfoSphere Replication Server
Q-Rep, CDC and Event Publisher eligible
InfoSphere Federation Server plus Classic Federation on System z
SPSS
Tivoli ITCAM, ITUAM
Cognos Now! For Linux on System z
Cognos Blueprints for Healthcare, Banking and others…
BI User on-boarding application (as proposed for Smart Analytics Cloud)
Powerful Data Warehouse and BI Software
DB2 for z/OS Value Unit Edition (primary) V9
Option for MLC
DB2 Utilities Suite V9
InfoSphere Warehouse on System z V9.5.2
Cognos 8 BI for Linux on System z V8.4
z/OS Operating System Stack V11
17
IBM Smart Analytics System 9600 Software
Deeply Optimized by IBM Experts…Flexible Growth…
Database Enhancements
Ve vill pump you
up! Sissy boy!!
• Versioned data or temporal queries
• pureXML and SQL enhancements
Applications
• More online schema changes
• Concurrency for catalog & utilities
• Improved security controls and audit
Resiliency
• CPU reduced: transactions & queries
• Ten to twenty times more
concurrent users
Efficiency
DB2 V10 for z/OS What’s exciting?
Productivity improved for DBAs, application
programmers, & systems – ability to ‘leap’ from V8 V10
IBM Smart Analytics Optimizer
Technology Preview for System z
How is it different
Deep integration with
IBM data management systems
High performance query software,
based on advanced data in-
memory technologies
Leveraging existing data system
investment and values without any
changes to applications
For System z, extends gold-
standard manageability, security,
and availability to high-
performance analytic applications
What is it?
A high performance extension that
is integrated with IBM DB2 for
z/OS delivering predictable, order-
of-magnitude faster, analytic query
response times, while lowering
operating costs
21
Orders of Magnitude Faster for Queries
Beta Customer Results
... and its acceleration factor : :
163 s
2311 s
25 s
1593 s
35 s 8s
5435 s
48
Runtime of queries w/o ISAO
with ISAO
511
12
206
4
1424
Factor
8s
4s
2s
5s
3s
For customers who have struggled with
gaining the required performance out their
complex queries of full table scans, multiple
compares, and complex logic – the results
are astounding!
CLIENT
Disk
Storage
Fibre Channel
HMC HMC
Ethernet Switch
OSA-Express3
10 GbE
BladeCenter
IBM Smart Analytics Optimizer Product Components
Private Service Network
Private Data Network
Data Warehouse application
DB2 for z/OS enabled for
Smart Analytics Optimizer
Data Studio
Foundation
Smart Analytics
Optimizer Admin
Plug-in
zEnterprise
IBM Smart
Analytics
Optimizer
DS5020
Disk
zBX
Business Analytics Enhancements
C O G N O S
Measure and Monitor to See “How” You’re Doing
Dashboards
• Provide at-a-glance, high impact views of complex
information
• Help quick focus on issues that need attention and action
• Combine information across disparate sources
• Benefit from range of highly visual personalized,
managed, or self-assembled dashboards
• Gain personalized views of operations with continuous
monitoring
H
Real-time Monitor Business Operations
• Continuously monitor and alert when
exceptions occur to take immediate action
• Detect events, anomalies and trends in data streams
flowing through transactional and messaging systems
• Aggregate data streams across multiple transactional
systems and data sources
• Enable self-service with user-defined dashboards,
operational KPIs, and alerts
• Address full operational decision cycle from detection to
action
Moni t or
Moni t or Moni t or
Al er t
Al er t Al er t
Anal yze
Anal yze Anal yze
Respond
Respond Respond
Understand the “Why” Behind
Business Performance
• Address full breadth of report needs (personalized,
transactional, management, statutory, production…)
• Deliver consistent information across all types of output
• Personalize and target to each department/individual
without having to re-author
• Re-use queries, analyses, express author reports in
business and collaborate on design with IT
• Easy access to data lineage, definitions of terms, and
annotations
Ad-hoc Query
• Intuitive, self-service reporting
• Access to all data; drag and drop query creation
• Easy sorting and filtering
• Corporate templates for consistency
• Share ad-hoc or promote for professional distribution
J
Reporting
Dig Deeper - Investigate Possible Better Outcomes
Analysis
• Compare and contrast to reveal symptoms and
causes behind trends
• Gain same analysis experience on Web or in Excel
interfaces
• Perform personal exploration across multiple
dimensions of information
• Move from summary level to detail effortlessly
J
Enhance decisions with Statistics and Predictors
of “What Might Happen”
• High-performance data mining and text
analytics workbench
• Quickly delivers positive ROI by creating the
predictive intelligence
• Set of mining algorithms that provide insight and
prediction
• Enables the discovery of key insights, patterns
and trends in data that can be used to optimize
business decisions
• Advanced statistics and data management
for analysts researching business problems
• Analysis, interpretation, explanation and presentation
of data
• Provides insight into a sample of data and tools for
prediction and forecasting based on the data
• Flexible enterprise foundation for managing
and deploying analytics throughout the
organization
Predictive Analytics
H
Flexible Access Wherever and Whenever Needed
• Receive in any format (PDF, HTML, Excel, XML…)
• Deliver in any language with robust Unicode support
• Access refreshable BI content in any location that best
serves the individual (Excel, PowerPoint, Word, Enterprise
Search, Portal)
• Search to find instant answers, related content and to
author based on search terms
• Browse BI content on mobile devices including
BlackBerry, Windows Mobile and Symbian devices
• Automate personal alerts, email bursting, scheduled report
production
• Mashup within applications and in processes
J
BI Anywhere
Deploy and Manage your BA environment
• Deliver information in terms business understands
• Combine data into a single view across multiple
disparate sources, including OLAP and relational
• Optimize models with built-in advisor, impact
analysis, and integration with 3
rd
party metadata
• Easily manage multi-lingual, multi-tier models with
reusable objects, versioning and retargeting
• Flexibly deploy model packages to deliver relevant
views securely to different communities
Administer the Deployment
• Complete view of system activity
• Task-oriented system monitoring
• Integration with 3
rd
party EMS
• Proactive administration before business impact
• Comprehensive security down to data layer
• Visual upgrade with automated
environment validation
J
Model Information Services
The Top 10 of Cognos 10
1. Unified workspace with greater power, intuitive
navigation and cleaner look
2. Breadth of analytics across historical, real-time
and predictive information
3. Collaborative BI through built-in collaboration and
social networking
4. Easy data inclusion by the business from one
value, to entire data sets and external files
5. Analytics on the go for more devices and
disconnected interaction
6. Faster performance with in-memory processing
7. Seamless upgrade and ease of ongoing
management
8. Trusted expertise with built-in training videos,
‘how-to’ books and user communities
9. Expanded deployment options include Cloud,
System z, and Power
10. Cognos 10 Ready added value of TM1, Planning,
Analytic Applications and SPSS Modeler
Cognos working with CICS (in progress)
33
3
3
IMS Integration with Cognos
IMS V11 Open Database:
•IMS V11 allows distributed access over TCP/IP using the IMS Universal Database Driver
(JDBC)
•IMS Connect and Open Database Manager now work together as a DRDA server for
IMS data
• Shipped with IMS V11 – requires System Programmer for initial setup
Windows, Linux, Unix, and zLinux
z/OS
Cognos
IMS
Universal
Database
Driver
T
C
P
I
P
T
C
P
I
P
IMS Connect
S
C
I
ODBM
S
C
I
O
D
B
A
CTL IMS
DB
PC
IMS
TCPIP
L100RP01# SQL Activities
0
200
400
600
800
1000
1200
13:28 :00
13:30:00
13:32:00
13:34:00
13:36:00
13:38:00
13:40:00
13:42:00
13:44:0 0
13:46:0 0
13:48:0 0
13 :50:0 0
13 :52:0 0
13 :54 :00
13 :56 :00
13 :58:00
14 :00 :00
14 :02 :00
14:04:00
14:06 :00
14:08:00
14:10:00
14:12:00
14:14:00
SQL
Cognos 8 BI for Linux on System z
….Performance Testing
• Customer provided the need:
• Processes operational and financial data for
10.000 other companies and exchanges info with
250 B2B partners.
• Faced with performance & stability issues and
could not expand it’s BI any further.
• IBM Provided the Test Infrastructure:
• Cognos 8 BI v3 and Websphere set-up on a
zLinux and a DB2 instance on z/OS.
• Numius Provided the Expertise:
• Ported existing application from the distributed to
System z:
• Cognos 8 BI
• Oracle on HP-UX to DB2 on z/OS
• MS-SQL on Wintel to DB2 on zLinux)
• MS-IIS on Wintel to WebSphere on
zLinux).
• Cognos Provided the Flexibility:
• Cognos 8 BI - open to Operating Systems and
Database Systems, no redevelopment was
required
The Results
Cognos 8 BI for Linux on System z
• By adhering to our best practises could
support more users and deliver faster
performance.
• There was no change in functionality at the
Cognos 8 BI level, so no impact whatsoever
for the end-user.
• Not one report timed out, not one user was
rejected. Even when the system slowed
down, it remained stable.
• No redesign was needed to achieve his
objective of reaching out to a large
community.
• System z was 400x faster in
this case!!!
Cognos 10 is showing even greater
improvements on System z – work underway
IBM Cognos 8 BI within a z/VM environment
“Distributed” Deployment with Over-commit
Total allocation of real IFLs to z/VM remains the same = 8
Number of virtual Cognos instances similar to other platforms’ physical servers or partitions
Individual Cognos components distributed on individual Linux “guest” servers
Number of virtual CPs /Cognos = 11 : instance increased on high CPU instances to enable use of excess capacity from low
CPU instances
Number of virtual CPs/Cognos instance should be less than or equal to number of GPs/IFLs assigned to z/VM LPAR
Over-commit ratio (sum of virtual resource type/real resource type assigned to z/VM LPAR) varies from 1.5/1 to 20/1 or more
– highly dependent upon
how active the guest server is
Content Manager
Content Manager
Cognos
CM
Cognos
CM
WAS
WAS
Content Store
Content Store
DB2
DB2
z/VM
vCP
vCP
vCP
vCP
vCP
vCP
vCP
vCP vCP
vCP
vCP
vCP
vCP
vCP
Report Server 1
Report Server 1
Cognos RS
Cognos RS
WAS
WAS
Report Server 2
Report Server 2
Cognos RS
Cognos RS
WAS
WAS
HTTP Server
HTTP Server
Linux 1 Linux 2 Linux 3 Linux 4 Linux 5
vCP
vCP
GP zAAP zAAP zIIP zIIP IFL IFL GP GP GP GP GP IFL IFL IFL IFL IFL IFL
IBM System z Mainframe
HTTP Server
HTTP Server
Cognos
Gateway
Cognos
Gateway
WAS
WAS
vCP
vCP
vCP
vCP
vCP
vCP
Multiple Linux systems
– virtualization with CPU over-allocation
0
200
400
600
800
1000
1200
1400
T
x
n
/
m
i
n
OpBI 50 OpBI 75 Saved Rep 75 Saved Rep 150 Mixed 60-30-10 Mixed 30-60-10
0
1
2
3
4
5
6
7
8
9
R
e
s
p
o
n
s
e
T
i
m
e
OpBI 50 OpBI 75 Saved Rep 75 Saved Rep 150
Multiple Linux Sys
Multiple Linux Sys
(overallocated)
Avg. txn duration (lower is better) Throughput (txn/min) (higher is better)
• With additional virtual CPU capacity available to the Report Server and HTTP Server, response times were lowered, and more transactions
could be processed.
IBM’s Pains:
• Segmented investments in
BI tooling and infrastructure
• Silo’d development,
redundant and possibly
competing
• Lack of tooling
standardization
• Limited visibility to the total
cost of business
intelligence costs for the
enterprise
• Organizational reluctance
to a centralized service
IBM’s Blue Insight
In the spotlight
Our commitment to informed decision making led us to consider private
cloud delivery of Cognos via System z, which is the enabling foundation
that makes possible +$25M savings over 5 years.
-IBM CIO Office
IBM’s Results:
Consolidating 115 multi-product,
departmental BI deployments to 1
Cognos 8 BI on System z
Support for our global workforce
2009 – 72K
2010 – 130K
2011 – 200K
Realizing value from +60 data
sources across IBM
Projected $25M in savings
60% Consolidation
35% Standardization
5% Automation
IBM’s Strategy:
Common BI “appliance
like” service for delivering
BI to IBM
Common service definition
and boarding process
Business intelligence
experts to assist adopters
Start with BI, grow to:
Predictive Analytics
Data Warehouse
Learn more: ibm.com/software/systemz/telecon/1jun
What Exactly is Blue Insight?
Transformational technology delivery matched with process and solution delivery model
changes
• Common BI “appliance like” service for delivering Business Intelligence to IBM
• Common extensible infrastructure ( HW & SW)
• Common operational support
• Common management of Cognos 8 BI licensing and Level 3 support
• Common service definition and boarding process
• Defined BI tooling service scope (Reports, Adhoc, cubing, pervasive, etc)
• Defined standard security and LDAP management
• Common operational processes
• Business intelligence experts to assist adopters
• BICC - (Business Intelligence Center of Competence)
• Consultants available to assist in solution definition and consumption of service
• Blue Insight is NOT an enterprise data strategy or a portal strategy
• Assumes data consumed by reports is a trusted part of the enterprise data strategy
• Initial scope of Blue Insight was to use the standard Cognos portal delivery
Initial Business case
> $25M Savings over 5 years…
• Business case
categorization
• Infrastructure
• Operations
• Skill efficiency
VIRTUALIZATION
+
STANDARDIZATION AUTOMATION
+
Increased
Flexibility
=
Reduced
Cost
Increased
Flexibility
5%
•Adopter administration
35%
•Operations efficiency
•Development efficiency
•Improved time to value
60%
•HW Consolidations
•SW Costs
•3
rd
Party vendor savings
Automated provisioning Common operations
process
Shared Cognos V8
Predictive planning Common promotion
process
Shared middleware
Automated
choreography &
administration
Common security Shared peripheral
infrastructure
Web 2.0 Boarding
application
Common service
definition
Z10 Infrastructure
* - Future focus
Smart
Analytics
Cloud
A private cloud within
the enterprise
A solution for delivering business
intelligence to the entire organization
Creates … That delivers …
The Smart Analytics Cloud solution offering
Open, enterprise-class BI platform
Web Office Search
Mobile
Cognos 8 BI
A broad range of BI capabilities
IBM System z
Centralize, Virtualize & Simplify the BI
infrastructure
IBM software
IBM hardware
• Phase 1: Create
awareness of, a strategy
for and a governance
foundation for BI across
the organization
• Phase 2: Preparation for
the Smart Analytics Cloud
IBM Services
Phase 3: Install the base cloud, integrate into the
corporate enterprise and test the cloud use cases
Phase 4: Educate the enterprise for on-going
success with the Smart Analytics Cloud
The solution components …
Report Authors
Cloud Administrators
BI Administrators
Smart Analytics Cloud is optimized for the enterprise
This offering transforms the delivery of business intelligence and performance
management into a service that is readily available and affordable to corporate users.
Smart Analytics Cloud
p
r
o
d
u
c
t
i
o
n
L
P
A
R
WAS
z/VM
Cognos
Linux
DB2
D
e
v
/
t
e
s
t
L
P
A
R
WAS
z/VM
Cognos
Linux
DB2
Marketing
Line of Business ‘A’
R&D
Data Mart/
Warehouse
HR
Data Mart/
Warehouse
Data Mart/
Warehouse
Finance
Operations
Data Mart/
Warehouse
Line of Business ‘B’
Marketing
R&D
Data Mart/
Warehouse
Senior
Executives
Large enterprise organization
Tivoli
Monitoring &
Metering
Tivoli
Monitoring &
Metering
Cloud
boarding
application
View the demo:http://ibmurl.hursley.ibm.com/JQ4
SPSS Solutions - Modeler
Predictive Analytics
Predictive Analytics helps connect data to effective
action by drawing reliable conclusions about current
conditions and future events.
—Gareth Herschel, Research Director, Gartner Group
Predictive Analytics with Modeler
Data mining uses existing data to:
– Predict
• Category membership
• Numeric Value
– Group / Find Outliers
• Cluster (group) things together based
on their characteristics/attributes
– Associate
• Find events that occur together
– Sequence
• Forecasting/ Time-dependent events
Modeler Key Features
• Ease of use
• Openness
• Productivity
• Automatic Model Selection
• Powerful Data Manipulation/Transformation Functionality
• Multiple Levels of Model Deployment
• Very Scalable*
• Leverages existing database functionality*
• SQL Pushback
• In-Database Mining
*Server
Customers use Modeler when they want to…
• Integrate and analyze data from a range of data sources
• Apply complex pre-/post-processing steps
• Build and evaluate predictive models
• Perform advanced “predictive” analysis for deep insight
e.g. segmentations, sequence detection, anomaly
detection
• Score cases in an ad hoc or straightforward batch manner
• Create predictive models and results for deployment through
other products
• Enable all of the above in a way that is:
• intuitive
• accessible to users without “expert” credentials
• supports the most demanding requirements of advanced
users
• minimizes time taken to deliver a best-fit solution
SPSS on System z
zSeries
LPAR-1 SLES 10
WAS 7
C&DS Server
LPAR-2 SLES 10
Modeler or Stats Server
LPAR-3 z/OS
DB2 z/OS
TCP/IP (HiperSockets)
LPAR z/OS
IMS, VSAM, ISAM, ...
Classic Federation
TCP/IP
ODBC/JDBC
TLS/SSL
Legend
External Data Sources
`
Workbenches
Summary
• IBM has heard you and responded
• Information Server
• InfoSphere Warehouse
• Cognos 8 BI for Linux on System z
• Cognos Now! for Linux on System z
• Smart Analytics Optimizer
• Smart Analytics Cloud
• ISAS 9600
• SPSS
• We have invested billions in new technologies and building a new
information-led infrastructure
• BI has evolved from a static, report-centric environment to a more real-
time and embedded analytics model – Business Analytics
• Data Warehousing has evolved to a more global, federated, real-time
environment
• We are using our own technology to change our business
External Websites
IBM Smart Analytics System 9600 Webpage:http://www.ibm.com/software/data/infosphere/smart-analytics-system/
IBM Smart Analytics System Optimizer Webpage:http://www.ibm.com/software/data/infosphere/smart-analytics-optimizer-z/
Data Warehousing and Analyticshttp://www.ibm.com/software/data/infosphere/data-warehousing/
Data Warehousing and Business Intelligence on System zhttp://www.ibm.com/software/data/businessintelligence/systemz/
Terabyte Club for System z BI customershttp://www.ibm.com/software/data/businessintelligence/systemz/terabyte-
club.html
Data Governance on System zhttp://www.ibm.com/software/data/db2imstools/solutions/compliance.html
doc_561911173.pdf