Description
Many organizations use BI tools to develop Key Performance Indicators (KPIs) to measure and improve organizational effectiveness.
]
SARAH MERTZ
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 1998
DAVID SWIERENGA
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 2005
GREG REISCHLEIN
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 2007
KPIs for Business Intelligence
Dallas Marks
Session 207
Real Experience. Real Advantage.
[ Breakout Description
Many organizations use BI tools to develop Key Performance
Indicators (KPIs) to measure and improve organizational
effectiveness. But fewer organizations apply BI to the business
intelligence organization itself. Learn how to develop KPIs from
the information available from BusinessObjects Enterprise
Auditor as well as other aspects of your business intelligence
infrastructure. See how these metrics can be utilized in
operational, tactical, and strategic dashboards created using
familiar tools like Xcelsius, Web Intelligence, and Crystal Reports.
2
Real Experience. Real Advantage.
[ About Dallas Marks
! Dallas is an SAP Certified Application Associate and authorized
trainer for Web Intelligence, Universe Design, Dashboards
(formerly Xcelsius), and SAP BusinessObjects BI platform
administration. A seasoned consultant and speaker, Dallas has
worked with BusinessObjects tools since 2003 and presented
at the North American conference each year since 2006.
! Dallas has implemented SAP BusinessObjects solutions in
multiple industries, including retail, energy, health care, and
manufacturing. He holds a master’s degree in Computer
Engineering from the University of Cincinnati.
! Dallas blogs about various business intelligence topics athttp://www.dallasmarks.org/. You can follow him on Twitter at
@dallasmarks.
3
Real Experience. Real Advantage.
[Things we know that we should do, but don’t
4
Real Experience. Real Advantage.
[ Things we do for other people, but never ourselves
! Create a culture of
analytics
! Deliver a single version
of the truth
! Embrace fact-based
decision making
! Foster organizational
advancement through
data-driven decision
making
! Get the right
information to the right
people at the right time
5
Real Experience. Real Advantage.
[ Agenda
! Business Intelligence Architecture
! Key Performance Indicators for Business Intelligence
! SAP BusinessObjects Auditor
! Next Steps
! Your Questions
6
Real Experience. Real Advantage.
[
BUSINESS INTELLIGENCE
ARCHITECTURE
KPIs for Business Intelligence
7
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
8
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
9
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Support
Incidents | Requests
Project Mgmt.
Projects | Business Processes
Time Entry
Projects | Hours
User Participation
Surveys | Training
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
10
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Project Mgmt.
Projects | Business Processes
Time Entry
Projects | Hours
Support
Incidents | Requests
Document Management
Portals | Sharepoint | Document Storage
User Participation
Surveys | Training
Real Experience. Real Advantage.
[ Challenges to creating KPIs for Business Intelligence
! Multiple source systems, vendors,
and data formats
! Lots of detailed, low-level
information
! Lack of hierarchies that map to
our business structure
! Lack of data aggregation to speed
analysis
! Lack of time!
11
Real Experience. Real Advantage.
[
KPI’S FOR BUSINESS
OBJECTS ENTERPRISE
KPIs for Business Intelligence
12
Real Experience. Real Advantage.
[ Key Performance Indicator - Definition
13
A Key Performance Indicator
(KPI) is a metric measuring how well
the organization or individual
performs an operational, tactical, or
strategic activity that is critical for
the current and future success of
the organization.
Wayne Eckerson
Performance Dashboards
© Wiley, 2006
Real Experience. Real Advantage.
[ Three Types of Dashboards
O
p
e
r
a
t
i
o
n
a
l
• Monitor core
operational
processes for
front line
workers and
their
supervisors
T
a
c
t
i
c
a
l
• Track and
analyze
departmental
activities,
processes
and projects
S
t
r
a
t
e
g
i
c
• Chart
progress
toward
reaching
strategic
objectives
14
Right now
Weekly or monthly
Long term
Real Experience. Real Advantage.
[ Three Types of Dashboards - Metrics
O
p
e
r
a
t
i
o
n
a
l
• Failed ETL Jobs
• Failed BOE Jobs
• Database
Health
• Database Free
Space
T
a
c
t
i
c
a
l
• User and
Storage Growth
• User Utilization
of new subject
area (universe)
• Phase-out of
Desktop
Intelligence
• ETL Batch
window SLA
• Scheduled
Reports SLA
• Training stats
S
t
r
a
t
e
g
i
c
• Team Goals
• Mission
Statement
• Corporate
Vision
• User
Satisfaction
15
Real Experience. Real Advantage.
[ How many spreadmarts have you killed this year?
16
Real Experience. Real Advantage.
[ Characteristics of Good KPIs
! Actionable
! Aligned with mission of your
business intelligence team
! Improvement of one
measurement doesn’t come at
expense of others
17
Real Experience. Real Advantage.
[ Put the “Key” in Key Performance Indicator
How Many KPIs?
Seven +/- Two
18
The Magical Number Seven, Plus or Minus Two:
Some Limits on Our Capacity for Processing Information
George A. Miller, Psychological Review, © 1956
Real Experience. Real Advantage.
[ Anatomy of a Performance Dashboard
Summarized
Graphical View
Multi-Dimentional
View
Detailed
Reporting View
19
Real Experience. Real Advantage.
[ RANT! No extra charge…
20
Dashboard = Xcelsius
Xcelsius soon to be renamed SAP BusinessObjects Dashboards,
but I’m not bitter
Real Experience. Real Advantage.
[ RANT! No extra charge…
21
Dashboard = InfoView
Soon to be renamed BI Launch Pad,
but I’m not bitter
Real Experience. Real Advantage.
[ Getting Started
! Brainstorm with BI Team
! Narrow down list of possible
metrics
! Determine data sources
! Validate data for accuracy
22
Real Experience. Real Advantage.
[ Key Question – ARE YOU HELPING THE PEOPLE IN
YOUR ORG!!!!!
23
Real Experience. Real Advantage.
[
SAP BUSINESS OBJECTS
AUDITOR
KPIs for Business Intelligence
24
Real Experience. Real Advantage.
[ SAP BusinessObjects Enterprise Architecture
25
Real Experience. Real Advantage.
[ SAP BusinessObjects Enterprise Architecture
26
Only the servers highlighted in blue support auditing.
Real Experience. Real Advantage.
[ Auditing XI 3.x Schema
27
SAP provides an Activity
universe and standard
reports for analyzing
audit data.
Real Experience. Real Advantage.
[ Querying the CMS System Database
28
The SAP
BusinessObjects System
database cannot be
queried directly;
however, data can be
extracted using the
SDK. Several
aftermarket products
on the market do this
and combine with
auditing data.
Real Experience. Real Advantage.
[ Best Practices
! Weekly or monthly generation of tactical KPIs is
sufficient – don’t overdesign
! Assess KPI carefully to insure improving it doesn’t
have negative impact on other business activities
! Don’t measure it if you’re not going to fix it
! Don’t neglect the value of information in non-core
systems (project management, issue management)
! Always obtain at least one measure of user sentiment
! Buying instead of building may be best solution
29
Real Experience. Real Advantage.
[
NEXT STEPS
KPIs for Business Intelligence
30
Real Experience. Real Advantage.
[ Recommended Reading
! Performance Dashboards: Measuring, Monitoring, and
Managing Your Business, by Wayne W. Eckerson, © Wiley, 2005
(Second edition to be released November 2010!)
! SAP BusinessObjects Enterprise Administrator's Guide, XI 3.1
Service Pack 3 edition, © SAP, 2010
Available fromhttp://help.sap.com/
! Information Dashboard Design: The Effective Visual
Communication of Data, by Stephen Few, © O'Reilly Media, 2006
31
Real Experience. Real Advantage.
[ Products that Extend Auditing
! Audit Launch by McManus Software Audit Launchhttp://www.auditlaunch.com
[email protected]
! Sherlock by EV Technologieshttp://savethecms.com
[email protected]
! Insight by APOShttp://www.apos.com/
32
This list is by no means exhaustive and does not
constitute an endorsement. There is quite of variety of
software products available to extend SAP
BusinessObjects Enterprise auditing.
Real Experience. Real Advantage.
[ Relevant ASUG SBOUC 2010 Breakout Sessions
33
! Exploring Auditor Data
Eric Vallo | Session 1013
Thursday, October 7, 2010 | 11:45 AM – 12:45 PM
! Working with Auditing Data in the
Activity Universe
Kevin McManus | Session 0812
Thursday, October 7, 2010 | 11:45 PM – 12:45 PM
Real Experience. Real Advantage.
[
34
[
]
! Thank you for participating.
SESSION CODE:
207
Please remember to complete and return your
evaluation form following this session.
For ongoing education on this area of focus, visit the Year-Round
Community page at www.asug.com/yrc
Dallas Marks
dallas AT dallasmarks DOT orghttp://www.dallasmarks.org/blog/
doc_716856244.pdf
Many organizations use BI tools to develop Key Performance Indicators (KPIs) to measure and improve organizational effectiveness.
]
SARAH MERTZ
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 1998
DAVID SWIERENGA
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 2005
GREG REISCHLEIN
[
ASUG INSTALLATION MEMBER
MEMBER SINCE: 2007
KPIs for Business Intelligence
Dallas Marks
Session 207
Real Experience. Real Advantage.
[ Breakout Description
Many organizations use BI tools to develop Key Performance
Indicators (KPIs) to measure and improve organizational
effectiveness. But fewer organizations apply BI to the business
intelligence organization itself. Learn how to develop KPIs from
the information available from BusinessObjects Enterprise
Auditor as well as other aspects of your business intelligence
infrastructure. See how these metrics can be utilized in
operational, tactical, and strategic dashboards created using
familiar tools like Xcelsius, Web Intelligence, and Crystal Reports.
2
Real Experience. Real Advantage.
[ About Dallas Marks
! Dallas is an SAP Certified Application Associate and authorized
trainer for Web Intelligence, Universe Design, Dashboards
(formerly Xcelsius), and SAP BusinessObjects BI platform
administration. A seasoned consultant and speaker, Dallas has
worked with BusinessObjects tools since 2003 and presented
at the North American conference each year since 2006.
! Dallas has implemented SAP BusinessObjects solutions in
multiple industries, including retail, energy, health care, and
manufacturing. He holds a master’s degree in Computer
Engineering from the University of Cincinnati.
! Dallas blogs about various business intelligence topics athttp://www.dallasmarks.org/. You can follow him on Twitter at
@dallasmarks.
3
Real Experience. Real Advantage.
[Things we know that we should do, but don’t
4
Real Experience. Real Advantage.
[ Things we do for other people, but never ourselves
! Create a culture of
analytics
! Deliver a single version
of the truth
! Embrace fact-based
decision making
! Foster organizational
advancement through
data-driven decision
making
! Get the right
information to the right
people at the right time
5
Real Experience. Real Advantage.
[ Agenda
! Business Intelligence Architecture
! Key Performance Indicators for Business Intelligence
! SAP BusinessObjects Auditor
! Next Steps
! Your Questions
6
Real Experience. Real Advantage.
[
BUSINESS INTELLIGENCE
ARCHITECTURE
KPIs for Business Intelligence
7
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
8
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
9
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Support
Incidents | Requests
Project Mgmt.
Projects | Business Processes
Time Entry
Projects | Hours
User Participation
Surveys | Training
Real Experience. Real Advantage.
[ The Business Intelligence Infrastructure
10
Data Sources
Packaged ERP | Legacy | Custom
Integration
ETL | EAI | EII (Federation) | Custom
Data Storage
Relational DBMS | OLAP | In-memory
Applications
Reports | Ad-Hoc | Dashboards
Project Mgmt.
Projects | Business Processes
Time Entry
Projects | Hours
Support
Incidents | Requests
Document Management
Portals | Sharepoint | Document Storage
User Participation
Surveys | Training
Real Experience. Real Advantage.
[ Challenges to creating KPIs for Business Intelligence
! Multiple source systems, vendors,
and data formats
! Lots of detailed, low-level
information
! Lack of hierarchies that map to
our business structure
! Lack of data aggregation to speed
analysis
! Lack of time!
11
Real Experience. Real Advantage.
[
KPI’S FOR BUSINESS
OBJECTS ENTERPRISE
KPIs for Business Intelligence
12
Real Experience. Real Advantage.
[ Key Performance Indicator - Definition
13
A Key Performance Indicator
(KPI) is a metric measuring how well
the organization or individual
performs an operational, tactical, or
strategic activity that is critical for
the current and future success of
the organization.
Wayne Eckerson
Performance Dashboards
© Wiley, 2006
Real Experience. Real Advantage.
[ Three Types of Dashboards
O
p
e
r
a
t
i
o
n
a
l
• Monitor core
operational
processes for
front line
workers and
their
supervisors
T
a
c
t
i
c
a
l
• Track and
analyze
departmental
activities,
processes
and projects
S
t
r
a
t
e
g
i
c
• Chart
progress
toward
reaching
strategic
objectives
14
Right now
Weekly or monthly
Long term
Real Experience. Real Advantage.
[ Three Types of Dashboards - Metrics
O
p
e
r
a
t
i
o
n
a
l
• Failed ETL Jobs
• Failed BOE Jobs
• Database
Health
• Database Free
Space
T
a
c
t
i
c
a
l
• User and
Storage Growth
• User Utilization
of new subject
area (universe)
• Phase-out of
Desktop
Intelligence
• ETL Batch
window SLA
• Scheduled
Reports SLA
• Training stats
S
t
r
a
t
e
g
i
c
• Team Goals
• Mission
Statement
• Corporate
Vision
• User
Satisfaction
15
Real Experience. Real Advantage.
[ How many spreadmarts have you killed this year?
16
Real Experience. Real Advantage.
[ Characteristics of Good KPIs
! Actionable
! Aligned with mission of your
business intelligence team
! Improvement of one
measurement doesn’t come at
expense of others
17
Real Experience. Real Advantage.
[ Put the “Key” in Key Performance Indicator
How Many KPIs?
Seven +/- Two
18
The Magical Number Seven, Plus or Minus Two:
Some Limits on Our Capacity for Processing Information
George A. Miller, Psychological Review, © 1956
Real Experience. Real Advantage.
[ Anatomy of a Performance Dashboard
Summarized
Graphical View
Multi-Dimentional
View
Detailed
Reporting View
19
Real Experience. Real Advantage.
[ RANT! No extra charge…
20
Dashboard = Xcelsius
Xcelsius soon to be renamed SAP BusinessObjects Dashboards,
but I’m not bitter
Real Experience. Real Advantage.
[ RANT! No extra charge…
21
Dashboard = InfoView
Soon to be renamed BI Launch Pad,
but I’m not bitter
Real Experience. Real Advantage.
[ Getting Started
! Brainstorm with BI Team
! Narrow down list of possible
metrics
! Determine data sources
! Validate data for accuracy
22
Real Experience. Real Advantage.
[ Key Question – ARE YOU HELPING THE PEOPLE IN
YOUR ORG!!!!!
23
Real Experience. Real Advantage.
[
SAP BUSINESS OBJECTS
AUDITOR
KPIs for Business Intelligence
24
Real Experience. Real Advantage.
[ SAP BusinessObjects Enterprise Architecture
25
Real Experience. Real Advantage.
[ SAP BusinessObjects Enterprise Architecture
26
Only the servers highlighted in blue support auditing.
Real Experience. Real Advantage.
[ Auditing XI 3.x Schema
27
SAP provides an Activity
universe and standard
reports for analyzing
audit data.
Real Experience. Real Advantage.
[ Querying the CMS System Database
28
The SAP
BusinessObjects System
database cannot be
queried directly;
however, data can be
extracted using the
SDK. Several
aftermarket products
on the market do this
and combine with
auditing data.
Real Experience. Real Advantage.
[ Best Practices
! Weekly or monthly generation of tactical KPIs is
sufficient – don’t overdesign
! Assess KPI carefully to insure improving it doesn’t
have negative impact on other business activities
! Don’t measure it if you’re not going to fix it
! Don’t neglect the value of information in non-core
systems (project management, issue management)
! Always obtain at least one measure of user sentiment
! Buying instead of building may be best solution
29
Real Experience. Real Advantage.
[
NEXT STEPS
KPIs for Business Intelligence
30
Real Experience. Real Advantage.
[ Recommended Reading
! Performance Dashboards: Measuring, Monitoring, and
Managing Your Business, by Wayne W. Eckerson, © Wiley, 2005
(Second edition to be released November 2010!)
! SAP BusinessObjects Enterprise Administrator's Guide, XI 3.1
Service Pack 3 edition, © SAP, 2010
Available fromhttp://help.sap.com/
! Information Dashboard Design: The Effective Visual
Communication of Data, by Stephen Few, © O'Reilly Media, 2006
31
Real Experience. Real Advantage.
[ Products that Extend Auditing
! Audit Launch by McManus Software Audit Launchhttp://www.auditlaunch.com
[email protected]
! Sherlock by EV Technologieshttp://savethecms.com
[email protected]
! Insight by APOShttp://www.apos.com/
32
This list is by no means exhaustive and does not
constitute an endorsement. There is quite of variety of
software products available to extend SAP
BusinessObjects Enterprise auditing.
Real Experience. Real Advantage.
[ Relevant ASUG SBOUC 2010 Breakout Sessions
33
! Exploring Auditor Data
Eric Vallo | Session 1013
Thursday, October 7, 2010 | 11:45 AM – 12:45 PM
! Working with Auditing Data in the
Activity Universe
Kevin McManus | Session 0812
Thursday, October 7, 2010 | 11:45 PM – 12:45 PM
Real Experience. Real Advantage.
[
34
[
]
! Thank you for participating.
SESSION CODE:
207
Please remember to complete and return your
evaluation form following this session.
For ongoing education on this area of focus, visit the Year-Round
Community page at www.asug.com/yrc
Dallas Marks
dallas AT dallasmarks DOT orghttp://www.dallasmarks.org/blog/
doc_716856244.pdf