Description
Business Intelligence platforms enable users to build information support applications that help organizations in their decision-making processes for enterprise strategic and tactical management.
BUSINESS
INTELLIGENCE
WITH SPAGOBI
SPAGOBI COMPE T E NCY CE NT E R
devel opi ng busi ness i nt el l i gence sol ut i ons usi ng t he onl y 100% open sour ce BI sui t e
d a t a mi n i n g e x t e r n a l p r o c e s s e s c h a r t s a d h o c r e p o r t i n g r e p o r t i n g
f r e e i n q u i r y r e a l t i me l o c a t i o n i n t e l l i g e n c e c o l l a b o r a t i o n o l a p
k p i o f f i c e e t l c o c k p i t s mo b i l e ma s t e r d a t a ma n a g e me n t
S PAGOBI COMPETENCY CENTER, ENGI NEERI NG
Business Intelligence with
SpagoBI
Copyright ? 2012 Engineering
All Rights Reserved
SpagoBI Competency Center
Corso Stati Uniti 23/c
312! "ad#a$ Italy
spago%i&eng'it
((('spago%i'org
- I -
Table of Contents
A%o#t the a#thors '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''')II
*ect#re notes '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' )III
Introd#ction'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''+
1' ,he SpagoBI "ro-ect'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
.pen So#rce B#siness Intelligence'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 1
SpagoBI S#ite'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 2
SpagoBI history '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 3
.pen So#rce Strategy ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' !
/evelopment Strategy''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 0
Ecosystem and Comm#nity'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
2' SpagoBI Architect#re''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
SpagoBI Server '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
SpagoBI 3eta '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
SpagoBI St#dio'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
SpagoBI S/4'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
SpagoBI Applications '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
3' SpagoBI 3eta ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''20
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
,he %#siness model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''32
Creation o6 the %#siness model''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''31
In7#iring the %#siness model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- II -
/eploy and #se the %#siness model ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
1' SpagoBI St#dio''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''0
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
Common tas8s''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
/ata set de6inition''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
/o(nload and deploy''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''23
/eveloping doc#ments'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
Report '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''20
Chart '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''92
Real time'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''122
Coc8pit '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''130
*ocation Intelligence''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''13!
' SpagoBI Server ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
Architect#re'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
/elivery layer'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
Analytical layer ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
/ata layer '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''19
Administrative tools and cross services''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''19
3#lti:tenancy'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''121
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''122
,he %ehavioral model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''120
User and role con6ig#ration''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''129
Repository str#ct#re and rights''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
Analytical drivers ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!0
"#%lication environment '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''191
Analytical model'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''192
3ain concepts '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''192
/oc#ment types''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''190
Register an analytical doc#ment'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''200
Correlation %et(een analytical drivers''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''210
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- III -
Controlled )isi%ility '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''212
Cross services''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''213
/oc#ment %ro(ser ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''213
S#%scriptions '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22!
3assive e;port and sched#ling ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''229
Administrative ,ools'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''232
Sched#ler''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''232
Import/e;port'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''212
Engine management'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''219
3ap catalog#e '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2
/ata so#rces ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
/ata sets'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''220
2' Analytical engines''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!!
Report'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!0
SpagoBIBirtReportEngine''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!9
SpagoBIorld initiative$ mar8ed %y the root o6 the (ord LSpagoL' Spago
Ci'e'$ t(ineD is not an acronym$ %#t an Italian name s#ita%le 6or an integration approach Cit ties$ (itho#t
compellingD' It may also recall the (idely 8no(n$ 6ine Italian c#isineA (ell$ i6 yo# li8e Spaghetti$ Spago
so6t(are may %e an e;cellent choice 6or yo#M
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- - -
services$ management o6 5eoBI initiative$ participation in BI:related .>2
Consorti#m initiatives$ development o6 %#siness intelligence pro-ects and BI
cons#ltancies at Engineering 5ro#p'
>hen the 6irst version o6 the .pen So#rce B#siness Intelligence SpagoBI s#ite
(as released in 200$ (ithin the 6rame(or8 o6 Spago>orld initiative$ the aim o6
the SpagoBI pro-ect (as to %#ild an integration plat6orm (hich co#ld o66er a
6le;i%le and s#staina%le BI sol#tion to organiBations and companies$ s#pporting
the meas#rement and management o6 their critical assets and s#ccess 6actors'
At the %eginning$ the prod#ct (as %#ilt %y integrating the %est availa%le open
so#rce tools$ ma8ing them #sa%le at the enterprise level$ %y c#stomiBing and
e;tending their %asic 6#nctions on the %asis o6 the in6ormation coming 6rom
the 6irst %#siness intelligence pro-ects in (hich the prod#ct itsel6 (as #sed' ,his
(ay$ SpagoBI development team created ne( analytical engines and
conse7#ently started a virt#o#s circle$ according to (hich BI pro-ect needs
7#ic8ly t#rned into additional practical capa%ilities or 6eat#res that contri%#ted
to the improvement o6 the prod#ct'
As a res#lt$ the prod#ct has %ecome more and more po(er6#l and #sa%le'
Speci6ically$ innovative practical 6#nctionalities have %een added at a 6irst stage$
(hich (as s#%stantially oriented to(ards the s#pport o6 the %asic %#siness
intelligence 6#nctions$ s#ch as reporting and m#ltidimensional analysis' ,hey
incl#dedA representation o6 data analysis on geo re6erenced s#pports C*ocation
IntelligenceD$ data in7#iry and colla%orative 6#nctions$ #sing annotations and
cooperative (or86lo('
,he 6irst (ave o6 pro-ects realiBed %y means o6 SpagoBI version 1'; (as mainly
motivated %y #sersG (ish to test this open so#rce prod#ct (ith a very ca#tio#s
%#t also innovative approach' ,here6ore$ the 6irst pro-ects aimed at
demonstrating that the prod#ct (as a%le to cover BI #sersG real needs at a m#ch
more reasona%le cost than proprietary sol#tions' As time goes %y and (ith the
increasing di66#sion o6 the open so#rce model and applications$ #sersG and
companiesG approach to open so#rce prod#cts has started to change' ,his
applied to SpagoBI as (ellA %eside testing strategies$ the replacement o6
proprietary tools and the strategic adoption o6 open so#rce plat6orms have
%ecome 8ey decision drivers 6or SpagoBI adopters'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- . -
,his (as -#st the right conte;t 6or a signi6icant evol#tion o6 SpagoBI to(ards
2'; version$ released at the end o6 2 Consorti#m$ a glo%al$ independent not:6or
ro6it
open so#rce comm#nity$ open to companies$ instit#tions and individ#als$
(hose goal is the development o6 open so#rce code in6rastr#ct#re Cmiddle(are
and generic applicationsD' .>2 role is central in SpagoBI open so#rce policy
%eca#se it g#arantees transparency$ openness$ 7#ality$ s#staina%ility and
availa%ility o6 the open so#rce code over time' SpagoBINs active commitment in
.>2 Consorti#m is demonstrated %y many activities$ a%ove all the 6ollo(ingA
leading K 6rom the technological point o6 vie( K the .>2 BI Initiative$
a -oint e66ort o6 .>2 and no:.>2 mem%ers$ set #p to 6oster the
gro(th o6 a %#siness ecosystem in the B#siness Intelligence domainH
participating in the .>2 .pen So#rce Clo#d(are initiative$ a -oint
e66ort o6 partners 6rom BraBil$ China$ E#rope and the U'S'A'$ all sharing
the same goals in the open so#rce clo#d domain'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &* -
3oreover$ SpagoBI competency center participates in the Eclipse Comm#nity
(ith a leading role in the eclipse e;tended B#siness Activity 3onitoring
CeBA3D pro-ect$ (hich adds real:time BI capa%ilities to SpagoBI s#ite'
SpagoBI pro-ect team closely (or8s (ith a (ide net(or8 o6 international
partners$ (hich incl#des systems integrators$ technology partners and all those
partners (ho (ant to contri%#te to the glo%al s#ccess o6 the s#ite' All SpagoBI
partners contri%#te to the gro(th o6 SpagoBI 6#nctionalities and are committed
to %ring the pro-ects that integrate SpagoBI to rapid s#ccess'
*ast %#t not least$ SpagoBI ecosystem incl#des research la%oratories and
instit#tes$ as (ell as several #niversities at the international level$ than8s to the
contin#o#s s#pport that SpagoBI team o66ers to researchers$ pro6essors and
st#dents$ %oth in ed#cational and research activities'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &, -
)' SpagoBI #chitectu#e
SpagoBI overall architect#re is composed o6 6ive mod#lesA
SpagoBI Ser"er, t'e core o$ t'e &uite t'at o$$er& all t'e
core an! analtical $unctionalitie&
SpagoBI Meta$ the environment to de6ine and manage
meta:data and %#siness models
SpagoBI Stu!io$ the development environment
SpagoBI S(), the integration layer that allo(s e;ternal
tools and applications to interact (ith SpagoBI Server
SpagoBI Application&$ collecting vertical models 6oc#sed
on a partic#lar %#siness domain'
Chapte#
)
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &- -
=I5URE 2'1 K SpagoBI s#ite main mod#les
,he main mod#le$ (hich provides all the BI capa%ilities$ is the SpagoBI Server'
,his is the only mandatory mod#le$ the one that o66ers a (e%:%ased end:#ser
environment to r#n all types o6 analysis'
,he 3eta and St#dio mod#les interact (ith the Server than8s to the S/4$
mainly to a#thenticate the #ser$ send or receive metamodels$ analytical
doc#ments or data sets'
=I5URE 2'2 K Interaction %et(een SpagoBI main mod#les
A typical BI pro-ect #sesA
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &. -
A single SpagoBI Server A the main BI plat6orm (here all BI doc#ments
are stored and #sed %y end #sers' ,he end:#ser 5UI is entirely (e%
%ased and can %e accessed via a common (e% %ro(ser
A 6e( instances o6 SpagoBI 3etaA the data manager #ses SpagoBI 3eta
Cclient applicationD to de6ine the %#siness models over the enterprise
data (areho#se
Several instances o6 SpagoBI St#dioA developers #se SpagoBI St#dio
Cclient applicationD to develop analytical doc#ments #sing the %#siness
model$ to get data and deploy doc#ments into a remote SpagoBI Server'
,he 3eta and St#dio mod#les are also availa%le in a single pac8age$ (hich is
partic#larly #se6#l (hen the data developer is the data manager'
Each mod#le has its o(n end:#ser target and covers speci6ic tas8s in a
development process$ as e;plained in the 6ollo(ing paragraphs'
SpagoBI Se#2e#
SpagoBI Server is the environment 6orA
End:#sersA they can #se their analytical doc#ments %y means o6 this
#ni6ied access point via a (e% %ro(ser
System administratorsA they can manage the server thro#gh a (e%
inter6ace'
=or end:#sers$ this mod#le o66ers all typical BI 6#nctionalities A
Reporting
3#ltidimensional analysis C.*A"D
Charts
Interactive coc8pits
4"Is
/ata 3ining
=ree In7#iry and driven data:selection
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &/ -
Ad:hoc reporting
*ocation Intelligence
R, dash%oards and consoles
3o%ile
.66ice a#tomation
Colla%orative tools'
3oreover$ some operational BI 6eat#res are availa%leA
E,*
E;ternal processes
3aster data management'
=or the administrator$ SpagoBI Server allo(s to manage all relevant tas8s s#ch
as the li6ecycle o6 analytical doc#ments$ internal repository$ #sers and roles$
sec#rity$ and presentation environment'
=rom a technical point o6 vie($ SpagoBI Server is a (e% application deployed
into a e%*ogic' It can r#n on any operating system that s#pports ED
/ata or E,* to load data 6rom c#stom so#rces
Analytical doc#ments Creports$ charts$ coc8pits$ etc'D
Us#ally$ they donGt incl#de code'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- )5 -
*' SpagoBI 6eta
In general terms$ metadata means Odata a%o#t dataG and in the BI domain it
#s#ally re6ers to data #sed to descri%e and enrich the original ones in terms o6A
meaning and str#ct#re o6 corporate data
(here they come 6rom
ho( they are organiBed
ho( they are val#ed
ho( they are accessed
ho( they are #sed
ho( they can %e interpreted
(hat they are
(hat they mean
(hat they are 6or
etc'
BI literat#re #s#ally disting#ishes %et(een technical and %#siness metadata$
according to their nat#re$ #se and pre6erred #sers'
Tec'nical meta!ata are commonly #sed %y analysts and developers to %#ild
and manage the />E$ and to ens#re system sec#rity' ,here6ore$ they mainly
contain descriptions o6 data so#rces Cphysical patternsD$ trans6ormations
per6ormed on data$ constraints and in6ormation a%o#t data #sage'
Chapte#
*
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
)& -
,echnical metadata are #sed to a%stract 6rom data so#rces$ de6ine a %#siness
model independently 6rom data storage$ generate a#tomatic doc#mentation$
%#ild data lineage and manage changes over data str#ct#res'
Bu&ine&& meta!ata are designed to s#pport end #sers in accessing and
#sing/interpreting %#siness data in the />E' ,hey typically incl#de many
types o6 re:classi6ication$ categoriBation$ description$ semantic in6ormation$
high:level calc#lation r#les'
B#siness metadata are #sed to enrich %asic data (ith additional in6ormation$
categoriBe doc#ments and provide additional contents to ma8e their
interpretation easier'
SpagoBI 3eta is the mod#le o6 SpagoBI s#ite speci6ically 6oc#sed on technical
metadata management$ (hereas %#siness metadata are managed %y SpagoBI
Server'
Goals an% ta#gets
SpagoBI 3eta is the mod#le dedicated to technical metadata management and
in7#iry' It o66ers a tool s#pporting the data%ase reverse engineering process$
(here #sers can de6ine the semantic layer to %e #sed d#ring the development o6
analytical doc#ments$ so as to de6ine data selection criteria even (itho#t any
partic#lar e;pertise on the data domain and 7#ery lang#ages'
,he target #sers o6 the meta mod#le areA
data o(ners and data domain e;perts$ (ho de6ine one or more models
that represent in6ormative islands 6rom a %#siness point o6 vie(
administrators (ho manage or %#ild shared semantic layers #nder the
analytical doc#ments
developers (ho in7#ire semantic layers to %#ild their analytical
doc#ments'
In small pro-ects$ a single or a 6e( developers are #s#ally in charge o6 managing
all activities' So they can %#ild and in7#ire semantic layers$ playing de facto all
roles'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
)) -
Installation an% configu#ation
In order to #se the SpagoBI 3eta mod#le$ the 6irst step is to chec8 that yo#r
environment satis6ies the 6ollo(ing prere7#isitesA
it has a
Business Intelligence platforms enable users to build information support applications that help organizations in their decision-making processes for enterprise strategic and tactical management.
BUSINESS
INTELLIGENCE
WITH SPAGOBI
SPAGOBI COMPE T E NCY CE NT E R
devel opi ng busi ness i nt el l i gence sol ut i ons usi ng t he onl y 100% open sour ce BI sui t e
d a t a mi n i n g e x t e r n a l p r o c e s s e s c h a r t s a d h o c r e p o r t i n g r e p o r t i n g
f r e e i n q u i r y r e a l t i me l o c a t i o n i n t e l l i g e n c e c o l l a b o r a t i o n o l a p
k p i o f f i c e e t l c o c k p i t s mo b i l e ma s t e r d a t a ma n a g e me n t
S PAGOBI COMPETENCY CENTER, ENGI NEERI NG
Business Intelligence with
SpagoBI
Copyright ? 2012 Engineering
All Rights Reserved
SpagoBI Competency Center
Corso Stati Uniti 23/c
312! "ad#a$ Italy
spago%i&eng'it
((('spago%i'org
- I -
Table of Contents
A%o#t the a#thors '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''')II
*ect#re notes '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' )III
Introd#ction'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''+
1' ,he SpagoBI "ro-ect'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
.pen So#rce B#siness Intelligence'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 1
SpagoBI S#ite'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 2
SpagoBI history '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 3
.pen So#rce Strategy ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' !
/evelopment Strategy''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' 0
Ecosystem and Comm#nity'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
2' SpagoBI Architect#re''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
SpagoBI Server '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
SpagoBI 3eta '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
SpagoBI St#dio'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
SpagoBI S/4'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
SpagoBI Applications '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''10
3' SpagoBI 3eta ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''20
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
,he %#siness model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''32
Creation o6 the %#siness model''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''31
In7#iring the %#siness model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- II -
/eploy and #se the %#siness model ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
1' SpagoBI St#dio''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''0
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
Common tas8s''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
/ata set de6inition''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''21
/o(nload and deploy''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''23
/eveloping doc#ments'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
Report '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''20
Chart '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''92
Real time'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''122
Coc8pit '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''130
*ocation Intelligence''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''13!
' SpagoBI Server ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
5oals and targets''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''11
Architect#re'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1
/elivery layer'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''12
Analytical layer ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
/ata layer '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''19
Administrative tools and cross services''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''19
3#lti:tenancy'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''121
Installation and con6ig#ration'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''122
,he %ehavioral model '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''120
User and role con6ig#ration''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''129
Repository str#ct#re and rights''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!
Analytical drivers ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''1!0
"#%lication environment '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''191
Analytical model'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''192
3ain concepts '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''192
/oc#ment types''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''190
Register an analytical doc#ment'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''200
Correlation %et(een analytical drivers''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''210
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- III -
Controlled )isi%ility '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''212
Cross services''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''213
/oc#ment %ro(ser ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''213
S#%scriptions '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22!
3assive e;port and sched#ling ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''229
Administrative ,ools'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''232
Sched#ler''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''232
Import/e;port'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''212
Engine management'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''219
3ap catalog#e '''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2
/ata so#rces ''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''22
/ata sets'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''220
2' Analytical engines''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!!
Report'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!0
SpagoBIBirtReportEngine''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''2!9
SpagoBIorld initiative$ mar8ed %y the root o6 the (ord LSpagoL' Spago
Ci'e'$ t(ineD is not an acronym$ %#t an Italian name s#ita%le 6or an integration approach Cit ties$ (itho#t
compellingD' It may also recall the (idely 8no(n$ 6ine Italian c#isineA (ell$ i6 yo# li8e Spaghetti$ Spago
so6t(are may %e an e;cellent choice 6or yo#M
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- - -
services$ management o6 5eoBI initiative$ participation in BI:related .>2
Consorti#m initiatives$ development o6 %#siness intelligence pro-ects and BI
cons#ltancies at Engineering 5ro#p'
>hen the 6irst version o6 the .pen So#rce B#siness Intelligence SpagoBI s#ite
(as released in 200$ (ithin the 6rame(or8 o6 Spago>orld initiative$ the aim o6
the SpagoBI pro-ect (as to %#ild an integration plat6orm (hich co#ld o66er a
6le;i%le and s#staina%le BI sol#tion to organiBations and companies$ s#pporting
the meas#rement and management o6 their critical assets and s#ccess 6actors'
At the %eginning$ the prod#ct (as %#ilt %y integrating the %est availa%le open
so#rce tools$ ma8ing them #sa%le at the enterprise level$ %y c#stomiBing and
e;tending their %asic 6#nctions on the %asis o6 the in6ormation coming 6rom
the 6irst %#siness intelligence pro-ects in (hich the prod#ct itsel6 (as #sed' ,his
(ay$ SpagoBI development team created ne( analytical engines and
conse7#ently started a virt#o#s circle$ according to (hich BI pro-ect needs
7#ic8ly t#rned into additional practical capa%ilities or 6eat#res that contri%#ted
to the improvement o6 the prod#ct'
As a res#lt$ the prod#ct has %ecome more and more po(er6#l and #sa%le'
Speci6ically$ innovative practical 6#nctionalities have %een added at a 6irst stage$
(hich (as s#%stantially oriented to(ards the s#pport o6 the %asic %#siness
intelligence 6#nctions$ s#ch as reporting and m#ltidimensional analysis' ,hey
incl#dedA representation o6 data analysis on geo re6erenced s#pports C*ocation
IntelligenceD$ data in7#iry and colla%orative 6#nctions$ #sing annotations and
cooperative (or86lo('
,he 6irst (ave o6 pro-ects realiBed %y means o6 SpagoBI version 1'; (as mainly
motivated %y #sersG (ish to test this open so#rce prod#ct (ith a very ca#tio#s
%#t also innovative approach' ,here6ore$ the 6irst pro-ects aimed at
demonstrating that the prod#ct (as a%le to cover BI #sersG real needs at a m#ch
more reasona%le cost than proprietary sol#tions' As time goes %y and (ith the
increasing di66#sion o6 the open so#rce model and applications$ #sersG and
companiesG approach to open so#rce prod#cts has started to change' ,his
applied to SpagoBI as (ellA %eside testing strategies$ the replacement o6
proprietary tools and the strategic adoption o6 open so#rce plat6orms have
%ecome 8ey decision drivers 6or SpagoBI adopters'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- . -
,his (as -#st the right conte;t 6or a signi6icant evol#tion o6 SpagoBI to(ards
2'; version$ released at the end o6 2 Consorti#m$ a glo%al$ independent not:6or
ro6itopen so#rce comm#nity$ open to companies$ instit#tions and individ#als$
(hose goal is the development o6 open so#rce code in6rastr#ct#re Cmiddle(are
and generic applicationsD' .>2 role is central in SpagoBI open so#rce policy
%eca#se it g#arantees transparency$ openness$ 7#ality$ s#staina%ility and
availa%ility o6 the open so#rce code over time' SpagoBINs active commitment in
.>2 Consorti#m is demonstrated %y many activities$ a%ove all the 6ollo(ingA
leading K 6rom the technological point o6 vie( K the .>2 BI Initiative$
a -oint e66ort o6 .>2 and no:.>2 mem%ers$ set #p to 6oster the
gro(th o6 a %#siness ecosystem in the B#siness Intelligence domainH
participating in the .>2 .pen So#rce Clo#d(are initiative$ a -oint
e66ort o6 partners 6rom BraBil$ China$ E#rope and the U'S'A'$ all sharing
the same goals in the open so#rce clo#d domain'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &* -
3oreover$ SpagoBI competency center participates in the Eclipse Comm#nity
(ith a leading role in the eclipse e;tended B#siness Activity 3onitoring
CeBA3D pro-ect$ (hich adds real:time BI capa%ilities to SpagoBI s#ite'
SpagoBI pro-ect team closely (or8s (ith a (ide net(or8 o6 international
partners$ (hich incl#des systems integrators$ technology partners and all those
partners (ho (ant to contri%#te to the glo%al s#ccess o6 the s#ite' All SpagoBI
partners contri%#te to the gro(th o6 SpagoBI 6#nctionalities and are committed
to %ring the pro-ects that integrate SpagoBI to rapid s#ccess'
*ast %#t not least$ SpagoBI ecosystem incl#des research la%oratories and
instit#tes$ as (ell as several #niversities at the international level$ than8s to the
contin#o#s s#pport that SpagoBI team o66ers to researchers$ pro6essors and
st#dents$ %oth in ed#cational and research activities'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &, -
)' SpagoBI #chitectu#e
SpagoBI overall architect#re is composed o6 6ive mod#lesA
SpagoBI Ser"er, t'e core o$ t'e &uite t'at o$$er& all t'e
core an! analtical $unctionalitie&
SpagoBI Meta$ the environment to de6ine and manage
meta:data and %#siness models
SpagoBI Stu!io$ the development environment
SpagoBI S(), the integration layer that allo(s e;ternal
tools and applications to interact (ith SpagoBI Server
SpagoBI Application&$ collecting vertical models 6oc#sed
on a partic#lar %#siness domain'
Chapte#
)
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &- -
=I5URE 2'1 K SpagoBI s#ite main mod#les
,he main mod#le$ (hich provides all the BI capa%ilities$ is the SpagoBI Server'
,his is the only mandatory mod#le$ the one that o66ers a (e%:%ased end:#ser
environment to r#n all types o6 analysis'
,he 3eta and St#dio mod#les interact (ith the Server than8s to the S/4$
mainly to a#thenticate the #ser$ send or receive metamodels$ analytical
doc#ments or data sets'
=I5URE 2'2 K Interaction %et(een SpagoBI main mod#les
A typical BI pro-ect #sesA
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &. -
A single SpagoBI Server A the main BI plat6orm (here all BI doc#ments
are stored and #sed %y end #sers' ,he end:#ser 5UI is entirely (e%
%ased and can %e accessed via a common (e% %ro(ser
A 6e( instances o6 SpagoBI 3etaA the data manager #ses SpagoBI 3eta
Cclient applicationD to de6ine the %#siness models over the enterprise
data (areho#se
Several instances o6 SpagoBI St#dioA developers #se SpagoBI St#dio
Cclient applicationD to develop analytical doc#ments #sing the %#siness
model$ to get data and deploy doc#ments into a remote SpagoBI Server'
,he 3eta and St#dio mod#les are also availa%le in a single pac8age$ (hich is
partic#larly #se6#l (hen the data developer is the data manager'
Each mod#le has its o(n end:#ser target and covers speci6ic tas8s in a
development process$ as e;plained in the 6ollo(ing paragraphs'
SpagoBI Se#2e#
SpagoBI Server is the environment 6orA
End:#sersA they can #se their analytical doc#ments %y means o6 this
#ni6ied access point via a (e% %ro(ser
System administratorsA they can manage the server thro#gh a (e%
inter6ace'
=or end:#sers$ this mod#le o66ers all typical BI 6#nctionalities A
Reporting
3#ltidimensional analysis C.*A"D
Charts
Interactive coc8pits
4"Is
/ata 3ining
=ree In7#iry and driven data:selection
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- &/ -
Ad:hoc reporting
*ocation Intelligence
R, dash%oards and consoles
3o%ile
.66ice a#tomation
Colla%orative tools'
3oreover$ some operational BI 6eat#res are availa%leA
E,*
E;ternal processes
3aster data management'
=or the administrator$ SpagoBI Server allo(s to manage all relevant tas8s s#ch
as the li6ecycle o6 analytical doc#ments$ internal repository$ #sers and roles$
sec#rity$ and presentation environment'
=rom a technical point o6 vie($ SpagoBI Server is a (e% application deployed
into a e%*ogic' It can r#n on any operating system that s#pports ED
/ata or E,* to load data 6rom c#stom so#rces
Analytical doc#ments Creports$ charts$ coc8pits$ etc'D
Us#ally$ they donGt incl#de code'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
- )5 -
*' SpagoBI 6eta
In general terms$ metadata means Odata a%o#t dataG and in the BI domain it
#s#ally re6ers to data #sed to descri%e and enrich the original ones in terms o6A
meaning and str#ct#re o6 corporate data
(here they come 6rom
ho( they are organiBed
ho( they are val#ed
ho( they are accessed
ho( they are #sed
ho( they can %e interpreted
(hat they are
(hat they mean
(hat they are 6or
etc'
BI literat#re #s#ally disting#ishes %et(een technical and %#siness metadata$
according to their nat#re$ #se and pre6erred #sers'
Tec'nical meta!ata are commonly #sed %y analysts and developers to %#ild
and manage the />E$ and to ens#re system sec#rity' ,here6ore$ they mainly
contain descriptions o6 data so#rces Cphysical patternsD$ trans6ormations
per6ormed on data$ constraints and in6ormation a%o#t data #sage'
Chapte#
*
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
)& -
,echnical metadata are #sed to a%stract 6rom data so#rces$ de6ine a %#siness
model independently 6rom data storage$ generate a#tomatic doc#mentation$
%#ild data lineage and manage changes over data str#ct#res'
Bu&ine&& meta!ata are designed to s#pport end #sers in accessing and
#sing/interpreting %#siness data in the />E' ,hey typically incl#de many
types o6 re:classi6ication$ categoriBation$ description$ semantic in6ormation$
high:level calc#lation r#les'
B#siness metadata are #sed to enrich %asic data (ith additional in6ormation$
categoriBe doc#ments and provide additional contents to ma8e their
interpretation easier'
SpagoBI 3eta is the mod#le o6 SpagoBI s#ite speci6ically 6oc#sed on technical
metadata management$ (hereas %#siness metadata are managed %y SpagoBI
Server'
Goals an% ta#gets
SpagoBI 3eta is the mod#le dedicated to technical metadata management and
in7#iry' It o66ers a tool s#pporting the data%ase reverse engineering process$
(here #sers can de6ine the semantic layer to %e #sed d#ring the development o6
analytical doc#ments$ so as to de6ine data selection criteria even (itho#t any
partic#lar e;pertise on the data domain and 7#ery lang#ages'
,he target #sers o6 the meta mod#le areA
data o(ners and data domain e;perts$ (ho de6ine one or more models
that represent in6ormative islands 6rom a %#siness point o6 vie(
administrators (ho manage or %#ild shared semantic layers #nder the
analytical doc#ments
developers (ho in7#ire semantic layers to %#ild their analytical
doc#ments'
In small pro-ects$ a single or a 6e( developers are #s#ally in charge o6 managing
all activities' So they can %#ild and in7#ire semantic layers$ playing de facto all
roles'
B U S I N E S S I N T E L L I G E N C E W I T H S P G ! B I
)) -
Installation an% configu#ation
In order to #se the SpagoBI 3eta mod#le$ the 6irst step is to chec8 that yo#r
environment satis6ies the 6ollo(ing prere7#isitesA
it has a