RittmanMead BI Forum 2014 – Wrap – up

RittmanMead BI Forum 2014

Last week I was (again) one of the lucky ones to join the Rittman Mead BI Forum 2014. This year we were served with a 3-day program. Just like the other years the program was varied. Varied in subjects  (Oracle BI EE, Oracle Endeca, Aggregation Persistence, Big Data, Oracle Exalytics, Oracle BI Cloud,  Oracle Information Management Reference Architecture, etc.) an varied in in style; Keynotes, one hour presentations and 10-minute TED-sessions. Next to that the possibility of a Masterclass around Hadoop Cloudera.

Just like all the other days the Rittman Mead BI Forum 2014 was an excellent place to network and exchange ideas. Next to the people I knew already I have met a lot of ‘new’ people. These days were a big inspiration for me. I do not have to be bored the coming year.

I was very impressed by the Masterclass of Lars George around the topic of Cloudera Hadoop. If you want to explore this subject more there are several options. Thanks to Alex Hansal for linking to these options.

It was interesting to hear how Oracle invests heavily in the Oracle (BI) Cloud. As a part of that a lot of new interesting Oracle BI functionality will become available in the Cloud first. Hopefully these functionalities will arrive on Premise shortly after.

Andrew Bond & Stewart Bryson had a very nice presentation about the Oracle Information Management Reference Architecture. This needs some further investigation from my part.

I often see clients struggle with reporting on Oracle eBS. There are a lot of alternatives. Truls Bergersen showed an alternative via the Oracle eBS extensions for Endeca.

Congratulations to Robin Moffat for receiving the ‘Best Speaker Award’ for the second time! Check his presentation; ‘No Silver Bullets – OBIEE Performance in the Real World’ here.

A big thank you to Mark Rittman, Jon Mead and their crew. Also a big thanks to Oracle for joining and for being so open about the Oracle BI developments and their visions and roadmaps. Thanks all for joining and sharing. That’s what makes the Rittman Mead BI Forum such a great event to be at. Hope to see everyone next year.

Tomorrow the US edition of the Rittman Mead BI Forum will start. If you would like to stay informed, you should check the Tweetchat.

After the US edition all the presentations of the RittmanMead BI Forum 2014 (Brighton and Atlanta) will be online. There is definitely some good stuff to have a look at!!

RM BI Forum 2014 - Tshirts

RM BI Forum 2014 Notes – Day II

RM BI Forum 2014 Notes – Day II

Find below some notes, links, etc regarding day I of the RittmanMead BI Forum 2014. These are just some notes and it’s by no means a re-cap of the complete presentations. Check the RittmanMead blog after the Atlanta edition of the RittmanMead BI Forum 2014. They will post all the presentations (both Brighton as well as Atlanta)

Drawing in a New Rock on the Map – How will Endeca Fit in to Your Oracle BI Topography by Truls Bergersen

Data Discovery
– Unknown Answers to Unknown Questions
– New Datasources

Hybrid search/analytical database
Key Value Pairs
In-Memory Analytics

Self-Service Provisioning – (Excel, JSON-Files, OBIEE Data Source)

Web Acquisition Toolkit

ODI KM – Integration Knowledge Module

Sentiment Analysis (only via Integrator tier) – Lexical (Dictionary)

Oracle eBS extensions for Endeca (light-weight Oracle BI Apps)

Real-time Data Warehouse Upgrade – Success Stories by Nicholas Hurt & Michael Rainey

Events —> ETL –> Cleanse –> De-dupe –> Summarize –> Dashboard
Streams & Oracle CDC —> Oracle GoldenGate (Journalizing – ODI)
OWB —> ODI 11g – 3R’s- Re-Asses, Replicate, Refine existing mappings

JMK Oracle to Oracle Consistent (OGG) Knowledge Module

Oracle Information Management Reference Architecture

Staging Layer –
Performance Layer (Dimensional Model – Star Schema)
Hybrid Layer

Real-time BI: An Introduction

GoldenGate and ODI – A Perfect Match for Real-Time Data Warehousing

Oracle BI Cloud by Matt Bedin

Sort of NDA, but it will be there……the Oracle BI Cloud

Oracle invests heavily in the Cloud. As a part of that a lot of new interesting Oracle BI functionality will become available in the Cloud first. Hopefully these functionalities will arrive on Premise shortly after.

Essbase within/without OBIEE – not just an aggregation engine by Gianni Ceresa

Essbase and OBIEE Aggregate Pesistance wizard

Essbase Studio

ASO (Aggregate Storage Option)
BSO (Block Storage Option)

CalcScripts

UDF – User Defined Functions
Essbase Writeback

Speed up RPD Development by Marco Klaassens

Speedup Delivering = Knowledge * Focus * Offering

Neo’s Voyage in OBIEE by Christian Berg

Blue Pill – It’s Known
Red Pill – It’s Undocumented (Use at own risk)

NQS Procedures as Physical Tables (ODBC) in the Physical Layer

Contact Christian directly, he might want to share.

Tuning TimesTen with Aggregate Persistence by Alistair Burgess 

Tuning TimesTen
  • RangeIndexType=0
  • TimesTen Data Types (TT_INTEGER, TT_SMALLINT)
  • RAM Policy
  • Compression
  • Index Advisor
  • Execute on Connect
  • Parallel Query
Licence costs (compared to the Oracle Database) could be interesting

RM BI Forum 2014 Notes – Day I

RM BI Forum 2014 Notes – Day I

Find below some notes, links, etc regarding day I of the RittmanMead BI Forum 2014. These are just some notes and it’s by no means a re-cap of the complete presentations. Check the RittmanMead blog after the Atlanta edition of the RittmanMead BI Forum 2014. They will post all the presentations (both Brighton as well as Atlanta).

Extreme Intelligence by Emiel van Bockel

Emiel started the day where he took us on a journey with regards to the Exalytics implementation @ CB Logistics. Exalytics is one of the Engineered Systems Oracle has.

An Engineered System is not a Plug ’n Play Environment. It needs to be Engineered. Only start engineering when you are sure system works.

Know your system (understand your data)

Do not use the wizards, but use your head/experience. Do it yourself.

If done right you own your own Extreme Intelligence System. The best in the world!

Times Ten Best Practice and Optimization by Chris Jenkins

Chris who is Senior Director, In-Memory Technology, TimesTen Development at Oracle gave us some very detailed insight into Oracle Times Ten.

OS Configuration

Shared Memory Segment

Huge Page considerations

Semaphores

Save storage (inline – out of line) by comparing Data Types between an Oracle Database and the Times Ten Database

Compression

Loading Times Ten via…..

Incremental refresh

Parallelism

Performance Optimisation

 OBIEE Performance in the Real World by Robin Moffat

Evidence based Design and Diagnostics

Create Time Profile – “Nose to Tail” —> Which component (OBIEE, Weblogic, Network, Database, etc.) is causing trouble.

Dive into the NQQuery Log – Query Logging is not evil! Check for more details here.

DMS metrics (obi-metrics-agent)

Grafana – Public live demo online

Must Read – “Thinking Clearly about Performance

Oracle BI Cloud by Adam Bloom

Sort of NDA, but it will be there……the Oracle BI Cloud

Oracle invests heavily in the Cloud. As a part of that a lot of new interesting Oracle BI functionality will become available in the Cloud first. Hopefully these functionalities will arrive on Premise shortly after.

Extreme Data Warehousing by Paul Oprea

A lot of discussion about Agile and Waterfall.One ting is important; Keep the user engaged and involved!

A Picture Can Replace A Thousand Words by Michael Rainey

Using pictures to vizualize the process will help in getting the requirements clear.

BPMN

About the Oracle DW Global Leaders Program by Reiner Zimmerman

http://www.oracle.com/technetwork/database/bi-datawarehousing/oracle-dw-global-leaders-brochure-345526.pdf

 Enterprise Big Data Architecture by Andrew Bond & Stewart Bryson

Oracle Information Management Reference Architecture

Discovery Lab

Foundation Layer – (Raw) Data Reservoir – Golden Gate  -> Mapping Physical to Logical (OBIEE) – No ETL, yet

Data Factory (ETL)

Enterprise Information Store

Event Engine

Data Ingestion

Information Interpretation

Agile Manifesto

Model Driven Development – Sandbox

Generate Logical Model Documentation (OBIEE)

Access and Performance Layer

Refactoring – Solve challenges in the Front-End. Working report -> Then move down to RPD or ETL

TDWI Chicago 2013 Keynote: Big Data, Bigger Impact

RittmanMead BI Forum 2014

 

RittmanMead BI Forum 2014

 

Today the 6th (my 5th) RittmanMead BI Forum takes off in Brighton. As usual the guys at RittmanMead have been able to put together a variety of sessions (Presentations, TED session, Keynotes, Debate) around OBIEE through to Oracle Endeca, Oracle Data Integrator and Oracle Essbase and In-Memory Analytics Databases.

For me the RittmanMead BI Forum is an opportunity to meet with the Premier League in Oracle BI&DW.

Check the RittmanMead website for the agenda and more details on the Lars George Cloudera Hadoop Masterclass – RM BI Forum 2014, Brighton & Atlanta

I will try to keep up a diary of the following three days.

Check back here to stay posted. If you want some liver coverage please check the following hashtag on Twitter; #biforum2014.

RM BI Forum 2013 – Wrap – up

Last week I was one of the lucky ones to join the he Rittman Mead BI Forum 2013. This year we were served with a 3-day program. Just like the other years the program was varied. Varied in subjects  (Oracle BI EE, Oracle Endeca, Aggregation Persistence, Big Data, Oracle Exalytics, Oracle BAM /BPM, Cloud, etc.) an varied in in style; Keynotes, one hour presentations, a debate and 10-minute TED-sessions. Next to that the possibility of a Masterclass around Oracle Data Integrator

Just like all the other days the Rittman Mead BI Forum 2013 was an excellent place to network and exchange ideas. Next to the people I knew already I have met a lot of ‘new’ people. These days were a big inspiration for me. I do not have to be bored the coming year.

Congratulations to Antony Heljula for receiving the ‘Best Speaker Award’ for the second time!

A big thank you to Mark Rittman, Jon Mead and their crew. Also a big thanks to Oracle for joining and for being so open about the Oracle BI developments and their visions and roadmaps. Thanks all for joining and sharing. That’s what makes the Rittman Mead BI Forum such a great event to be at. Hope to see everyone next year.

For a foto-impresssion, check Flickr.

Tommorow the US version of the Rittman Mead BI Forum will start. If you would like to stay informed, you should check the Tweetchat.

As of this weekend the presentations of the RittmanMead BI Forum 2013 (Brighton and Atlanta) are online. There is definitely some good stuff to have a look at!!

RM BI Forum 2013 Notes – Oracle Data Integrator Master Class

Today the RittmanMead BI Forum 2013 started with an Oracle Data Integrator Master Class provided by (in alphabetical order)  Mark Rittman, Michael Rainey and Stewart Bryson.

I made some notes, so I’ll try to highlight some points from the Master Class. It won’t be complete, but it gives an indication. I didn’t know much about ODI, so the start of the Master Class was very welcome to me.

Overview by Stewart Bryson

Just in time for Oracle BIA 11.1.1.7 – everything ODI, bye, bye Informatica and DAC (DAC translated into configuration and packaging and load plans).

Further integration with Oracle Weblogic and the Fusion Middleware

ODI & OBI Jive really good together. Abstraction of physical Sources logic built into the model not the process. Same like OBI. Develop the model, not the query. Metadata. See the the similarity between ODI and OBI.

Scripting becomes Groovy with ODI  (see later on).

Everything you do in ODI goes via Agents
OCI versus JDBC –> ETL versus E-LT (insert into select)

Develop once in the Model instead of in the interface / mapping. Interface inherits from the model, override if needed. Interconnect interfaces via yellow temporary interfaces

Knowledge Modules (KM) –  the physical implementation of the logic
How to load is determined by the KM, E-LT or ETL

Packaging (sequencing) versus Load Plans

Goldengate and ODI by Michael Rainey

Oracle Reference Architecture for Information Management and Big Data – 2013 Whitepaper

Oracle Goldengate – Data Replication

CDC Journalizing in ODI – Journalizing Knowledge Module (JKM)

Goldengate uses the JKM….generated metadata and a readme how to apply. No full integration

RMAN redo log, archive log , cleaning the logs

Parent Child Journalizing two different tables via two interfaces into the same target table

Subscription Views a RM feature to provide a choice for the ETL developer to choose which object to use

Oracle Goldengate and ODI are a Perfect Match

ODI and Big Data by Mark Rittman
If you do not care about a single row you refer to Big Data
Decisions based on your own data vs decisions based on all data relevant to you

Oracle Big Data

Terminology

HDFS
Hive

ODI (or OBIEE) to connect the Hadoop world to the traditional DWH world via the Hive.

HiveODBC (DocId 1520733.1) and HiveJDBC

ODI and OBIEE als enabelers to use the result out of the Hadoop world
Check Mark’s presentation

The three R’s of ODI – Resuming, Restarting, Restoring by Stewart Bryson

Using database features in ODI to eliminate the “Aftermath scenarios”.

Resuming

Enable resumability in ODI to prevent a load to fail and just suspend
Monitor the resumable view – dba_resumable view

Load Plans

Restarting

Flashback Table
Flashback Database

Record the SCN (be careful with row level and block level)

Restoring

archivelog mode
Block change tracking file
Insert /*APPEND*/
Nologging
Backup

Check the origin of the “Three R’s of Data Warehouse Fault Tolerance” here.

Automating & Scripting Oracle Data Integrator by Michael Rainey

Some great examples of how to make life a little bit easier. Could Oracle have used this to migrate Oracle BIA from Informatica to Oracle Data Integrator earlier?

ODI – 11g Expert Accelerator for Model Creation – David Allen 

All in all it was a very valuable Master Class. I learned a lot and there is lot more to investigate and explore. Hopefully this is the standard for the rest of the BI Forum.

RittmanMead BI Forum 2013

Today the 5th (my 4th) RittmanMead BI Forum takes off in Brighton. As usual the guys at RittmanMead have been able to put together a variety of sessions (Presentations, TED session, Keynotes, Debate) around Oracle BI (Applications), Oracle Endeca, Oracle Data Integrator and Oracle Essbase.

For me the RittmanMead BI Forum is an opportunity to meet with the Premier League in Oracle BI.

Check the RittmanMead website for the agenda and a preview of the Data Integration Masterclass.

I will try to keep up a diary of the following three days.

Check back here to stay posted.