RM BI Forum 2013 – Wrap – up

Last week I was one of the lucky ones to join the he Rittman Mead BI Forum 2013. This year we were served with a 3-day program. Just like the other years the program was varied. Varied in subjects  (Oracle BI EE, Oracle Endeca, Aggregation Persistence, Big Data, Oracle Exalytics, Oracle BAM /BPM, Cloud, etc.) an varied in in style; Keynotes, one hour presentations, a debate and 10-minute TED-sessions. Next to that the possibility of a Masterclass around Oracle Data Integrator

Just like all the other days the Rittman Mead BI Forum 2013 was an excellent place to network and exchange ideas. Next to the people I knew already I have met a lot of ‘new’ people. These days were a big inspiration for me. I do not have to be bored the coming year.

Congratulations to Antony Heljula for receiving the ‘Best Speaker Award’ for the second time!

A big thank you to Mark Rittman, Jon Mead and their crew. Also a big thanks to Oracle for joining and for being so open about the Oracle BI developments and their visions and roadmaps. Thanks all for joining and sharing. That’s what makes the Rittman Mead BI Forum such a great event to be at. Hope to see everyone next year.

For a foto-impresssion, check Flickr.

Tommorow the US version of the Rittman Mead BI Forum will start. If you would like to stay informed, you should check the Tweetchat.

As of this weekend the presentations of the RittmanMead BI Forum 2013 (Brighton and Atlanta) are online. There is definitely some good stuff to have a look at!!

RM BI Forum 2013 – Day Two

Check out my RittmanMead BI Forum 2013, Day Two Notes

Adam Seed & Charles Elliot – Oracle Endeca looking beyond the general demos

Oracle Endeca 3.0 Difficult to install into Weblogic

Endeca Portal – repository
Endeca Server
Endeca Provisioning for uploading Excelsheet
Endeca Integrator – client

Collaboration of Software
Liferay – Endeca Studio
Oracle MDEX Server
Clover ETL (Integrator)
Lexalytics – Text Enrichment

Configuration Load –> Getting Started
Row Level Security
GEO Mapping – Google Maps

OBIEE as a Datasource using Integratorion
BI Publisher Datamodel Integration
Catalog Search

Edelweiss Kammermann – integrating Oracle BI, BPM and BAM, the complete cycle of Information

Oracle BPM – Business Process Management
Oracle BAM – Business Activity Monitoring

Oracle BI Webservice or Analyse
Process Cubes
Oracle ADF

Same Framework
More Insight
Automation and Interaction

Mike Durran – Virtualize Exalytics
Oracle VM – Smaller licenses – Trusted partitioning to run a subset of the 40 cores
RAID-1 for the OS (Oracle Linux)
RAID-5
OCFS – Oracle Clustered Filesystem

Big Data – Hype or Future

This is a very difficult discussion. First of all, what is the definition of Big Data? I liked the ‘definition’ of Peter Scott; If you do not care about a single row, you refer to Big Data. Sounds plausible. Is Big Data about tools (Hadoop vs. Oracle Database)? Is Big Data about the difference between structured and unstructured data? In a way all data can be referred to as structured. There is a whole new source of (Social) Data which didn’t exist before. Is that Big Data?

All in all one essential question is; what are you going to do with the data? Just collecting data, because everybody does it would be useless.

Making decisions on data which is only for 95% correct is whole new way of thinking as opposed to traditional (Financial) DWH-systems. I guess (almost) everybody agreed on that.

RM BI Forum 2013 – Day One

Check out my RittmanMead BI Forum 2013, Day One Notes
Philipe Lion showing the V305 SampleApp
No Sales, no Demo, Samples –>  how to solve (functional) challanges, reverse engineer
Showcase the latest new and / or improved features
Tighter integration with other products from the Oracle Analytics family
Wait for V305 and start exploring the new functionality
Anthony Heljula – Performance Tuning – Real Customers Stories
Aggregate Persistance in Oracle BI – Agile
Creating and deploy Aggregates in Oracle BI (Both Physical as well as Logical)
Engineerd Systems (Oracle Exalytics, Oracle Database Appliance, Oracle Exadata)
Take everything (All possible slections) into account – Dashboard prompts (Granularity), Column Selectors, etc.
Operational Report Tuning – Dimension Elimination
Pushing down calculations to RPD
Incremental Load with Aggregate Persistance via Notepad (staging table and where clause)
Peak ETA Extract Transform Aggregate
Aggregate Groups – in Parralel, Using existing Aggregates as Source
Compression TimesTen
Parralel Query Database
Caching – Database TimesTen in Memory, Oracle BI Server Cache, Oracle BI Presentation Cache
Check his presentation here.
Marco Klaasens – Secrets of OBIEE Deployment at Liberty Global
Oracle APEX for Data Entry
Challanges
– Focus and Sequence (Agile)
– Knowledge
– Constraints
– Standards
Uli Bethke, Maciej Kocon – Oracle Data Integrator
ODI Performance
Metadatadriven SQL Code Generator –> Advanced Analytics – Analytic Functions
Code Templates (Knowledge Module)
Java Agents
Network
ODI Scheduling
Stage –> Dim –> Facts
Packages (Scenarios) versus Load Plans
Efficiency Analysis
Dependency Driven Scheduling
ODI Deployment / Release
Source Control
Merge
Trunk / Branch
Adam Bloom – New Developments in BI Multi-Tenancy and Cloud
 
Oracle Cloud – Hardware, Software infrastructure
NIST – National Institute of Standards and Technology
Multi-Tenancy
– Per Tenant Analytics
– Per Tenant BI
– Centrally Provisioned, Departemental BI
Toby Potter – Driving BI from Social Data with Datasift
There is more to a tweet then the 140 characters
It’s not the volume, but the value of data
Servicing Oracle via the biggest Hadoop cluster of Europe
Use your brain to use contextually right data- what do you want to know or do with the data
Profiling
Enrichment
Tagging
Datasift + Oracle = Social BI Platform
Making decisions on data which is only for 95% correct is whole new way of thinking as opposed to traditional (Financial) DWH-systems
TED Sessions
Jon Mead – Why I want to be in BI in 5 years of time
(Big) Data (Software, Statisitics, Scope)
Development techniques (Tools, Approaches)
Deliver (Cloud, Packaged, Control)
Anthony Heljula – Incrementally loading Exalytics using Notepad
NQCMD
Incremental Load with Aggregate Persistance via Notepad (via an additional staging table and a where clause)
Check his presentation here.
Mike Durran – HA, DR, CFC
 
How to keep your Exalytics systems online?
HA – Hig Availability
DR – Disaster Recovery
CFC – Cold Failover Cluster (CFC)

RM BI Forum 2013 Notes – Oracle Data Integrator Master Class

Today the RittmanMead BI Forum 2013 started with an Oracle Data Integrator Master Class provided by (in alphabetical order)  Mark Rittman, Michael Rainey and Stewart Bryson.

I made some notes, so I’ll try to highlight some points from the Master Class. It won’t be complete, but it gives an indication. I didn’t know much about ODI, so the start of the Master Class was very welcome to me.

Overview by Stewart Bryson

Just in time for Oracle BIA 11.1.1.7 – everything ODI, bye, bye Informatica and DAC (DAC translated into configuration and packaging and load plans).

Further integration with Oracle Weblogic and the Fusion Middleware

ODI & OBI Jive really good together. Abstraction of physical Sources logic built into the model not the process. Same like OBI. Develop the model, not the query. Metadata. See the the similarity between ODI and OBI.

Scripting becomes Groovy with ODI  (see later on).

Everything you do in ODI goes via Agents
OCI versus JDBC –> ETL versus E-LT (insert into select)

Develop once in the Model instead of in the interface / mapping. Interface inherits from the model, override if needed. Interconnect interfaces via yellow temporary interfaces

Knowledge Modules (KM) –  the physical implementation of the logic
How to load is determined by the KM, E-LT or ETL

Packaging (sequencing) versus Load Plans

Goldengate and ODI by Michael Rainey

Oracle Reference Architecture for Information Management and Big Data – 2013 Whitepaper

Oracle Goldengate – Data Replication

CDC Journalizing in ODI – Journalizing Knowledge Module (JKM)

Goldengate uses the JKM….generated metadata and a readme how to apply. No full integration

RMAN redo log, archive log , cleaning the logs

Parent Child Journalizing two different tables via two interfaces into the same target table

Subscription Views a RM feature to provide a choice for the ETL developer to choose which object to use

Oracle Goldengate and ODI are a Perfect Match

ODI and Big Data by Mark Rittman
If you do not care about a single row you refer to Big Data
Decisions based on your own data vs decisions based on all data relevant to you

Oracle Big Data

Terminology

HDFS
Hive

ODI (or OBIEE) to connect the Hadoop world to the traditional DWH world via the Hive.

HiveODBC (DocId 1520733.1) and HiveJDBC

ODI and OBIEE als enabelers to use the result out of the Hadoop world
Check Mark’s presentation

The three R’s of ODI – Resuming, Restarting, Restoring by Stewart Bryson

Using database features in ODI to eliminate the “Aftermath scenarios”.

Resuming

Enable resumability in ODI to prevent a load to fail and just suspend
Monitor the resumable view – dba_resumable view

Load Plans

Restarting

Flashback Table
Flashback Database

Record the SCN (be careful with row level and block level)

Restoring

archivelog mode
Block change tracking file
Insert /*APPEND*/
Nologging
Backup

Check the origin of the “Three R’s of Data Warehouse Fault Tolerance” here.

Automating & Scripting Oracle Data Integrator by Michael Rainey

Some great examples of how to make life a little bit easier. Could Oracle have used this to migrate Oracle BIA from Informatica to Oracle Data Integrator earlier?

ODI – 11g Expert Accelerator for Model Creation – David Allen 

All in all it was a very valuable Master Class. I learned a lot and there is lot more to investigate and explore. Hopefully this is the standard for the rest of the BI Forum.

RittmanMead BI Forum 2013

Today the 5th (my 4th) RittmanMead BI Forum takes off in Brighton. As usual the guys at RittmanMead have been able to put together a variety of sessions (Presentations, TED session, Keynotes, Debate) around Oracle BI (Applications), Oracle Endeca, Oracle Data Integrator and Oracle Essbase.

For me the RittmanMead BI Forum is an opportunity to meet with the Premier League in Oracle BI.

Check the RittmanMead website for the agenda and a preview of the Data Integration Masterclass.

I will try to keep up a diary of the following three days.

Check back here to stay posted.