RM BI Forum 2013 Notes – Oracle Data Integrator Master Class

Today the RittmanMead BI Forum 2013 started with an Oracle Data Integrator Master Class provided by (in alphabetical order)  Mark Rittman, Michael Rainey and Stewart Bryson.

I made some notes, so I’ll try to highlight some points from the Master Class. It won’t be complete, but it gives an indication. I didn’t know much about ODI, so the start of the Master Class was very welcome to me.

Overview by Stewart Bryson

Just in time for Oracle BIA 11.1.1.7 – everything ODI, bye, bye Informatica and DAC (DAC translated into configuration and packaging and load plans).

Further integration with Oracle Weblogic and the Fusion Middleware

ODI & OBI Jive really good together. Abstraction of physical Sources logic built into the model not the process. Same like OBI. Develop the model, not the query. Metadata. See the the similarity between ODI and OBI.

Scripting becomes Groovy with ODI  (see later on).

Everything you do in ODI goes via Agents
OCI versus JDBC –> ETL versus E-LT (insert into select)

Develop once in the Model instead of in the interface / mapping. Interface inherits from the model, override if needed. Interconnect interfaces via yellow temporary interfaces

Knowledge Modules (KM) –  the physical implementation of the logic
How to load is determined by the KM, E-LT or ETL

Packaging (sequencing) versus Load Plans

Goldengate and ODI by Michael Rainey

Oracle Reference Architecture for Information Management and Big Data – 2013 Whitepaper

Oracle Goldengate – Data Replication

CDC Journalizing in ODI – Journalizing Knowledge Module (JKM)

Goldengate uses the JKM….generated metadata and a readme how to apply. No full integration

RMAN redo log, archive log , cleaning the logs

Parent Child Journalizing two different tables via two interfaces into the same target table

Subscription Views a RM feature to provide a choice for the ETL developer to choose which object to use

Oracle Goldengate and ODI are a Perfect Match

ODI and Big Data by Mark Rittman
If you do not care about a single row you refer to Big Data
Decisions based on your own data vs decisions based on all data relevant to you

Oracle Big Data

Terminology

HDFS
Hive

ODI (or OBIEE) to connect the Hadoop world to the traditional DWH world via the Hive.

HiveODBC (DocId 1520733.1) and HiveJDBC

ODI and OBIEE als enabelers to use the result out of the Hadoop world
Check Mark’s presentation

The three R’s of ODI – Resuming, Restarting, Restoring by Stewart Bryson

Using database features in ODI to eliminate the “Aftermath scenarios”.

Resuming

Enable resumability in ODI to prevent a load to fail and just suspend
Monitor the resumable view – dba_resumable view

Load Plans

Restarting

Flashback Table
Flashback Database

Record the SCN (be careful with row level and block level)

Restoring

archivelog mode
Block change tracking file
Insert /*APPEND*/
Nologging
Backup

Check the origin of the “Three R’s of Data Warehouse Fault Tolerance” here.

Automating & Scripting Oracle Data Integrator by Michael Rainey

Some great examples of how to make life a little bit easier. Could Oracle have used this to migrate Oracle BIA from Informatica to Oracle Data Integrator earlier?

ODI – 11g Expert Accelerator for Model Creation – David Allen 

All in all it was a very valuable Master Class. I learned a lot and there is lot more to investigate and explore. Hopefully this is the standard for the rest of the BI Forum.

RittmanMead BI Forum 2013

Today the 5th (my 4th) RittmanMead BI Forum takes off in Brighton. As usual the guys at RittmanMead have been able to put together a variety of sessions (Presentations, TED session, Keynotes, Debate) around Oracle BI (Applications), Oracle Endeca, Oracle Data Integrator and Oracle Essbase.

For me the RittmanMead BI Forum is an opportunity to meet with the Premier League in Oracle BI.

Check the RittmanMead website for the agenda and a preview of the Data Integration Masterclass.

I will try to keep up a diary of the following three days.

Check back here to stay posted.

RM BI Forum Notes – Wrap-up

Last week I have tried to give you an impression about the Rittman Mead BI Forum 2012. They managed to provide us with a four day program packed with all things related to Oracle BI. Two core days with various presentations. Various in subject; Oracle BI, agile, Fusion Apps, Endeca, etc., etc. But also various in style; Keynotes, one hour presentations and 10-minute (TED/Ignite) presentations. Next to that the possibility of a Masterclass by Kevin McGinley and a NDA session by Oracle.
I was one of the lucky few, who was able to join all four days. Four days, packed with information and a basis for a lot of inspiration. Where to start!?

The Rittman Mead BI Forum is a good place to network and to exchange ideas. It was good to see a lot of known faces again. On top of that I have met some ‘new’ people also.

A big thank you to Mark Rittman, Jon Mead and their crew. Also a big thanks to Oracle for joining and for being so open about the Oracle BI developments and their visions and roadmaps. Thanks all for joining and sharing. That’s what makes the Rittman Mead BI Forum such a great event to be at. Hope to see everyone next year.

For a foto-impresssion, check Flickr.

Tommorow the US version of the Rittman Mead BI Forum will start. If you would like to stay informed, you should check the Tweetchat.

Stay on the lookout for the pdf’s which will probably placed on the Rittman Mead website. There will definitely be some good stuff to have a look at!!

RM BI Forum Notes – Day 3

Day 3 of the Rittman Mead BI Forum is the second of the two core days filled with 1 hour and 10 minute presentations.

A few notes related to the 1 hour presentations. These notes by far do not cover everything that has been presented, but should give you a indication and possibly a starting point for further investigation.

*******

Adam Bloom – Oracle BI 11g Diagnostics and Logging
Three places for logging; BI, Enterprise Manager and Weblogic
There is a whole lot of logging. Check the documentation to find your way.
Check JRockit
Rotation and location can be managed
ExecutionId’s should make it ‘easy’ to link the various logfiles together and find the cause of the problem
A clean set of logs –> DocId 1434514.1 on Oracle Support


Emiel van BockelAgile going all the BI way
People and Information engineerd to work together
Information cycle –> from data to information to knowledge back to data again
Adding sense to data
Agile is the abilty to react to change with focus and total control
Communication is the key – Post-IT
Begin with the end in mind – learning


Mike DurranExalytics (Analytics without Limits)
Infiniband for Networking excellence
Check the Times-Ten documentation on OTN
Oracle SQL Developer to check on source databases, the RCU schemas & Summary Statistics and Times-Ten
1 TB becomes 400 GB effective mememory due to the perm and temp space for Times-Ten (800 GB total, equally devided)
Essbase for faster planning
Certified to run Oracle BI Applications
Summary Advisor to identify hotspots based on Usage Tracking information


Michael WilckeFrom spreadsheets to dashboards
Understand the Business – Never believe a customer but try to understand him / her
Set Expectations and live up to them
The Information Network – Connecting Oracle BI Dashboards
Information Integration by Conforming Dimensions
Insist on Decisions – Commitment

More to come

RM BI Forum Notes – Keynote – Debra Lilley

The second day of the Rittman Mead BI Forum ended with an Keynote provided by Debra Lilley. She showed us the role Oracle BI (Applications) will play in Fusion Applications.

A few notes. These notes by far do not cover everything that has been presented, but should give you a indication and possibly a starting point for further investigation.

*******

Fusion Applications less new Functionality as opposed to a lot of new (aquired) Technology in the Fusion Middleware
(Role-Based) End User experience –> getting the right information in the right time
Integrating Apps and BI makes pre-aggregation and (balance) predictions possible at the time transactions are entered
Informatica & ODI side-by-side in the Fusion BI Architecture? There seems to be no single answer (yet)
BI View Objects on top of the Fusion Applications including Essbase
The importance of the Metadata Store

After this Keynote we had a little drink in the Rittman Mead office and a very nice dinner in the Havana restaurant.

More to come