Trying to understand the Oracle Reference Architecture for Information Management

Last month I have been attending the RittmanMead BI Forum 2014. In the wrap-up I mentioned a presentation by Andrew Bond & Stewart Bryson. They had a very nice presentation about the Oracle Information Management Reference Architecture. This needed some further investigation from my part.

This blogpost is a first summary of the information I found online so far.

There is a complete reference library of IT Strategies from Oracle. Pay extra attention to the following docs:

  • Oracle Reference Architecture Information Management
  • Oracle Reference Architecture Business Analytics Foundation
  • Oracle Reference Architecture Business Analytics Infrastructure
  • Oracle Reference Architecture Service Orientation
  • Oracle Reference Architecture Security
  • Oracle Reference Architecture Engineered Systems

IT Strategies from Oracle

Next to that, Oracle has a few White Papers focussing on Information Management (Big Data & Analytics):

Oracle Information Management – Logical View

Let’s take a closer look, see the picture below. This picture has been copied from; the Oracle Information Management Reference Architecture. presentation I mentioned above. There are a few major components in the Reference Architecture

  • Data Sources
  • Information Provisioning
    • Data Ingestion
    • Logical Data Warehouse
  • Information Delivery

While putting together this blog post, Mark Rittman posted the following article(s); “Introducing the Updated Oracle / Rittman Mead Information Management Reference Architecture – Pt1. Information Architecture and the “Data Factory” & Pt2. – Delivering the Data Factory” on the RM Blog.

Oracle Information Management – Logical View

Data Sources

Within this Reference Architecture Oracle should be able to handle all sorts of data:

  • Traditional Enterprise Data (ERP, CRM, etc.)
  • Machine-generated /Sensor Data (Smart Meters, Equipment Logs, etc.)
  • Social Data (Twitter, Facebook, etc.)

Any Data - Any Source - Any Format - Different Data

The last couple of years / decades, Data has changed. We (as BI/DW-Consultants) have always looked at data in a Traditional (Structured) way. Now Oracle provides an Architecture to combine the old Data with the new (Big) Data. Whether there are 3, 4, 5, or whatever number of V’s, the most important thing is that you get value from your Data!

Data Ingestion (Loading)

Oracle provides / supports tools to perform Batch or (Near) Real-Time Data Ingestion.

Oracle GoldenGate & Oracle Data Integrator

Michael Rainey is writing an excellent series on how to load the Raw Data Reservoir (Staging Layer) and the Foundation Layer; Oracle GoldenGate and Oracle Data Integrator – A Perfect Match in 12c.

Cloudera Distribution including Apache Hadoop (CDH)

Hadoop is Open Source and Apache licensed. Cloudera provides an Open Source Distribution ( Cloudera CDH – Cloudera Enterprise Data Hub).

Oracle Event Processing (OEP)

OEP is a complete solution for building applications to filter, correlate and process events in real-time. Check the Data Sheet here.

Logical Data Warehouse

There are a few different Layers:

  • Raw Data Reservoir (Staging Layer)
  • Foundation Layer
  • Access and Perfomance Layer

Depending on the requirements and the tooling one can decide to skip or combine the different Layers. Oracle has the tooling to load the various Layers directly (GoldenGate).

The data is no longer only stored in the Oracle Database. The ‘new’ types of data require ‘new’ types of storage. There are different Data Stores for different purposes.

The Oracle Big Data Connectors can be used to integrate Apache Hadoop with Oracle Database Software.

Processing the data could be either In-Database (Oracle Database Options –  Advanced Analytics, OLAP) or In-Memory (Oracle TimesTen).

Information Delivery

Oracle is able to support proven answers to known questions via Oracle BI. Fast answers to new questions are provided by Oracle Endeca Information Discovery.

“The Oracle BI Foundation Suite provides comprehensive capabilities for business intelligence, including enterprise reporting, dashboards, ad-hoc analysis, multi-dimensional OLAP, scorecards, and predictive analytics on an integrated platform”

Oracle BI Foundation - Front-End

OBIEE makes it possible (Logical Layer) to skip the ‘Access and Perfomance Layer’ and source directly form the ‘Foundation Layer’. There are some very interesting presentations online around this subject.

“Oracle Endeca Information Discovery is a complete enterprise data discovery platform that combines information of any type, from any source, empowering business user independence in balance with IT governance. Now organizations can access the information they need, when they need it, to make business decisions they can trust.”

There is still a lot more to investigate, but for me this gives a little bit more guidance.

Big Data and Analytics Top Ten Trends for 2014

Oracle recently published their view on the; Top Ten Trends “Big Data” & “Analytics” for 2014. Find the list below:

1. Business Users Get Hooked on Mobile Analytics –> Oracle Business Intelligence Mobile App Designer

2. Analytics Take to the Cloud –> Oracle Applications Cloud

3. Hadoop-Based Data Reservoirs Unite with Data Warehouses –> Your Data Warehouse and Hadoop – Better Together Featuring Cloudera Webcast

4. New Skills Bolster Big Data Investments –> In search of Insight and Foresight – Getting more out of Big Data

5. Big Data Discovery is the Secret to Workforce Success for HCM –> Harnessing the Power of Employee Sentiment

6. Predictive Analytics Lend Fresh Insight into Big Data Strategies –> Oracle Advanced Analytics Option

7. Predictive Analytics Bring New Insight to Old Business Processes –> Big Data @ work – Real-Time Fraud Detection and Prevention

  • White Paper Big Data Analytics: Advanced Analytics in Oracle Database
  • White Paper Bringing R to the Enterprise
  • White Paper Oracle Engineered Systems – Engineered for Extreme Performance

8. Decision Optimization Technologies Enhance Human Intuition –> Oracle Real-Time Decisions Review by James Taylor

9. Business Leaders Embrace Packaged Analytics –> Packaged Analytic Applications: Accelerating Time and Value

10. New Skills Launch New Horizons of Analysis –> Oracle Training

If you are interested in; Succeeding with Enterprise Performance Management in 2014, please check here.

Check it out yourself

Check here for the Pre-Built Developer VMs (for Oracle VM VirtualBox). Pay special attention to the ‘SampleApp V309’ (Oracle BI Foundation) and the ‘BigDataLite 2.5’. If you are interested in Endeca, you might want to download an Endeca Virtual Machine here.

There are also some hosted environments online for Oracle BI (prodney / Admin123) and Endeca (publicuser@oracle.com / Admin123)

If you would like some guidance, you might want to check out the Oracle Learning Library (OLL).

RM BI Forum 2013 – Day Two

Check out my RittmanMead BI Forum 2013, Day Two Notes

Adam Seed & Charles Elliot – Oracle Endeca looking beyond the general demos

Oracle Endeca 3.0 Difficult to install into Weblogic

Endeca Portal – repository
Endeca Server
Endeca Provisioning for uploading Excelsheet
Endeca Integrator – client

Collaboration of Software
Liferay – Endeca Studio
Oracle MDEX Server
Clover ETL (Integrator)
Lexalytics – Text Enrichment

Configuration Load –> Getting Started
Row Level Security
GEO Mapping – Google Maps

OBIEE as a Datasource using Integratorion
BI Publisher Datamodel Integration
Catalog Search

Edelweiss Kammermann – integrating Oracle BI, BPM and BAM, the complete cycle of Information

Oracle BPM – Business Process Management
Oracle BAM – Business Activity Monitoring

Oracle BI Webservice or Analyse
Process Cubes
Oracle ADF

Same Framework
More Insight
Automation and Interaction

Mike Durran – Virtualize Exalytics
Oracle VM – Smaller licenses – Trusted partitioning to run a subset of the 40 cores
RAID-1 for the OS (Oracle Linux)
RAID-5
OCFS – Oracle Clustered Filesystem

Big Data – Hype or Future

This is a very difficult discussion. First of all, what is the definition of Big Data? I liked the ‘definition’ of Peter Scott; If you do not care about a single row, you refer to Big Data. Sounds plausible. Is Big Data about tools (Hadoop vs. Oracle Database)? Is Big Data about the difference between structured and unstructured data? In a way all data can be referred to as structured. There is a whole new source of (Social) Data which didn’t exist before. Is that Big Data?

All in all one essential question is; what are you going to do with the data? Just collecting data, because everybody does it would be useless.

Making decisions on data which is only for 95% correct is whole new way of thinking as opposed to traditional (Financial) DWH-systems. I guess (almost) everybody agreed on that.

RM BI Forum Notes – Oracle Keynote

Day I of the Rittman Mead BI Forum 2012 ended (besides a delicious meal) with a Keynote provided by Oracle (Alan Lee and Mike Durran). First Alan thanked us for being Oracle BI evangelistic. I guess a thanks back is well in place for a great product (portfolio).

Nothing spectacular to announce. I guess luckily for us, because it has been a busy year ;-).

A few notes:

Oracle BI will be Oracle (Business) Analytics

Next to the Oracle BI Foundation products like Endeca, Big Data (is this a product or a process), Engineered Systems (Big Data Appliance, Exadata, Exalytics) have been covered. Especially the last two products were subject to discussion. How do Exadata and Exalytics work together? We were presented with a Exalytics demo. Do you need to now where the data is coming from (TimesTen Oracle BI Cache) or is the fact that the data is retrieved very fast enough? This discussion will continue when Mike Durran does his presentations. Personally I would like to now where the data is coming from an I wasn’t the only one…….

More to come