The Quistor Business Analytics & Big Data Practice is expanding

Working at Quistor

 

We are expanding our Quistor Business Analytics & Big Data Practice. Therefore we are looking for new colleagues. Please find the vacancies for a Senior Oracle Business Analytics Consultant and a Senior Oracle Data Integrator Consultant below.

Please get into contact with me or send a mail to jobs@quistor.com. If you are not interested yourself, but know someone who might be, I would really appreciate it if you would let me know.

Thanks in advance.

Daan Bakboord

Managing Consultant Quistor Business Analytics & Big Data. Managing and developing the Oracle Business Analytics Practice in the Netherlands. Because of the DNA of Quistor I have a strong focus on Oracle Business Analytics (OBIEE, BICS &OBIA) and Oracle JDEdwards. Next to that I have strong interest in (the Architecture of) Business Analytics and Data Warehousing in general (TOGAF, ArchiMate and CBIP) and Oracle Business Analytics Architectures in specific.

Oracle Data Integrator 11g Cookbook – Review

Somewhere in the summer of 2010 the first 11g R1 release of Oracle Data Integrator (ODI) became GA. ODI is the leading Data Integration platform within the Oracle Product Family. It seemed like a logical step that a book on ODI 11g would be launched. The Oracle ODI Product Management team have shared their knowledge into a book called; Oracle Data Integrator 11g: Getting Started. This book presents the audience with a step-by-step tutorial. In the end the reader should be familiar, comfortable and successful with (the new features of) ODI 11g R1.

After the first ‘Getting Started’ book a more advanced book on ODI 11g seemed like a very logical next step.  The Oracle Data Integrator 11g Cookbook is a collection of recipes which cover the more advanced topics in ODI 11g.

Oracle Data Integrator 11g CookbookWhere the first book is more an introduction to ODI, the aim of the second book will uncover the more advanced features of ODI. Some basic knowledge of ODI is essential if you want to get the most out of the this Cookbook.

The Oracle Data Integrator 11g Cookbook is nicely structured. In a chronological order, the various components of ODI are covered. From Installation, Security, Variables, (inside) Knowledge Modules, Advanced Coding, Advanced ETL Processing to a Catch-all chapter which reveals the little know secrets and gives answers to several FAQ’s.

Each chapter consists of several (related) recipes. Each recipe is a step-by-step explanation of a specific task. Sometimes you have to perform some actions to get ready for the (next) recipe. Next to that it’s explained how things work. Last but not least, the recipes go beyond the steps necessary to complete a task in the; ‘There’s more’- and the ‘See also’-sections of the recipe. Within the tasks you will find notes which give some additional information to the recipe. Screenshots, code-(snippets) and links to external sites (Documentation, Oracle Support, Blogs, etc.) complete the recipes.

Consider the Oracle Data Integrator 11g Cookbook as a written MasterClass. Probably even for the more experienced ODI consultants, this book will reveal something they didn’t know before. I guess the authors succeeded in writing a book which differs from the first one and is still worth reading.

For me personally, I this book gives me more understanding of the capabilities of Oracle Data Integrator. I just recently (seriously) started exploring ODI. I would say that in this stage the Oracle Data Integrator 11g: Getting Started better fits my knowledge, but the  Oracle Data Integrator 11g Cookbook definitely is next on my reading list.

Enjoy reading this book.

RM BI Forum 2013 Notes – Oracle Data Integrator Master Class

Today the RittmanMead BI Forum 2013 started with an Oracle Data Integrator Master Class provided by (in alphabetical order)  Mark Rittman, Michael Rainey and Stewart Bryson.

I made some notes, so I’ll try to highlight some points from the Master Class. It won’t be complete, but it gives an indication. I didn’t know much about ODI, so the start of the Master Class was very welcome to me.

Overview by Stewart Bryson

Just in time for Oracle BIA 11.1.1.7 – everything ODI, bye, bye Informatica and DAC (DAC translated into configuration and packaging and load plans).

Further integration with Oracle Weblogic and the Fusion Middleware

ODI & OBI Jive really good together. Abstraction of physical Sources logic built into the model not the process. Same like OBI. Develop the model, not the query. Metadata. See the the similarity between ODI and OBI.

Scripting becomes Groovy with ODI  (see later on).

Everything you do in ODI goes via Agents
OCI versus JDBC –> ETL versus E-LT (insert into select)

Develop once in the Model instead of in the interface / mapping. Interface inherits from the model, override if needed. Interconnect interfaces via yellow temporary interfaces

Knowledge Modules (KM) –  the physical implementation of the logic
How to load is determined by the KM, E-LT or ETL

Packaging (sequencing) versus Load Plans

Goldengate and ODI by Michael Rainey

Oracle Reference Architecture for Information Management and Big Data – 2013 Whitepaper

Oracle Goldengate – Data Replication

CDC Journalizing in ODI – Journalizing Knowledge Module (JKM)

Goldengate uses the JKM….generated metadata and a readme how to apply. No full integration

RMAN redo log, archive log , cleaning the logs

Parent Child Journalizing two different tables via two interfaces into the same target table

Subscription Views a RM feature to provide a choice for the ETL developer to choose which object to use

Oracle Goldengate and ODI are a Perfect Match

ODI and Big Data by Mark Rittman
If you do not care about a single row you refer to Big Data
Decisions based on your own data vs decisions based on all data relevant to you

Oracle Big Data

Terminology

HDFS
Hive

ODI (or OBIEE) to connect the Hadoop world to the traditional DWH world via the Hive.

HiveODBC (DocId 1520733.1) and HiveJDBC

ODI and OBIEE als enabelers to use the result out of the Hadoop world
Check Mark’s presentation

The three R’s of ODI – Resuming, Restarting, Restoring by Stewart Bryson

Using database features in ODI to eliminate the “Aftermath scenarios”.

Resuming

Enable resumability in ODI to prevent a load to fail and just suspend
Monitor the resumable view – dba_resumable view

Load Plans

Restarting

Flashback Table
Flashback Database

Record the SCN (be careful with row level and block level)

Restoring

archivelog mode
Block change tracking file
Insert /*APPEND*/
Nologging
Backup

Check the origin of the “Three R’s of Data Warehouse Fault Tolerance” here.

Automating & Scripting Oracle Data Integrator by Michael Rainey

Some great examples of how to make life a little bit easier. Could Oracle have used this to migrate Oracle BIA from Informatica to Oracle Data Integrator earlier?

ODI – 11g Expert Accelerator for Model Creation – David Allen 

All in all it was a very valuable Master Class. I learned a lot and there is lot more to investigate and explore. Hopefully this is the standard for the rest of the BI Forum.