Facebook Twitter LinkedIn YouTube RSS
magnify
Home Data Vault A short intro to #datavault 2.0
formats

A short intro to #datavault 2.0

In this post I will introduce some of the items covered in Data Vault 2.0, I am refining and polishing the specifications at this time, and should be able to release them shortly. In the mean time, here are some reasons why DV2.0 is up-and-coming, what role it will play in the Data Warehousing landscape, why it’s important, and what DV2.0 certification is about.

What is Data Vault 2.0?

Data Vault 2.0 is the evolution of the standards for Data Vault.  Before I go any further I think it is wise to state that Wikipedia needs an update, as it does not cover all of the components nor the full definition of Data Vault.  To that end: here is the proper definition of “Data Vault” itself:

Data Vault is a system of data warehousing and business intelligence that is comprised of three major components: the Data Vault Model, the Data Vault Methodology, and the Data Vault Systems Architecture.

Changes to the standard:

Data Vault 2.0 brings to the table improvements in the following areas:

  1. Data Vault Modeling – changes have been made to adapt better performance levels for both loading and querying.  These changes are also specific to ensuring the success of Data Vault Modeling with the use of NoSQL environments in a seamlessly integrated fashion.
  2. Data Vault Methodology – while I’ve introduced bits and pieces of the methodology (such as implementation rules and procedures) during older certification classes, I’ve not really published in full, the complete components around the methodology.  Data Vault 2.0 brings the full methodology to bear on the projects to ensure CMMI Level 5 compliance (which relies also on people’s ability to execute), TQM (overall for BI), Six Sigma (for project based build outs), and Agile for rapid 2 to 3 week delivery cycles.  Data Vault 2.0 certification will require knowledge of the methodology as well as knowledge of the Modeling components.
  3. Data Vault Architecture – In my book: Super Charge Your Data Warehouse I outline some of the systems architecture components necessary to make the “Data Vault System” a success.  In Data Vault 2.0 not much has changed here, with the exception being: the inclusion of NoSQL environments for multiple purposes.  Data Vault 2.0 certification will require knowledge of the NoSQL environments from both an architectural perspective, as well as an implementation perspective.

Why Bother With Data Vault 2.0? Business Value?

The world is shifting, and including big data is a necessary step in forward movement.  Not just that, but subtle changes to the data modeling architecture are necessary for seamless integration of big data and NoSQL environments.  Beyond that, for far too long the methodology has been “discounted” or forgotten or left in the dust.  Well, I’m here to say that this will no longer be the case.

Customers are demanding IT do more with less (as they always have), and they are asking us to be agile about our implementation strategies.  Long gone are the days of 6 month deployments, or even 3 month deployments.  We now must step to the plate and begin to acknowledge things like:  (These things are parts of the Business Value)

  • Managed Self Service BI
  • Automation and Back end self-healing systems
  • Dynamic Structure Adaptation of the Data Warehouse
  • Rapid Time to Deliver (2 or 3 week delivery cycles)
  • Lower Cost of Maintenance and Management (TCO)

Businesses are clamoring for the data warehousing industry to “catch up”.  Well, with Data Vault 2.0 they can, and you can help them get there rapidly.  This year as I release the standards, I will be releasing specifications for the following areas:

  • Data Vault Modeling 2.0 Specification (specific to the Data Modeling and architecture components)
  • Data Vault Implementation 2.0 Specification (specific to ETL and loading components including Big Data and NoSQL)
  • Data Vault Methodology 2.0 Specification (specific to delivery, project management, agile production, etc..)
  • Data Vault Architecture 2.0 Specification (what’s required, best practices, and standards for systems architecture designs)

What Does Certification say to customers?

Certification in Data Vault 2.0 tells the customers that you are well briefed in the standards, the methods, the architecture and design of end-to-end data warehouses for a corporate level.  That you have the capacity to deliver in an agile fashion, that you can build, automate, and deploy Data Vault systems from end to end with only weeks of design, and implementation.  That you can discuss the business benefits and uplift (or value) with the business users.  That you can manage a full Data Vault 2.0 project, that you can include Big Data and NoSQL systems seamlessly and easily in your Data Vault 2.0 implementation plan.

What’s the difference with Data Vault 1.0 Certification?

The original certification course and test was highly focused on just Data Vault Modeling.  It did not have any of the considerations for Big Data nor, NoSQL.  There were a few bits introduced in the 1.0 certification class that discussed implementation and architecture, but the certification test did not ensure the knowledge was in place.  The original certification test does not discuss methodology at all.

Can I get Data Vault 2.0 Certified without taking the class?

Yes, and the DV2.0 Certification test will be available for a fee, and from a licensed and authorized Data Vault 2.0 training partner.

Can I take a Data Vault 2.0 Update Class if I’m familiar with Data Vault 1.0?

Yes, there will be a number of on-line courses available at: http://LearnDataVault.com/training over the course of this year which will allow you to take different classes to learn each of the aspects of DV2.0

After which, you can take the Data Vault 2.0 Certification test to complete your knowledge level with the customer base.

Will there be Downloads / Artifacts available with the on-line class?

Yes.  I will be providing quite a few downloads for each section for use with your project, the implementation, and different tool sets involved.  All will have examples that you can follow or apply to your project.

What on-line classes can I expect to see this year?

The following courses are being developed for Data Vault 2.0 release this year:

  • Informatica ETL Data Vault Loading & Data Mart Building Best Practices and Patterns (due out end of February)
  • SSIS ETL Data Vault Loading & Data Mart Building Best Practices (Date: TBD)
  • Data Stage ETL Data Vault Loading & Data Mart Building Best Practices (Date: TBD)
  • ANSI-SQL Data Vault Loading & Data Mart Building Best Practices (due out end of April 2013)
  • Data Vault Bootcamp – end to end Data Vault 2.0 full coverage – prep course for DV2.0 certification (due out Q3 – 2013)
  • Data Vault 2.0 Certification Preparation – For those wanting to prepare for DV2.0 certification (Due out early Q3-2013)
  • Data Vault Testing Strategies and Best Practices – (due out early Q3-2013)
  • From Data Vault to Data Marts – Specializing in loading Data Marts (due out Q4-2013)

The class that is available today is:

  • Data Vault Fundamentals – Implementation Basics, ANSI-SQL based standards, designs, goals, covering scalability, performance, parallelism and fault tolerance.  You can find this one already available at: http://LearnDataVault.com/training

Can I teach DV2.0 or use any of the materials?

Not without licensed written authorization from me.  You must as an individual (not an organization) sign up to become a licensed Data Vault 2.0 Trainer.  You must have completed Data Vault 2.0 certification yourself.  You must have real-world experience with Big Data and NoSQL solutions.  In other words, you will be asked to pass an instructors test which is far more rigorous than that of the standard Data Vault 2.0 student certification.

Once authorized, and accepted in to the program, you will be licensed (as an individual not an organization) to teach Data Vault 2.0 certification classes.

NOTE: Organizations will be listed as authorized Data Vault 2.0 training centers, but individual trainers within the organizations are required to adhere to the rigors.  Authorization to teach Data Vault 2.0 will be granted to individuals, not organizations.

Legal made me say this: anyone without authorization, caught infringing on my copyrights, trademarks, and intellectual property will be punished to the full extent of either international or US law.  Data Vault 2.0, DV2.0 are registered trademarks and copyrights of Dan Linstedt.  All intellectual property around Data Vault 2.0 is the sole property of Dan Linstedt, all rights reserved.

I want to know more about teaching or certification or on-line courses…

Use the CONTACT US form on this site, I look forward to hearing from you.

 

 
 Share on Facebook Share on Twitter Share on Reddit Share on LinkedIn
2 Comments  comments 

2 Responses

  1. Ahmed Fayed

    Hi,
    We’re planning to use the data vault architecture in Dubai Customs data warehouse, it’s a very flexible technique combining the features of centralized and bus architectures and avoids their drawbacks, the e-book provides adequate information about the structure and design, but we need information about the recommend development process, required team roles, artifacts…, where can I find such information, is it published somewhere?

    Thanks.

  2. Hi Ahmed,

    Thank-you for contacting me. Yes, the information you seek is currently offered in two places: http://LearnDataVault.com – the on-line, hands on ETL training classes (one that is SQL generic based, and one that is Informatica ETL specific). The only other place to get information about the development process, team roles, artifacts, SCRUM, agile, etc… is in my Data Vault 2.0 Boot Camp course. Currently I offer this in person only. Although I hope to soon offer this class on LearnDataVault.com as well.

    Please feel free to contact me directly at: danLinstedt@gmail.com for further information or if you have additional questions.

    Thank-you kindly,
    Dan Linstedt

Leave a Reply

Your email address will not be published. Required fields are marked *


*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Current ye@r *