Data Scientist

Data Vault Standards Round 3

yet again, i am faced with a never ending stream of questions about why standards are important.  it seems, people are now asking me to prove why they should stick to the standards, rather than getting up off their own rear-ends and doing their own testing to prove why the standards need to be changed.  well, let’s explore this shall we?

first, some questions:

  • would you trust a brain surgeon who had no formal education in the medical profession?
  • would you trust a heart surgeon who said: i don’t operate on patients the way the standards dictate, i do my own thing, i actually remove the heart from the patient in order to operate on it outside the human body, just because i think it’s easier to get at.
  • would you trust a car mechanic on your new ferrari who was only qualified to work on lawn mowers?  someone who said: i can adapt and change the standards, all engines are basically the same…
  • what if your local physician (general practitioner) prescribed hallucinogenics to you because they felt that the “standard drugs” approved by the medical community and taught in school were not appropriate?

my point is this:

i’ve spent 10 years in r&d (between 1990 and 2000) testing, checking, fixing, adapting, modifying and proving the model, the methodology, the architecture, and the entire process of data vault.  developing the standards so that if you follow them, you can avoid the pit-falls, the holes in the road, and all the problems and issues that come with building an enterprise class data warehouse.

i’ve spent the last 16 years (2000-2016) designing, and proving (over and over again) at many many customer sites that what i teach, as well as implement,  works.  again: if you follow the standards.

i’ve seen solutions where standards have been broken, and customers complain – inevitably because the “patch” the “fix” the “change away from the standards” have fallen apart, force re-engineering, force the customer to say: the “data vault” is broken, when in fact, it’s their deviation from the standards that caused the issue to begin with.

i’ve said it before, i’ll say it again:

if you aren’t following the standards of the data vault, then please don’t call it a data vault and — run the risk of re-engineering down the road!!!

where does that leave us?

the “owness” or responsibility, of adapting the standards, making changes does rest on all of us.  we should challenge standards in order to discover other holes, and move them forward.  of course it’s where innovation happens.  but i say again: the responsibility to prove that the changes to the standards work (in unconditional format – across a multitude of problem spaces) lies with the individual suggesting that the standards be changed.

it is not “bullocks”, or hogwash to propose a change, it is hogwash to assume that the change (without proper testing and vetting) is to be “automatically acceptable” across the board by all customers and all clients.  this is where the rubber hits the road.  this is where lazy and irresponsible developers either grow up and become valuable contributors to the innovation stream, or they disappear – never to be heard from again.

but to think: “just because person x says it’s good – so therefore it should change the standard in data vault” is not the right approach.  not now, not today, not tomorrow, not ever.

if we could accept blanket statements without backing / testing, then we wouldn’t need “development”, “test”, and “production” environments in our daily work-place.  we would simply do everything in production all the once again, i implore you (everyone in the community) – do not simply follow like lemmings, those who claim that the “standard should change by consensus” – without proper testing, vetting and proof that the changes actually work.  i am suggesting, an impact study be done.

don’t just take my word for it, read something about why standards are important to different facets of live.  in my next blog (and hopefully my last one on standards) i will address “how to change standards, how to innovate” going forward.

some background:

standards are published documents that establish specifications and procedures designed to ensure the reliability of the materials, products, methods, and/or services people use every day. standards address a range of issues, including but not limited to various protocols that help ensure product functionality and compatibility, facilitate interoperability and support consumer safety and public health.

why are they important?
standards form the fundamental building blocks for product development by establishing consistent protocols that can be universally understood and adopted. this helps fuel compatibility and interoperability and simplifies product development, and speeds time-to-market. standards also make it easier to understand and compare competing products. as standards are globally adopted and applied in many markets, they also fuel international trade.

it is only through the use of standards that the requirements of interconnectivity and interoperability can be assured. it is only through the application of standards that the credibility of new products and new markets can be verified. in summary standards fuel the development and implementation of technologies that influence and transform the way we live, work and communicate.


standards provide people and organizations with a basis for mutual understanding, and are used as tools to facilitate communication, measurement, commerce and manufacturing.

standards are everywhere and play an important role in the economy, by:

  • facilitating business interactio
  • enabling companies to comply with relevant laws and regulations
  • speeding up the introduction of innovative products to market
  • providing interoperability between new and existing products, services and processes.

and more:

standards have been in existence for many years. at one time they were thought of as being the lowest common denominator, restrictive, and of little importance. that has changed.  today, standards are recognized as being
essential to helping companies be innovative, reduce costs, improve quality and maintain competitiveness in an international marketplace.

thank-you kindly for your understanding,
(c) copyright 2016-2017, dan linstedt, all rights reserved.

Tags: , , , ,

No comments yet.

Leave a Reply