A typical set of strategies and rules for designing strong, cost-effective, and scalable knowledge fashions for the postmodern knowledge stack.
Over the previous few years, multi-dimensional knowledge modeling has slowly develop into a factor of the previous because the Trendy Knowledge Stack (MDS) launched new patterns and requirements for transferring, reworking, and manipulating knowledge. As an alternative, knowledge groups have been layering on high of One-Large-Tables (OBT) and dbt fashions to deal with new use circumstances. Nonetheless, these approaches have led to the unlucky state of affairs the place knowledge groups have develop into value facilities with unscalable processes. So, as we enter the “post-modern” knowledge stack period, looking for to scale back prices, streamline knowledge platforms, and curb mannequin sprawl, knowledge modeling is making a comeback.
This transition presents knowledge groups with a dilemma: Do they return to inflexible knowledge modeling approaches outlined many years in the past for a wholly completely different knowledge ecosystem, or can they carry in new rules outlined based mostly on right this moment’s know-how and enterprise issues?
I imagine that for many corporations, the best reply is someplace in between. On this article, I’ll describe a set of knowledge modeling requirements.
