Have you ever imagined a world where transactional systems were able to focus solely on the tasks they were built to complete? Have you ever…
Data warehouses and modern cloud architectures go together better than chocolate and peanut butter. The “abilities” (scalability, flexibility, reliability, etc.) of the cloud allows one…
Traditional data warehouses were often created as custom reporting data structures using on-site servers. These on-prem servers need to have a team of DBAs, storage…
In my previous Operational Data Store (ODS) blog, we discussed how to design an ODS. In this post, I will describe how to optimize the…
Operational Data Stores (ODS) are entity-centric and should only contain data about that specific entity. When designing an ODS, you will use relational database design…
An Operational Data Store (ODS) is a powerful tool to help provide any company or organization operational reports with up-to-date 360-degree views of any and…
The definition of an Operational Data Store (ODS) is a subject-oriented, integrated, volatile collection of current data designed to support the tactical decision-making of an…
The three keys to warehouse project success are to quickly, efficiently and consistently refresh the data in the warehouse. Here are four ways to design…
You often hear “drilling down” and “drilling across” from business intelligence professionals, but what does it mean and how do you, as a data modeler,…
I was recently tasked with loading a lot of historical json files into a database. I wanted to use KNIME to create a repeatable workflow…
I recently came across a situation where I needed to load a couple of table partitions. I wanted to automate this process and have a…
You will inevitably come across a time when a source system will allow the updating of transaction records. This drives data modelers, ETL developers, analytics…
In my last post I discussed late arriving facts, and although it is slightly annoying to receive delayed transaction data, the impact on the ETL…
Yesterday I had to import an XML file into a series of relational database tables. I started by thinking of the best way to import…
Late arriving facts are those transactions which are delayed in arriving to the warehouse. For Type I data warehouses there is no real impact but…
The Postgres COPY command is the most efficient way to load CSV data into a Postgres database. RDS provides a small challenge to the use…
KNIME workflows can contain a lot of code and, like all good programmers, I always want to eliminate as many code changes as possible. To…
Factless facts are those fact tables that have no measures associated with the transaction. Factless facts are a simple collection of dimensional keys which define…
We have all come across times when our customer wants to know how the organization is currently doing. They often want to know how they…
Often management looks for bottlenecks in corporate processes so that they can be streamlined or used as a measurement of success for the organization. In…