Shawn’s Blog

  • Building a Data Quality Management Process that Scales : Data Quality Playbook

    Building a Data Quality Management Process that Scales : Data Quality Playbook

    The system that is proposed here is a repeatable process loop that moves from initial data ingestion to the final staging of data in a trusted layer or data warehouse. The process is made up of four distinct phases with their own milestones and deliverables – in other words, any observer will know when a… Read more

  • Why I’m Devoting the Rest of My Career to the Concept of Data-Driven Organizations

    Why I’m Devoting the Rest of My Career to the Concept of Data-Driven Organizations

    I’m still working on the Data Quality posts. They will happen. I’m in the process of actually implementing this with a client, so this gives me a lot of material to work with. However, I wanted to just drop a quick post to talk about some of my goals for the rest of the year.… Read more

  • Building a Data Quality Management Process that Scales : Data Quality Metrics

    Building a Data Quality Management Process that Scales : Data Quality Metrics

    I recently completed a guide for a client related to creating data quality metrics. It’s an interesting problem to tackle, because you absolutely need to understand what goals you need to achieve as an organization. Without these goals defined, you can make the mistake of either blanketing your data with far too many metrics or… Read more

  • Building a Data Quality Management Process that Scales : Data Quality or Intelligence Quality?

    Building a Data Quality Management Process that Scales : Data Quality or Intelligence Quality?

    How does an organization go about determining data quality? What are the first steps in an overall process to achieve the organizational goals related to data quality? First, before we can answer any of these questions, I think it’s important to agree upon a standard definition of data quality. Wikipedia gives the following definition –… Read more

  • Building a Data Quality Management Process that Scales : The Many Paths to Quality Data

    Building a Data Quality Management Process that Scales : The Many Paths to Quality Data

    This post describes an opinionated method for achieving data quality within a small organization. There are some pre-qualifiers and assumptions made about the data system architecture and the skill set of the team. One of the biggest struggles for organizations that rely on data is to achieve an acceptable level of data quality. Steps are… Read more

  • The Proof of Concept

    The Proof of Concept

    One valuable tool I wish I had realized was at my disposal earlier in my career is the proof of concept. I remember jumping into large projects intent on implementing the latest and greatest library, only to discover that I couldn’t get it to work because I didn’t really grasp how it worked. Having a… Read more