A F500 firm's ecommerce analytics group was building scorecards to drive product marketing decisions based on inputs from over 150 third party data sources. There were no data dictionaries, quality checks or test automation in place, and a single error in one KPI could result in a significant negative impact on the business. The stakes were high.