Study: Untamed analytics will take your business on a wild ride

Companies need a governance strategy to check their predictive models are not based on faulty or outdated assumptions

Predictive analytics can speed up business decisions and create a competitive advantage, but the models need better governance to avoid having some predictions turn into business fiascos, according to research supported by the Society for Information Management’s Advanced Practices Council.

Data science is a nascent field where organizations are trying to find the best governance approach to mitigate the risks of analytics failures, according to the research paper by academic Michael Goul. The paper is titled “Taming the Wild West of Predictive Analytics and Business Intelligence.”

For all the good that data analytics can do, the models can also “go awry, resulting in unintended consequences,” if the underlying assumptions are faulty or become outdated, the report says. Analytics can also produce business results that are controversial or run afoul of legalities, such as anti-discrimination laws.

The report summarizes the emerging best practices for governance at various organizations, including Adidas, American Express and State Farm Insurance. “State Farm established a testing culture in which analytic solutions are assessed to determine whether they are performing as designed and promoted,” the report says. “A testing team comprised of a business partner, a statistical designer, an execution specialist, and a structural and creative design expert” run controlled A/B experiments to evaluate the performance of analytics applications.

To continue reading this article register now

Join the discussion
Be the first to comment on this article. Our Commenting Policies