An eye-catching headline or something similar limps across a social media feed--not unlike a wounded animal in the wild--the eye is drawn.
In this recent instance, it was the claim that 60% of healthcare executives say they use predictive analytics. Clearly the headline referred to this recent report from the society of actuaries--2019 Predictive Analytics in Health Care Trend Forecast.
I have "0" familiarity with the Society of Actuaries but I loosely know what their professional responsibilities include.
Wikipedia defines an actuary as "a business professional who deals with the measurement and management of risk and uncertainty".
Full disclosure, I have not seen the survey and for all I know some of these practices were implemented under the hood but if they were--why not say so?
Define what you are measuring. How do you know if predictive analytics are being used in your organization if you aren't presented with a baseline definition of predictive analytics or how you would like respondents to consider whether it is being used or not and in what capacity?
Report the raw numbers. When percentages are reported without accompanying numerators and denominators how are we to evaluate the ability to extrapolate the findings to the real world. Perhaps this only applies to the 201* respondents to the survey. How many received the survey? If it was sent to 20,000 health payers and provider executives how reflective are the findings of this single survey to the larger group?
*stated on last page of report--100 health payer executives and 101 health provider executives were interviewed.
What is a health provider executive? I know what I think they are. Are they defined the same way across organizations?
How are they using the predictive analytics and are they comparable across organizations? What exactly are they trying to predict? Employee retention? Per member per month (PMPM) capitation payments?
Save their organization what?
Who are these organizations that are saying no to predictive analytics? Isn't that the foundational algorithm embedded in healthcare outcomes forecasting?
In the absence of a workable definition of predictive analytics presented to the respondents--what can we say for certain?
At first glance I would also make an assumption that the "actual results overall" are negative? Why? The color choice. Red in a chart can be misinterpreted because we all arrive at graphicacy with our own perceptions and biases.
If the future of predictive capabilities question yielded "Data visualization at 23% what are you all looking at now?
Ranking questions can yield probabilities but any other format would be reporting descriptive statistics only.
My point isn't too blame but to demonstrate how we can all do better--myself included.
We need to slow down and take the time to make sure that we aren't introducing unsolvable paradoxes with our own data collection.
After all, when an unstoppable force meets an immovable object, the laws of physics are quite boring. Don't let your survey become a black hole...