Making Data Work For You: 6 Steps To Limit Bias In Your Big Data

Making Data Work For You: 6 Steps To Limit Bias In Your Big Data
Making Data Work For You: 6 Steps To Limit Bias In Your Big Data

You can’t succeed in business today without the use of big data. In fact, I’ve long been a believer that data-backed decisions are essential for effective digital transformation. Not only does data help you learn a lot more about your customers—often in real-time—it can also help speed up otherwise slow and taxing approval processes. Together, that creates a better customer experience as you’re able to deliver more of what your customers want when they want it.

Yes, there are always some resistors. Many legacy hangers-on refuse to believe that data could ever replace their experienced gut in terms of projecting sales trends and customer demands. But one group of people we don’t usually talk about is the data opportunists—those who use data to back a decision they’ve already made. And believe me, that’s a big problem.

We’ve all seen how scientists can aim their experiments toward specific results simply by strategically orchestrating the audience they choose or the questions they ask them. The same goes for big data. In this transitionary period between legacy and revolution, it can be tempting to use our gut to make a decision and set up data streams we know can prove it. That’s not only short-sighted, it’s setting your company up for a lot of lost time and revenue. So how do you prevent the human tendency to “use” data to their advantage? Consider the following.

KNOW YOUR PURPOSE. What are you trying to solve or prove or find an answer for? Hint: it isn’t to prove how right you are about your industry! It’s to find the best solution to the problem you’re trying to solve, be it a new product or an improvement to customer service delivery. There’s no time for ego in purpose. Use the purpose you establish to guide your thinking throughout the data gathering process.

If you want to know who to target with your lead gen efforts, think about collecting data on the leads that have converted. If you want to know who to target for online marketing, think about collecting data on who has gone to your website. But don’t let your bias cloud your judgment. You might be surprised to learn who is actually using your brand.

DEVELOP YOUR OWN SCIENTIFIC METHOD. When scientists do experiments, the following specific steps known as the scientific method. What are your fail-safes within your company that ensure people aren’t using data to their advantage? What are the standards you use to ensure that data is always used to further the company’s purpose, rather than an individual team’s agenda? Know these before you put a data plan in place.

KNOW THE RESISTERS. As noted above, not everyone is in favor of data-backed decision making. If you haven’t yet built a data-backed culture, you may already know who your detractors in data-backed decision-making may be. Know them, understand them, and be sure to take their biases and agendas in mind when receiving their data-backed solutions.

It’s important to work with your employees and help them integrate data into their decision-making process. Data is not scary and doesn’t have to be if you take the time to explain it.

CREATE A HYPOTHESIS, BUT DON’T CLING TO IT. Yes, every good scientist starts with a problem and a potential hypothesis they believe will solve it. But the best scientists also admit when their hypothesis was wrong. Whatever you think you know, always be open to accepting otherwise. What’s more, if you’re in a position to create a culture where failure is never penalized, even better. It will go a long way to ensuring people aren’t afraid to admit when their hypothesis is wrong.

Say you own a motorcycle dealership and think that your most likely customers are middle-aged men, but the data shows it’s millennials. Don’t be afraid to admit that the hypothesis was wrong. You should embrace the fact that it was wrong! You just learned something important for your marketing efforts that are going to save you time and money and help your bottom line—who doesn’t like that?

DON’T JUMP TO CONCLUSIONS. Many of us who have been working in certain industries for many years have an inner sense of how things “tend to go” in our market. But rather than jump to those conclusions, or hold them as gospel, consider putting them on the back burner and brainstorm potential ways the situation could play out. Sometimes simply stepping back from the situation—or asking someone with a bit less experience in your lane—might yield some unexpected options.

If data-backed decisions really aren’t your company’s thing, consider outsourcing the process to another agency. In this age of Everything as a Service (XaaS), you can always rely on an outside source to put together a hypothesis, determine the right questions to ask to test it, and feed you the least biased results.

ACCEPT THE ANSWERS. Well—usually. While I do love big data, I know there is no substitute for good old-fashioned common sense. If the data really doesn’t fit, question it. Ask deeper questions. It’s possible the hypothesis was wrong, and it’s also possible the data wasn’t pulled correctly, or the correct data wasn’t pulled at all. In short: read the report. Understand how the answer was developed. The second pair of eyes never hurts anyone. Also, be sure to pay attention to the possibility of data bias. That can definitely impact the results you get.

Big data is only getting bigger, and there will always be a tendency for humans to err on the side of ego, rather than an algorithm. Now is the time to recognize where in your organization you are at risk for using data to support your already-made decisions—and to use some of the tips to turn that ship around.

originally posted on Forbes.com by Daniel Newman