Tag Archives: data scrubbing

35 Ways Data Go Bad

When you take your first statistics class, your professor will be a kind person who cares about your mental well-being. OK, maybe not, but what the professor won’t do is give you real-world data sets. The data may represent things … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , , , , , , , | 2 Comments

The Most Important Statistical Assumptions

Posted in Uncategorized | Tagged , , | 3 Comments

WHAT TO LOOK FOR IN DATA – PART 1

Some activities are instinctive. A baby doesn’t need to be taught how to suckle. Most people can use an escalator, operate an elevator, and open a door instinctively. The same isn’t true of playing a guitar, driving a car, or … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , , | Leave a comment

Posted in Uncategorized | Tagged , , , , | Leave a comment

Aphorisms for Data Analysts

An aphorism is a pithy saying that reveals some astute observation or popular notion, whether true or fictitious. “Lies, damn lies, and statistics” you’ve undoubtedly heard. If you’ve taken Stats 101, you probably know that “correlation doesn’t imply causation.” Here … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , , , , , , | 1 Comment

Ten Tactics used in the War on Error

Scientists and other theory-driven data analysts focus on eliminating bias and maximizing accuracy so they can find trends and patterns in their data. That’s necessary for any type of data analysis. For statisticians, though, the real enemy in the battle … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , , , , , , , | 3 Comments

Six Misconceptions about Statistics You May Get From Stats 101

When you learn new things, you can develop misconceptions. Maybe it’s the result of something you didn’t understand correctly. Maybe it’s the way the instructor explains something. Or maybe, it’s something unspoken, something you assume or infer from what was … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , , , , , , , , , | 10 Comments

Dealing with Dilemmas

A decade or so ago, I always feared and was the frequent victim of hardware and software problems. It was a logical consequence of a craftsman routinely pushing his tools way beyond the limits of their capabilities. But the software … Continue reading

Posted in Uncategorized | Tagged , , , , , , , , | 4 Comments

The Data Scrub

Garbage in, garbage out is a saying that dates back to the early days of computers but is still true today, perhaps even more so. If the numbers you use in a statistical analysis are incorrect (garbage), so too will … Continue reading

Posted in Uncategorized | Tagged , , , , , , | 15 Comments