Data Scientist Dad

Jun 4

Break through the Excel Ceiling

Part One Very often people use Excel worksheets without thinking too much about what they are doing. Excel can be so intuitive, and even powerful and yet they don’t go further than just using the legacy spreadsheets that they are given at work. If people invest just a little more time in…

Excel

7 min read

May 27

Data Quality over Quantity

Why and how in a world of Big Data you have to remain sane and not collect every datum that you possibly can. — The technology, storage capacity and computing power behind Big Data might seem like it spells the end of statistics as we know it. An entire population could be explored and defined to the point that we don’t need to sample. At the very least, the t-statistic might fall into disuse…

Tesla

5 min read

Mar 10

Bots That Make Money While You 😴 : What are the Most Popular Types?

If you have been writing code for a little while, you start to notice how powerful it is. Suddenly it seems like you can create entire self-sufficient systems from simple digits. Your properly written algorithms will be executed with little supervision and they never, ever get tired. It is at…

Statistics

5 min read

Bots That Make Money While You 😴 : What are the Most Popular Types?

Mar 9

Try Trimmed Mean for a Beautiful Body (of Data)

Measures of central tendency can be thought of as a tool box. The mean serves a purpose as our first, best guess of what an average value for a variable looks like. You sum the observations and divide by the number of those observations. However, if you have very high…

Statistics

4 min read

Try Trimmed Mean for a Beautiful Body (of Data)

Mar 7

The O’Brien-Fleming Boundary: Interim Checks of Experiment Design, Part 2

How O’Brien-Fleming deviates from Pocock blocking and effectively stops an experiment to save time, money and possibly lives. — Experiment design and analysis is an interesting career avenue for the aspiring statistician/programmer. If you can construct a sound hypothesis test, then you can simultaneously help people and earn cash. Experiments can be complex and costly. If a research institution staff can save money by stopping a test when the…

Statistics

4 min read

The O’Brien-Fleming Boundary: Interim Checks of Experiment Design, Part 2

Mar 6

Pocock Blocked: Interim Checks of Experiment Design, Part 1

Experiment design and analysis is something you can do as a programmer that helps people and simultaneously makes you money. Academic institutions and think tanks need help with statistical analysis, and their in-house statistics organization may not be enough. …

Statistics

4 min read

Pocock Blocked: Interim Checks of Experiment Design, Part 1

Feb 21

Where to Look for Your Best, Most Happiest Data Science Job

The good guys that need Data Scientists in 2022

Data Science

6 min read

Feb 20

What to Do with Too Much Qualitative Data

Qualitative variables involve nonnumerical observations such as nationality and name. Sometimes they are referred to as cateogorical variables. Certain domains and studies lend themselves to being prone to qualitative data collection. Behaviors, motives, incentives and opinions are all things that not easily quantified without some artifice and effort. Nor should…

Statistics

4 min read

What to Do with Too Much Qualitative Data

Feb 19

Swimming in the Data Lake

During this age of inexpensive storage, terms like “data lake” and “data warehouse” get thrown around as if everyone clearly gets what they must be. The names are intuitive and have certain connotations, but how they are properly used is not always well understood. They aren’t just places to archive…

Statistics

4 min read

Feb 19

How I Learned Data Science at 50

As a younger man, my professional life revolved around political science and international affairs for many years. I enjoyed it immensely. I read quite a bit. I traveled quite a bit too (an example is all the former Soviet republics except Belarus for some reason). However, when family life demanded…

Data Science

6 min read