The Data Scientist's Odyssey

The organized chaos of all things data science, machine learning, and social science


Probability

Markov Chains: The Building Block to Key Stochastic Processes. You Need To Know This!!

An introduction with code examples of the key stochastic process behind reinforement learning, stock market price movements, and atomic movement

Continue reading…

Probability Fundamentals You Need To Know: Getting Up To Speed In One Article!

What do you do when you have forgotten the fundamentals of probability or when you have never had a formal education? In this article, I hope to bring you up to speed with the basic foundations required to study intermediate and advanced parts of probability theory. I hope that this will also serve as a useful reference article for those who are rusty or had a spotty education in the topic.

Continue reading…

Multiple Random Variables: Marginal, Joint, and Conditional Distributions

An introduction to the fundamental mathematical objects in the analysis of multiple random variables with Python examples

Continue reading…


Reinforcement Learning

Markov Decision Processes - The Framework For Decision-Making Under Uncertainty

Markov Decision Processes are the essential process which we use in dynamic programming and thus reinforcement learning problems. It is an extension of Markov chains and provides the theoretical backbone for training an AI agent under iterative environments and rewards based off of decisions.

Continue reading…

K-Armed Bandits: The Canonical RL Problem

The main toy problem behind reinforcement learning

Continue reading…

What is Reinforcement Learning?

Key RL concepts and history

Continue reading…

See All…
About
Hello! Names Eddie. I finished my PhD in experimental fusion physics in 2019 and have been working as an operations research scientist for a few years. I enjoy all things science and hope to understand my world better by reading the best sources and summarizing the information to the best of my ability for all to enjoy. I hope you enjoy my blog!