The Data Scientist's Odyssey

The organized chaos of all things data science, machine learning, and social science


Markov Chains: The Building Block to Key Stochastic Processes. You Need To Know This!!

An introduction with code examples of the key stochastic process behind reinforement learning, stock market price movements, and atomic movement

Continue reading…

Probability Fundamentals You Need To Know: Getting Up To Speed In One Article!

What do you do when you have forgotten the fundamentals of probability or when you have never had a formal education? In this article, I hope to bring you up to speed with the basic foundations required to study intermediate and advanced parts of probability theory. I hope that this will also serve as a useful reference article for those who are rusty or had a spotty education in the topic.

Continue reading…

Markov Decision Processes - The Framework For Decision-Making Under Uncertainty

Markov Decision Processes are the essential process which we use in dynamic programming and thus reinforcement learning problems. It is an extension of Markov chains and provides the theoretical backbone for training an AI agent under iterative environments and rewards based off of decisions.

Continue reading…

About
Hello! Names Eddie. I finished my PhD in experimental fusion physics in 2019 and have been working as an operations research scientist for a few years. I enjoy all things science and hope to understand my world better by reading the best sources and summarizing the information to the best of my ability for all to enjoy. I hope you enjoy my blog!