Saran Ahluwalia

Saran Ahluwalia

My primary interests are in applying statistical learning, graphical models and unsupervised machine learning in service of - amongst others - healthcare services, quantitative finance and real estate economics. I hope to continue to marry my prior experience with my passion for the democratization of knowledge through open source development

Sutton and Barto Part 2

less than 1 minute read

Published:

I am currently reading Sutton and Barto (reference below). Along the way I decided to recreate certain experiments cited in each book chapter. This particular example includes the example from Figure 6.2.

I have added a notebook of the experiments:

Temporal Difference Learning with Batch Updates

Plots are here.

  1. Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction. A Bradford Book, Cambridge, MA, USA.

You May Also Enjoy

Derivation of Support Vector Machines

less than 1 minute read

Published:

Recently, I am experimenting with different mechanisms for deriving decision functions for multiclass classification problems. I have spent some time reading and experiementing with examples from the following references:

Natural Language Processing with Deep Learning

less than 1 minute read

Published:

I recently completed Stanford’s course on natural language processing. This course opened my eyes to different representaions of speech and linguistics.