About me
I have recently finished my master’s studies at McGill University and Quebec Artificial Intelligence Institute (MILA), under the supervision of Prof. Doina Precup. My master’s thesis was about reinforcement learning and optimization.
My projects:
Master’s thesis work
SVRG for Policy Evaluation with Few Gradient Evaluations
- Worked on developing sample-efficient first order optimization algorithms for policy evaluation in reinforcement learning.
- Proved linear convergences of proposed methods.
- Conducted experiments and showed proposed methods are more sample-efficient than previous methods, especially in large-data settings.
- Links to code and thesis: here
- Link to paper on Arxiv: here
Machine learning projects
Image classification on hand drawing data
- Designed a conditional random field (CRF) for the task on a small testing dataset. Analyzed why the CRF reaches its optimal performance. Used a residual network to accurately classify images from 340 categories.
- Results: here
- Language used: Python
Reproducing inverse reward design
- Reproduced a Neurips paper, titled “Inverse Reward Design”. Analyzed strengths and weaknesses of the paper. Showed omitted details of the paper in our report.
- Report: here
- Language used: Python
Image Segmentation
- Used Gaussian mixture model and EM algorithm for image segmentation.
- Results: here
- Language used: Matlab
Aggregators in Markov logic networks
- Analyzed how the quality of aggregators relates to prediction accuracies. Developed a Markov logic network that outperforms other baseline methods.
- Results: here
- Language used: Python
Control of dynamic systems using neural networks
- We combined LSTM and DNN, and used it to learn the complex behaviour of model predictive control.
- Code: here
- Report: here
- Language used: Python
Software projects
Course Scheduler
- Used a flow network to solve the scheduling problem. Used promises instead of call backs to handle asynchronous operations. Wrote tests that cover most of the code base.
- Code: here
- Language used: Typescript
Let’s Sell
- This mobile application allows users to sell text books and upass (transist pass for students). Users can add items for sales, search items, save items to their watch lists, and log in by authenticating their social network accounts. This app was on the ios app store for a year.
- Code: here
- Language used: Objective C