Multi-Agent Coordination and Path-Finding through Stigmergy
For my undergraduate thesis, I devised a distributed, hierarhical method for multi-agent path-finding with environment modification. This work was inspired by how ants coordinate in a decentralized manner through pheromones.
Fully Online Decision Transformer
A friend and I collaborated in adapting an offline RL algorithm for online contexts that leveraged the powerful representation capabilities of the transformer architecture. Was a fun one that yielded pretty good results.
Machine Learning for Image Reconstruction
Super random, fun personal project that taught an machine learning algorithm to automatically reconstruct any given image using MS paint. COVID-19 and boredom can really do a lot sometimes.
Bayesian Conservative Reinforcement Learning
A group of friends and I collaborated on a class project centered around designing an RL agent that optimized for its worst-case scenarios. Instead of optimizing for its average utility, it conservatively optimized its bottom percentile loss.
End-to-End RL for Adversarial Text Generation
We designed an ML agent that could take input texts and could ideally fool state-of-the-art classification models by using RL-based word swap methods.
Graph Neural Networks for Register Allocation
We formulated a way to use graph neural networks (GNN) to address the register allocation problem: mapping virtual registers to physical registers in compiler systems. I admittedly worked on the compiler side of this project. My peers did a fantastic job designing an ML algorithm to address the problem.
