Projects

Here are some projects I have worked on.

	Morse Code Transformer I implemented the transformer architecture from scratch. I trained two LLMs, one on english characters and another on morse encoded english characters. I found that increasing ONLY the context length proportionally yielded similar performance between the morse code and english LLM. github
	Multi-Implicit Chain of Thought Reasoning via Knowledge Distillation I expanded upon a paper by training the LLM to perform simultaneous 2x2 inference using the same knowledge distillation process all packaged up in a nice and easy to use notebook. github
	ChatGPT vs Keyword ML I trained a NN, RNN and GBM to predict amazon review scores from keywords and compared to ChatGPT using the openAI API. The results demonstrated that ChatGPT understands context by significantly outperforming traditional keyword models in binary score prediction. github
	Zoomerified Java Code Compiler This is just a silly project I did for a course. I created a Java program that emulates a compiler. The emulated compiler takes in "Zoomerfied" Java structured code and parses, compiles and runs its translated java program. github