Some projects I have made public

I spend a lot of time working on research, but I also like making smaller projects around the same ideas. They help me test things properly and, most of the time, they make a difficult idea much easier to understand.

Here are a few projects that I have made public on GitHub. Some are closely related to my research and some are just useful things I wanted to build.

RL for HVAC Teaching a controller to keep a home comfortable while responding to changing energy prices. View on GitHub → Hot water control Comparing planning and reinforcement learning for heating water on time while using less energy. View on GitHub → Meeting transcriber A small tool that turns meeting audio into transcripts, notes and action points. View on GitHub → MCTS Tic-Tac-Toe A simple game where you can play against an AI that plans its moves using tree search. View on GitHub →

What connects them?

The energy projects are about making better choices when we do not know exactly what will happen next. The Tic-Tac-Toe project shows the same planning idea in a much smaller and more visual problem.

The meeting transcriber is a bit different. I made it because long supervision meetings can contain a lot of useful details, and it is easy to forget a small action point afterwards. The tool keeps the audio private during transcription, then turns it into notes which are easier to use.

I will keep adding to these repos when I have something useful to share. You can also see the rest of them on my GitHub.