As I'm working on the backend personal knowledge base portion of my website I am writing a lot of small Unix-style scripts to be executed with Bun. This library has been very nice to quickly and easily have a robust CLI for my scripts even though it's possibly "overkill" for my purposes. This is the best kind of tooling: tooling which makes doing the right thing also the easy thing.
I'm Zachary.
I'm a multidisciplinary problem solver with 20+ years' experience.
This website is where I examine my life, my work, and my learnings.
Notes
This repository is from the same author as the Kokoro one I recently wrote about but instead it is for transcription using OpenAI's open-sourced Whisper model in a browser with GPU acceleration. As usual, impressive work.
I have been using Whisper extensively in my workflow through MacWhisper.
Building personal knowledge bases
This website is a terminal through which to explore the public parts of my personal knowledge base. I intend to do as much of my thinking and learning in the open as possible.
I was excited to see this repository because I was trying out Kokoro in my homelab a few weeks ago as an API service with FastAPI. I really liked the experience and was able to get it working as the TTS voice of the OpenWebUI instance I also run locally.
I especially liked that I was able to generate arbitrary strings of text at speeds consistently far below realtime without using third-party compute: no Internet necessary and importantly no third-parties logging everything I use it for (which as an Autistic person with ADHD is a lot of things).
This repository takes that even further: this can run Kokoro within a browser and using GPU acceleration if available. Although most of my ideas for speech synthesis make best sense outside of a browser environment, it's definitely exciting to see this kind of thing is possible.
When you play around with self-hosting AI models as much as I do you quickly learn that models can be very large downloads. For performance reasons you want to keep them on your fastest storage which is often your smallest storage. So, again like me, you find yourself very low on available space and need to figure out where you can reclaim some.
In the past I've used a macOS app called DaisyDisk for this but I was recently delighted to find this open source TUI tool which is extremely fast and easy to use for exactly this purpose.