BionicGPT - An open source Chat GPT replacement built in Rust

I though I would share a new startup I'm working on. https://github.com/purton-tech/bionicgpt

I hope it gives fellow rustaceans an idea of what it's like to put together a product using Rust.

The main architecture I've written about previously and is documented here https://rust-on-nails.com/

Writing software that works with large language models brings up it's own challenges such as with testing and not being able to get one working in the CI/CD pipeline for testing.

I used \[https://dioxuslabs.com/\] Dioxus for the user interface.

I would have liked to use an LLM built with rust, but they are not their yet. There are some great ML libraries now, but not much support for quantization which is needed for getting models to run locally.

Any questions, just ask.

​