Here’s a different kind of open model. Hugging Face released Carbon-X on Thursday, a 14 billion parameter model you can talk to about DNA, and it’s small enough to run locally on a laptop. WIRED broke it down.
The quick version
- Built with researchers at Zhongguancun Academy in China and the University of Naples Federico II in Italy.
- They took an existing language model, taught it to read DNA in six-letter chunks, and kept training on about 300 billion tokens mixing DNA sequences, English text and examples linking the two.
- You can ask plain-language questions about how a DNA change might affect gene activity or health. Think “ChatGPT for DNA.”
- It takes sequences of about 50,000 base pairs, so you query small pieces of a genome, not the whole thing.
- They deliberately left viruses out of training to reduce misuse.
- It runs on your own hardware, so no data goes to Hugging Face or anyone else. The team is clear it hasn’t been validated with wet-lab experiments yet.
My take
The local part is the big deal. Medical and genetic data is exactly the stuff you shouldn’t be pasting into somebody’s cloud. A model sized for real hardware, with the privacy built in by design, is the right call. I’d treat any answers as research leads, not diagnosis, until the validation work is done. But this is a great example of why I keep pushing local AI: some data just shouldn’t leave the building.
Have a blessed day! And Happy Hacking!