suum-exse / roadmap / our own models

1M to 1T. Ten times bigger, seven times over.

Each step is ten times the last, and each one has to earn the next. Pick a step to see where it stands.

Updated 13 Nov 2026

Research models. They don’t power suum-exse. suum-exse runs on proven open models until one of ours beats them on real tasks. Only then does it take over.

Overall Step 3 of 7
  1. 1M Done , 100% done
  2. 10M Done , 100% done
  3. 100M Training , 15% done
  4. 1B Next , 0% done
  5. 10B Planned , 0% done
  6. 100B Planned , 0% done
  7. 1T Planned , 0% done

Training Step 3 of 7

100M parameters

Progress15%

Of the training run.

Parameters
100,000,000
Started
12 Nov 2026
Finished
TBD
Hardware
NVIDIA GeForce GTX 1070 [8 GB VRAM] · GPU training
Trained on · text
FineWeb-Edu · 128,892 complete English web documents
Trained on · tokens
124,857,600 pretraining tokens
Vocabulary
16,384 tokens (byte-level BPE)
Weights
Open (on request)

What it’s for

Answer simple questions, follow short instructions, and use details from earlier turns in text chat.

To earn the next step

Answer basic questions, follow a requested format, and recall a new detail across two turns.

Latest note · 13 Nov 2026

Mark III has 101,480,256 parameters. Held-out loss fell from 5.32 nats at 10M pretraining tokens to 4.02 at 124,857,600 tokens on the same 16,384-token validation set. The model at it's 10M training token checkpoint was not passing our "basic questions and recall" test. The current pretraining run is in progress.

← 10M 1B →

How to read this. Only the step we’re on has dates. Later steps depend on what the one before teaches us, so they’re planned, not promised. News lands in the Build log first. Members get training notes and early builds in the Lab: join the Community.