suum-exse / roadmap / our own models

1M to 1T. Ten times bigger, seven times over.

Each step is ten times the last, and each one has to earn the next. Pick a step to see where it stands.

Updated 13 Nov 2026

Research models. They don’t power suum-exse. suum-exse runs on proven open models until one of ours beats them on real tasks. Only then does it take over.

Overall Step 3 of 7
  1. 1M Done , 100% done
  2. 10M Done , 100% done
  3. 100M Training , 15% done
  4. 1B Next , 0% done
  5. 10B Planned , 0% done
  6. 100B Planned , 0% done
  7. 1T Planned , 0% done

Done Step 1 of 7

1M parameters

Progress100%

Done. Results are in the Build log.

Parameters
1,000,000
Started
22 Oct 2026
Finished
11 Nov 2026
Hardware
Intel Core i5-6500 @ 3.20 GHz · CPU training
Trained on · text
TinyStories · 3,686 cleaned training stories · 3,122,441 text characters
Trained on · tokens
3,129,813 corpus tokens
Vocabulary
99 tokens (i.e., characters)
Weights
Open (on request)

What it’s for

Prove the pipeline end to end, from preparing TinyStories and training a 1M-parameter model to testing it and generating text in a local browser.

To earn the next step

Complete training, evaluate on reserved stories, verify browser generation, and publish the results in the Build log.

Latest note · 11 Nov 2026

MK1 trained from scratch with 1,005,536 parameters. Validation loss fell from 4.637 to 1.125. Across 200 reserved test stories, final loss was 1.128 and perplexity was 3.09. The saved checkpoint generates story continuations in the browser.

10M →

How to read this. Only the step we’re on has dates. Later steps depend on what the one before teaches us, so they’re planned, not promised. News lands in the Build log first. Members get training notes and early builds in the Lab: join the Community.