suum-exse / roadmap / our own models

1M to 1T. Ten times bigger, seven times over.

Each step is ten times the last, and each one has to earn the next. Pick a step to see where it stands.

Updated 13 Nov 2026

Research models. They don’t power suum-exse. suum-exse runs on proven open models until one of ours beats them on real tasks. Only then does it take over.

Overall Step 3 of 7
  1. 1M Done , 100% done
  2. 10M Done , 100% done
  3. 100M Training , 15% done
  4. 1B Next , 0% done
  5. 10B Planned , 0% done
  6. 100B Planned , 0% done
  7. 1T Planned , 0% done

Done Step 2 of 7

10M parameters

Progress100%

Done. Results are in the Build log.

Parameters
10,000,000
Started
11 Nov 2026
Finished
12 Nov 2026
Hardware
NVIDIA GeForce GTX 1070 [8 GB VRAM] · GPU training
Trained on · text
TinyStories · 437,380 complete cleaned training stories · 389,555,204 characters
Trained on · tokens
99,999,744 training tokens
Vocabulary
4,096 tokens (byte-level BPE, including
Weights
Open (on request)

What it’s for

Continue short stories from a prompt and compare MK2 with MK1 in the browser.

To earn the next step

Beat MK1 on our shared tests for text prediction, plot continuity, repetition, and story endings.

Latest note · 12 Nov 2026

MK2 trained from scratch with 10,026,112 parameters in 54 minutes. On the same 200 reserved stories, prediction loss fell from 1.626 bits per byte for MK1 to 0.502 for MK2, a 69% reduction. On 50 fresh openings, MK2 reached its end-of-story signal within the length limit 44 times, compared with 32 for MK1. Some continuations still repeated phrases or lost track of plot details.

← 1M 100M →

How to read this. Only the step we’re on has dates. Later steps depend on what the one before teaches us, so they’re planned, not promised. News lands in the Build log first. Members get training notes and early builds in the Lab: join the Community.