Reference

A new creator, from nothing

The whole path for someone who is not Dr K or Huberman, as a checklist. It assumes the machine is set up and ./alive check only complains about models. Pick an id for them, short and lowercase; below it is <id>.

Where your time goes

0 h6121824 h download answers+20 min of yours voice+3 stops: threshold, listen, pick face clipsone video tracked: 10-20 h, unattended+3 looks motion+2 looks render+2 looks
About a day with one tracked video; each further tracked video adds 10-20 hours. The orange notes are where the build stops for you. Answers and voice can be done while you wait for tracking, but the build runs the stages in order so they never share the card.

The checklist

1 · Choose the videos

2 · Create the files that describe them

creators/_template/→ creators/<id>/ voice: .../text-to-voice/profiles/→ profiles/<id>.py clips: .../face-clips/profiles/→ profiles/<id>.py motion: .../audio-to-mesh/profiles/→ profiles/<id>.py render: .../mesh-to-render/profiles/→ profiles/<id>.py answers: .../harness/creators/_template/→ data/answers/<id>/creator.md live.env, build.json name, takes, held-out video name; numbers read later name, video → soundtrack same name; reads the rest filled in at step 4 Use the same id everywhere and nothing has to be cross-referenced. Every template says, beside each value, what it is and how to fill it. Values marked as read from a tool are left alone until that tool has run.

In each recipe's folder, copy _template.py to <id>.py. The full folders:

stageprofiles folder
voiceengines/text2audio/blocks/voice/recipes/text-to-voice/profiles/
face clipsengines/audio2face/corpus/recipes/face-clips/profiles/
motionengines/audio2face/rigfit/recipes/audio-to-mesh/profiles/
renderengines/audio2face/gauss/recipes/mesh-to-render/profiles/
answers (persona note)engines/knowledge_style/proto/harness/creators/_template/creator.md → data/answers/<id>/creator.md

In creators/<id>/build.json: the YouTube ids under videos.ids, the face video's id under clips.takes, and the profile names (your id) for each stage.

3 · Download

./alive down
./alive build <id> --stage videos

Puts each video, its sound and its subtitles in data/takes/<id>/.

4 · Answers

./alive build <id> --stage answers

It stops asking for the persona note. Write it as on the answers page (its last step, trying it out, waits until the app runs), then run the same command again.

5 · Everything else

./alive build <id>

Run it, and each time it stops, it says what to look at. Make the decision, record it where it says (each stage page has a Where the decisions are kept table), and run the same command again. In order, the stops are:

stageyou
voiceread the speaker table and set the threshold; listen to the reference clip; pick the saved step
face clipsread the derived numbers into the profile; label each group of frames; watch a few chunks; check the mesh overlays
motionlook at their rig beside the stock face; look at the timing sheet; promote, writing what is wrong
renderlook at the mesh-on-photo sheet and the two-second clip; promote, writing what is wrong

6 · Live

  1. Fill in creators/<id>/live.env: the template names every value. Leave REST empty for now. WPS, their speaking rate, comes from the voice training set:
    python3 -c "import json;r=[json.loads(l) for l in open('data/voice/dataset/<id>/train/manifest.jsonl')];print(sum(x['n_words'] for x in r)/sum(x['seconds'] for x in r))"
  2. ./alive check <id> until nothing is missing.
  3. ./alive up <id>, then pick the resting pose and set REST.
  4. Ask the example questions, and the three persona-note test questions. Listen and watch.
Before you put it in front of anyoneGet the creator's permission. The page labels everything as AI-generated; keep that label.

If a stage comes out worse than for Dr K or Huberman

Every recipe's profile separates values measured on this person from values carried over from Dr K. The carried ones are the first place to look. Each RECIPE.md has a section, What did not generalise, listing what changed between the first creator and the second; a third will find more. Add what you find there.