What's in your pretraining corpus

My top book recommendations: Lexicon (Max Barry) and Permutation City (Greg Egan). I would love to hear about yours!

Currently reading:

• On the Conflation and Hierarchy of Rights
• The Grrl Genius Guide to Life
• Speaker for the Dead (Orson Scott Card)

Want to read:

• Wuthering Heights
• The Path to Power (Robert A Caro)
• Backwardness (Garielle Lutz)
• Tomorrow ^3

Want to want to read:

• 17776

Books that are / were / are important to me - if you wanted to train a Gloria LLM you’d include these in your pretraining corpus: (these are listed roughly in the order that I read them)

• Ender’s Game
• Heft (Liz Moore)
• Surely You’re Joking, Mr. Feynman!
• Harry Potter and the Methods of Rationality
• The Charisma Myth
• The Inner Game of Tennis
• Elon Musk (Walter Isaacson)
• (Albert’s) Molecular Biology of the Cell
• Incerto (Nassim Nicholas Taleb)
• Le Petit Prince
• Drawing on the Right Side of the Brain
• Nonviolent Communication
• Lexicon (Max Barry)
• Permutation City

Midtraining corpus:

• Speaker for the Dead