Lancelot Server Homepage

This server hosts some of my research demos. For more about my research, visit my website at aman-bhargava.com.

Research Demos

1. PCA on LLM Token Embedding Layer
2. t-SNE on Falcon 7b Embeddings
3. Exploring Single-Token Prompt Spaces

Datasets

Lisp Math

Accessible at lancelot.languagegame.io/data/{filename}

1. math_0_100.csv
2. math_-100_100_asym.csv
3. math_-100_100.csv
4. math_-10_10.csv

LLM Emotion

github.com/amanb2000/Emo_LLM

"Hola" -- Cayden

1. bob_happy_sad.html
2. 29032024_mean_coefficients_per_layer.html
3. 29032024_grok_output.txt
4. Valence-Arousal Activation Axes -- signal generalizes across prompts! Notebook can be found here: 03292024_Tijuana_Results.ipynb
5. 3d pca visualization over all prompts -- Polarized clustering!!! Results notebook: 03292024_Tijuana_Results.ipynb

Autism Questionnaires

1. 2D PCA on P(answer | prompt + question) with synthetic prompts and Llama-3 8b. Code to reproduce is in autism_questionnaire_20240613.ipynb
2. 3D PCA on the same as above.

LLM Control Theory

• 02_Theorem_Demo_Apr24
• Roger Federer Prompt Engineering Game
• Simple Math Control 20240709 with 100 arithmetic examples.

Principles of Neuroscience

• Parallel Pursuit, the necessity of internal world models.
• Parallel Pursuit II: Boids,
• Boid VI: The Finale

Transformer Block Flows

1. Spiral No Control (Non-PCA Plot)
2. Spiral No Control (PCA Plot)
3. Bee Movie Flows No Control (PCA Plot)
4. Bee Movie Flows No Control (Non-PCA Plot)
5. Bee Movie Flows with Control (Non-PCA Plot)
6. Bee Movie Flows with Control (PCA Plot)
7. Negative Time (Non-PCA Plot)
8. Negative Time (PCA Plot)