WebGL Animation: Spinning Docdecahedron with Electrons in Electric Fields Normal to Faces
Another WebGL Experiment.
Category: Uncategorized
WebGL Visualization of Transformer Model (Experimental)
Transformer Model 3D Visualization Click and drag to rotate Scroll to zoom The Blue block is the Input Embeddings, the Red Blocks are Attention Heads, The Large Green Block is the Hidden Feed Forward Network and the Little Green Block is the Feed Forward Network Output.
Reducing LLM Training Dimensions Through Definition-Specific Token Encoding
Abstract This paper proposes a novel approach to reducing the dimensional complexity of Large Language Model (LLM) training by introducing a definition-specific byte encoding system that disambiguates word meanings during the tokenization phase. By attaching a single byte that maps to specific Oxford English Dictionary definitions, we can potentially reduce the embedding dimensions required for
RAG Hybrid Keyword and Context Retrieval
RAG (Retrieval Augmented Generation) is a developing technology for using embedding models to search documents for context based on an embedding generated from the user query. There are problems with the current methods, including loss of contextual information and failure to find relevant information. To circumvent these difficulties, a hybrid keyword search and contextual search
Notes on Magnetic Levitation
This is a stub to keep a link to the interestingengineering.com‘s article on spinning magnet levitation: “Physicists have deciphered the underlying physics of a perplexing “magnet levitation” phenomenon first reported by a Turkish researcher in 2021. The phenomenon involves the levitation of a nearby magnet caused by the fast rotation of another magnet, which challenges
Fan Filtration System for VOCs
Particulate and VOC Capture system concept(s): ## Components: ## Coating Process: ## Operational Considerations: ## Safety Measures: ## Potential Enhancements: ## Disposal/Recycling:
Electrici-Tree: Trees as Electrical Systems
Have you ever considered a tree as an electrical system? Certainly there are some insights to be gained by doing so… Check out these related Links! Query 1: Let’s consider plant biology, specifically the electrical properties of living plant cells. Plant cells contain a cell wall, which is a dielectric medium, and interior to this
Protected: Research on Electrostatic Induction in a Dielectric Material for Filtration of VOCs and Carbon Black
There is no excerpt because this is a protected post.
Spectroscopy of Plastic Polymers (Research Notes)
This article is a simple set of notes and links for some research into the practicality of spectroscopy methods for use with plastic polymers. “Polycarbonates contain several phenyl-based molecular groups, which are very energy-rich due to the π electrons of the double bond in the ring. In fluorescence, electrons can be lifted into higher energetic
Oxford Bot – A Document Corpus LLM Chat Bot
So I decided to create a variant of the SparkOne Bot, using the same client side android application modifying it only slightly to include the necessary changes to switch from using a locally run transformer model to a locally run quantized Llama3 model. This is a screenshot from the client side Application. It features text