1. A project finetuning an LLM on trippy mathematical reasoning (using RTX 2080 cards); 2. Research showing that bidirectional and autoregressive training induces symmetric and directional self-attention matrices, which can be leveraged for performance improvements; 3. Programming mixed-signal devices on-chip with feedback control.
Research Experience
1. Experiments with LLMs; 2. Works on 'efficient and exotic hardware' that implements neural computations using analog circuits; 3. Developed a novel feedback control algorithm for on-chip training of mixed-signal neuromorphic chips in 2024.
Education
PhD in Neuroinformatics with a thesis on synaptic plasticity and predictive processes in biological and artificial networks.
Background
A research scientist in Machine Learning and Neuromorphic Computing. Fascinated by life and intelligence, enjoys studying complex systems. Loves to play music and dance.
Miscellany
Values human connections and open communication, sees himself as a human being going through life with the help of these.