Summary
Engineer that specializes in reducing compute. Co-author of SwarmFormer, a fresh transformer-like architecture, and sole developer of autonomous driving models that are optimized for resource-limited hardware.
Technical Skills
Languages/Frameworks
Python
C
TypeScript
NumPy
OpenCL
CUDA
Tools/Platforms
Azure
AWS
PyTorch
Git
Experience
Takara.ai – UK | Frontier Research Team | 2025 – Present
- Pioneered the development of SwarmFormer, revolutionizing efficiency in compute-restricted environments. Spearheaded a high-performance C implementation of SwarmFormer, achieving unprecedented optimization in memory usage and processing speed.
- Executed comprehensive benchmarking and profiling strategies, dramatically enhancing inference efficiency and setting new performance standards.
Publications
SwarmFormer: Local-Global Hierarchical Attention via Swarmed Token Representations (2025)