On periodic distributed representations using Fourier embeddings

Tech Report, 2026

Jakeb Chouinard

Abstract

Periodic signals are critical for representing physical and perceptual phenomena. Scalar, real angular measures, e.g., radians and degrees, result in difficulty processing and distinguishing nearby angles, especially when their absolute difference exceeds 𝜋. We can avoid this problem by using real-valued, periodic embeddings in high-dimensional space. These representations also allow us to control the nature of their dot product similarities, allowing us to construct a variety of different kernel shapes. In this work, we aim of highlight how these representations can be constructed and focus on the formalization of Dirichlet and periodic Gaussian kernels using the neurally-plausible representation scheme of Spatial Semantic Pointers

Full text links

 PDF

 DOI

 arXiv

CTN Tech Report

Month
05
Institution
Centre for Theoretical Neuroscience
Address
Waterloo, ON
Issn
CTN-TR-20260508-002
Doi
https://doi.org/10.48550/arXiv.2605.10818
Arxiv
2605.10818

Cite

Plain text

BibTeX