Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study

2026-09-05

AI Summary

研究通过XOR折叠减少Tsetlin机器的反馈宽度，解决小型设备上序列推理时的历史保留问题，保持了与直接反馈相近的准确性。

Abstract

Sequential inference on small devices requires a model to retain useful history without repeatedly processing a long input record. A Recurrent Tsetlin Machine (RTM) provides this memory by returning Boolean clause outputs from one time step as inputs to the next. Direct feedback, however, grows with the clause bank and can make the recurrent input unnecessarily wide. This paper investigates a fixed-width alternative. We combine clause activations by exclusive-OR (XOR) folding, retain the folded bits at two time scales, and threshold them back to a binary state. The resulting design reduces 480 clause activations to 96 recurrent bits. We evaluate the method on a reproducible Boolean finite-state-machine benchmark with explicit transition rules, data splits, and random seeds. Across 144 runs, the compressed model obtains $61.47 \pm 6.74\%$ and $62.94 \pm 9.92\%$ accuracy on the two task families. Raw clause feedback changes these means by less than one percentage point, while increasing the recurrent width tenfold and measured host execution time by $4.38\times$ and $3.71\times$. Gated neural models remain more accurate, and a no-feedback control retaining only short input history achieves comparable or slightly higher accuracy. On this benchmark, folding matches raw feedback within small empirical margins at a much narrower interface; these findings also underscore the critical necessity of no-feedback recurrence controls when benchmarking sequence models.

Problem

• Recurrent Tsetlin Machine
• Sequential inference
• Clause feedback
• XOR folding
• Boolean finite-state-machine

Innovation

• XOR folding
• compressed recurrent feedback
• Boolean finite-state-machine
• Tsetlin Machine
• resource-constrained devices