ABC: Attention with Bounded-Memory Control

Keyphrases

• Memory Control 100%
• Bounded Memory 100%
• Sequence Length 33%
• Memory Size 33%
• Efficient Attention 33%
• Long Sequence 16%
• Attention Mechanism 16%
• Token 16%
• Control Approach 16%
• Processing Task 16%
• Machine Translation 16%
• Computation Overhead 16%
• Quadratic Complexity 16%
• Inference Time 16%
• Language Modeling 16%
• Natural Language Processing 16%
• Time Efficiency 16%
• Transformer 16%
• Masked Language Model 16%
• Space Efficiency 16%
• Transformer Architecture 16%
• Accuracy Loss 16%
• Causal Attention 16%
• Attention Model 16%
• Inference Space 16%
• Random Access Memory 16%
• Translation Language Models 16%

Computer Science

• Sequence Length 100%
• Language Modeling 100%
• Machine Translation 50%
• Processing Task 50%
• Natural Language Processing 50%
• Attention (Machine Learning) 50%
• Control Approach 50%
• Random Access Memory 50%