PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation

Keyphrases

• Low-rank Adaptation 100%
• Training Process 33%
• Pruning 33%
• Training Costs 33%
• Storage Cost 33%
• Parameter Tuning 33%
• Trainable 33%
• Downstream Task 33%
• Large-scale Pre-trained Model 33%
• Model Fine-tuning 33%
• Rank Decomposition 33%
• Decomposition Matrices 33%

Computer Science

• Training Process 100%
• New-State 100%
• Decomposition Matrix 100%
• Pre-Trained Language Models 100%

Mathematics

• Statistics 100%
• Matrix Decomposition 100%
• Training Process 100%