Disaster Question Answering with LoRA Efficiency and Accurate End Position
arXiv:2602.21212v1 Announce Type: new Abstract: Natural disasters such as earthquakes, torrential rainfall, floods, and volcanic eruptions occur with extremely low frequency and affect limited geographic areas. When individuals face disaster situations, they often experience confusion and lack the domain-specific knowledge and experience necessary to determine appropriate responses and actions. While disaster information is continuously updated, even when utilizing RAG search and large language models for inquiries, obtaining relevant domain knowledge about natural disasters and experiences similar to one's specific situation is not guaranteed. When hallucinations are included in disaster question answering, artificial misinformation may spread and exacerbate confusion. This work introduces a disaster-focused question answering system based on Japanese disaster situations and response experiences. Utilizing the cl-tohoku/bert-base-japanese-v3 + Bi-LSTM + Enhanced Position Heads archit
arXiv:2602.21212v1 Announce Type: new Abstract: Natural disasters such as earthquakes, torrential rainfall, floods, and volcanic eruptions occur with extremely low frequency and affect limited geographic areas. When individuals face disaster situations, they often experience confusion and lack the domain-specific knowledge and experience necessary to determine appropriate responses and actions. While disaster information is continuously updated, even when utilizing RAG search and large language models for inquiries, obtaining relevant domain knowledge about natural disasters and experiences similar to one's specific situation is not guaranteed. When hallucinations are included in disaster question answering, artificial misinformation may spread and exacerbate confusion. This work introduces a disaster-focused question answering system based on Japanese disaster situations and response experiences. Utilizing the cl-tohoku/bert-base-japanese-v3 + Bi-LSTM + Enhanced Position Heads architecture with LoRA efficiency optimization, we achieved 70.4\% End Position accuracy with only 5.7\% of the total parameters (6.7M/117M). Experimental results demonstrate that the combination of Japanese BERT-base optimization and Bi-LSTM contextual understanding achieves accuracy levels suitable for real disaster response scenarios, attaining a 0.885 Span F1 score. Future challenges include: establishing natural disaster Q\&A benchmark datasets, fine-tuning foundation models with disaster knowledge, developing lightweight and power-efficient edge AI Disaster Q\&A applications for situations with insufficient power and communication during disasters, and addressing disaster knowledge base updates and continual learning capabilities.
Executive Summary
The article proposes a disaster-focused question answering system that leverages the LoRA efficiency optimization technique and the cl-tohoku/bert-base-japanese-v3 + Bi-LSTM + Enhanced Position Heads architecture to improve the accuracy of disaster response scenarios. The system achieves 70.4% End Position accuracy with 5.7% of the total parameters, outperforming existing models. The experimental results demonstrate the effectiveness of the proposed system in real-world disaster response scenarios, achieving a 0.885 Span F1 score. The authors highlight the importance of establishing natural disaster Q&A benchmark datasets, fine-tuning foundation models with disaster knowledge, and developing lightweight and power-efficient edge AI Disaster Q&A applications.
Key Points
- ▸ The proposed system leverages LoRA efficiency optimization to improve the accuracy of disaster response scenarios.
- ▸ The system achieves 70.4% End Position accuracy with 5.7% of the total parameters.
- ▸ The experimental results demonstrate the effectiveness of the proposed system in real-world disaster response scenarios.
Merits
Improved Efficiency
The LoRA efficiency optimization technique allows the proposed system to achieve high accuracy with significantly reduced parameters, making it more efficient and practical for real-world applications.
Enhanced Accuracy
The proposed system achieves high accuracy in disaster response scenarios, outperforming existing models and demonstrating its effectiveness in real-world applications.
Demerits
Limited Generalizability
The proposed system is specifically designed for Japanese disaster situations, and its generalizability to other languages and disaster scenarios is not demonstrated.
Lack of Real-World Deployment
The proposed system is still in the experimental phase, and its real-world deployment and evaluation in various disaster scenarios are not discussed.
Expert Commentary
The proposed system is a significant contribution to the field of disaster response and AI, leveraging the LoRA efficiency optimization technique to improve the accuracy of disaster response scenarios. However, the limited generalizability of the proposed system to other languages and disaster scenarios is a concern. Furthermore, the lack of real-world deployment and evaluation of the proposed system in various disaster scenarios is a limitation. Nevertheless, the proposed system has the potential to be a valuable tool for disaster response teams and inform policy decisions related to disaster preparedness and response.
Recommendations
- ✓ Future research should focus on adapting the proposed system to other languages and disaster scenarios, demonstrating its generalizability and effectiveness in various contexts.
- ✓ The authors should conduct real-world deployment and evaluation of the proposed system in various disaster scenarios to demonstrate its practicality and effectiveness.