Academic

FreeTxt-Vi: A Benchmarked Vietnamese-English Toolkit for Segmentation, Sentiment, and Summarisation

arXiv:2603.05690v1 Announce Type: new Abstract: FreeTxt-Vi is a free and open source web based toolkit for creating and analysing bilingual Vietnamese English text collections. Positioned at the intersection of corpus linguistics and natural language processing NLP it enables users to build explore and interpret free text data without requiring programming expertise. The system combines corpus analysis features such as concordancing keyword analysis word relation exploration and interactive visualisation with transformer based NLP components for sentiment analysis and summarisation. A key contribution of this work is the design of a unified bilingual NLP pipeline that integrates a hybrid VnCoreNLP and Byte Pair Encoding BPE segmentation strategy a fine tuned TabularisAI sentiment classifier and a fine tuned Qwen2.5 model for abstractive summarisation. Unlike existing text analysis platforms FreeTxt Vi is evaluated as a set of language processing components. We conduct a three part eva

H
Hung Nguyen Huy, Mo El-Haj, Dawn Knight, Paul Rayson
· · 1 min read · 6 views

arXiv:2603.05690v1 Announce Type: new Abstract: FreeTxt-Vi is a free and open source web based toolkit for creating and analysing bilingual Vietnamese English text collections. Positioned at the intersection of corpus linguistics and natural language processing NLP it enables users to build explore and interpret free text data without requiring programming expertise. The system combines corpus analysis features such as concordancing keyword analysis word relation exploration and interactive visualisation with transformer based NLP components for sentiment analysis and summarisation. A key contribution of this work is the design of a unified bilingual NLP pipeline that integrates a hybrid VnCoreNLP and Byte Pair Encoding BPE segmentation strategy a fine tuned TabularisAI sentiment classifier and a fine tuned Qwen2.5 model for abstractive summarisation. Unlike existing text analysis platforms FreeTxt Vi is evaluated as a set of language processing components. We conduct a three part evaluation covering segmentation sentiment analysis and summarisation and show that our approach achieves competitive or superior performance compared to widely used baselines in both Vietnamese and English. By reducing technical barriers to multilingual text analysis FreeTxt Vi supports reproducible research and promotes the development of language resources for Vietnamese a widely spoken but underrepresented language in NLP. The toolkit is applicable to domains including education digital humanities cultural heritage and the social sciences where qualitative text data are common but often difficult to process at scale.

Executive Summary

The article introduces FreeTxt-Vi, a free and open-source web-based toolkit for analyzing bilingual Vietnamese-English text collections. It combines corpus analysis features with transformer-based NLP components for sentiment analysis and summarization. The toolkit achieves competitive performance compared to widely used baselines in both Vietnamese and English, supporting reproducible research and promoting the development of language resources for Vietnamese. By reducing technical barriers, FreeTxt-Vi is applicable to various domains, including education, digital humanities, and social sciences.

Key Points

  • FreeTxt-Vi is a bilingual Vietnamese-English toolkit for text analysis
  • The toolkit combines corpus analysis features with transformer-based NLP components
  • It achieves competitive performance in segmentation, sentiment analysis, and summarization

Merits

Unified Bilingual NLP Pipeline

The design of a unified bilingual NLP pipeline integrating segmentation, sentiment analysis, and summarization components is a significant strength of FreeTxt-Vi.

Reducing Technical Barriers

By not requiring programming expertise, FreeTxt-Vi reduces technical barriers to multilingual text analysis, making it accessible to a broader range of users.

Demerits

Limited Language Support

FreeTxt-Vi currently only supports Vietnamese and English, which may limit its applicability to other languages and regions.

Expert Commentary

The introduction of FreeTxt-Vi marks a significant step forward in promoting the development of language resources for underrepresented languages. By providing a unified bilingual NLP pipeline and reducing technical barriers, the toolkit has the potential to facilitate interdisciplinary research and collaboration. However, its limited language support may hinder its widespread adoption. Further research and development are necessary to expand the toolkit's language support and explore its applications in various domains.

Recommendations

  • Expand the toolkit's language support to include other underrepresented languages
  • Conduct further evaluations and comparisons with other NLP toolkits to assess its performance and limitations

Sources