System Architecture
An automated data pipeline that ingests Wongnai reviews, tokenizes and normalizes text, passes batches through fine-tuned XLM-RoBERTa weights, and surfaces insights on a real-time dashboard.
Key Architecture Components
- Data Preprocessing Engine: Noise removal, emoji mapping, and Thai compound word segmentation.
- Transformer Inference Engine: PyTorch-optimized XLM-RoBERTa classifier with GPU/CPU inference fallback.
- FastAPI Service Layer: RESTful endpoints exposing batch and single-review prediction APIs.
- Streamlit Intelligence Dashboard: Visualizes sentiment trends, keyword word-clouds, and rating distributions.
Data Pipeline Flow
Raw Customer Reviews → Thai Preprocessor → Tokenizer Pipeline → XLM-RoBERTa Transformer → Sentiment Classification → Live Analytics Dashboard