From Lexicon to AI: A Structured-Data Pipeline for Specialized Conversational Systems in Low-Resource Languages

Siddhant Hitesh Mantri
NMIMS, Mumbai
siddhant.mantri22@nmims.in
Dhara Gorasiya
CFILT, IIT Bombay
dharagorasiya@gmail.com
Malhar Kulkarni
CFILT, IIT Bombay
malhar@hss.iitb.ac.in
Pushpak Bhattacharya
CFILT, IIT Bombay
pb@cse.iitb.ac.in


Abstract

Low-resource languages face a critical challenge in AI development: creating specialized conversational systems without access to massive training corpora. We present a systematic methodology for transforming structured linguistic resources into specialized AI systems, demonstrating that expert-curated lexical databases can serve as effective foundations for conversational AI development. Our approach converts Hindi WordNet into 1.25 million diverse instruction-response pairs, fine-tunes a 12B-parameter language model using resource-efficient LoRA with 4-bit quantization. Evaluation through a Hindi language learning chatbot suggests that structured-knowledge-based systems can improve pedagogical effectiveness in educational conversational settings (91.0 vs. 79.4-83.6 for general-purpose models) while maintaining competitive semantic performance and high consistency. The complete pipeline demonstrates a proof-of-concept methodology using Hindi for developing specialized AI systems for any languages with WordNet resources. This work addresses the critical gap in AI accessibility for low-resource languages, offering a practical alternative to corpus-intensive approaches and potentially enabling specialized AI development for the hundreds of languages with existing WordNet resources.

1 Introduction↩︎

The democratization of artificial intelligence increasingly depends on developing specialized systems that effectively serve diverse linguistic communities. While recent advances in large language models have shown strong capabilities [1], these systems predominantly excel in high-resource languages with abundant digital content, leaving billions of speakers of low-resource languages underserved [2], [3]. This gap is particularly pronounced in specialized domains such as education, where culturally and linguistically aligned AI systems are critical for effective learning outcomes [4].

A key bottleneck in developing conversational AI for such settings is the reliance on massive training corpora, which are unavailable for most of the world’s 2,500+ languages [5], [6]. Existing fine-tuning paradigms assume large-scale textual data [7], as seen in datasets used for GPT-3 [8] and Common Crawl [9]. However, the challenge extends beyond data quantity to the lack of high-quality, domain-specific instructional data. Even languages with substantial web presence, such as Hindi, remain “resource-poor” in terms of pedagogically structured examples, limiting their applicability in specialized AI systems.

To address this limitation, we leverage structured linguistic resources that encode expert-curated knowledge. WordNets which are hierarchical lexical databases capturing semantic relationships, exist for over 200 languages [10], while resources like BabelNet integrate multilingual WordNets at scale [11]. Despite their richness, such resources are typically used as static references rather than as foundations for training conversational systems, representing a missed opportunity for advancing AI accessibility in multilingual contexts.

We propose a systematic methodology for transforming structured linguistic resources into specialized conversational AI systems, providing a practical alternative to corpus-intensive approaches. Using Hindi WordNet [12], [13] as a case study, we construct a language-learning system and evaluate it across semantic accuracy and pedagogical effectiveness.

Beyond this specific implementation, our approach suggests a potentially scalable pathway for enabling AI development across languages with existing structured resources. Hindi WordNet, comprising 105,460 words and 40,466 synsets [14], also serves as a foundation for other Indian language WordNets. This makes the methodology particularly relevant for educational applications in resource-constrained settings, where both computational limitations and lack of appropriate content hinder adoption [15].

Our key contributions are: (1) a systematic method for converting structured lexical databases into diverse conversational training data while preserving semantic relationships; (2) demonstration off a resource-efficient fine-tuning framework enabling deployment in typical educational environments; and (3) empirical evidence demonstrating improved domain-specific performance over general-purpose models. Together, these results establish a reproducible pipeline for building specialized AI systems in low-resource languages.

2 Related Work↩︎

2.1 The Evolving Role of AI in Education↩︎

Large-scale surveys consistently report positive learning gains from AI interventions while warning that impact is often measured on single dimensions rather than intertwined pedagogical, technical, and human factors. A comprehensive review covering 2010-2020 recommends "a multidimensional evaluation model" combining technical metrics with pedagogical design, domain alignment, and learner affect [16]. A conceptual synthesis categorizes AI’s functions into three roles: new subject, direct mediator, and supplementary assistant-showing how each reshapes classroom dynamics [17]. When AI takes the "new subject" role (e.g., tutoring agent), it can personalize instruction but must address social presence and reflection to avoid merely automating drill-and-practice [17]. These insights frame our approach as maintaining learner connections to structured knowledge rather than replacing expert guidance.

2.2 Chatbots for Language Learning↩︎

Systematic evidence confirms three recurring affordances of language-learning chatbots: timeliness, ease of access, and personalization, with pedagogical uses including simulation, helpline, and recommendation [18]. Social-presence analyses show bot self-disclosure encourages longer learner utterances and reduces practice anxiety [18]. CLIL field studies demonstrate high engagement (91% content mastery agreement, 93% finding dialogue engaging) but only 48% felt language skill improvement, highlighting content-language objective tensions [19]. These findings motivate our level-adaptive output balancing vocabulary complexity with curricular content, and post-response augmentation sustaining engagement beyond novelty effects.

2.3 Conversational AI in Low-Resource Languages↩︎

Low-resource contexts add data scarcity, cultural nuance, and deployment constraints to AI development challenges. Vision papers argue techniques like Direct Preference Optimization can lower supervision requirements for culturally sensitive AI companions [20]. Empirical work explores lightweight architectures: a Bangla customer service bot achieves >90% accuracy using n-gram stemming and CNN classifiers without deep linguistic resources, but lacks structured knowledge integration and level adaptation [21]. Knowledge-enriched FAQ chatbots improve intent classification through transfer learning but rely on retrieval rather than generation, limiting conversational depth [22]. More recent approaches attempt to bypass data scarcity by leveraging the cross-lingual transfer capabilities of large foundation models. [23] introduced Linguistically-Diverse Prompting (LDP), a technique that elicits generative capabilities in low-resource languages by using synthetic exemplars from high-resource "sibling" languages or English pivots. While this method demonstrates that English-dominant models can be coaxed into performing translation and summarization tasks for under-represented languages without supervised data, it fundamentally relies on the model’s latent, pre-trained knowledge. Consequently, such prompting strategies remain susceptible to the hallucination and factual inconsistency inherent in the base model, particularly in specialized domains where the model’s internal representation of the low-resource language is sparse or fragmented. This limitation underscores the necessity for methods that can ground generation in explicit, structured expert knowledge rather than relying solely on cross-lingual transfer. These studies demonstrate feasibility while underscoring gaps: (1) automatic diverse instruction-response generation; (2) resource-efficient fine-tuning; and (3) structured lexical resource coupling [24].

Hindi WordNet has been adapted into Hindi Shabdamitra, a five-level digital aid exposing gloss simplification and progressively richer semantic relations to K-12 learners. Classroom pilots show improved concept retention when learners explore associative networks rather than flat dictionary entries [15]. WordNet’s cognitive basis, which represents meaning as concept networks, aligns with semantic network vocabulary acquisition theories. Despite this potential, existing conversational systems rarely exploit such structure beyond initial training. Our approach bridges this gap by converting synsets into training examples, maintaining knowledge connections through post-generation augmentation, and enabling conversation-to-structure pivoting.

2.4 Research Gaps and Opportunities↩︎

Critical gaps remain for low-resource language applications: (1) Structured knowledge continuity - chatbots rarely maintain learner connections to training resources [18], [24]; (2) Level-adaptive generation - few systems systematically vary vocabulary, syntax, and explanation depth across proficiency levels [21]; (3) Resource-efficient deployment - approaches often assume cloud-scale hardware [20]; and (4) Integrated scaffolding - studies report novelty effects and limited long-term gains, indicating the need for dynamic learning supports [18], [19]. Our methodology addresses each gap by coupling structured linguistic resources with parameter-efficient fine-tuning and real-time knowledge augmentation.

3 Methodology: Structured-Data-to-AI Pipeline↩︎

Our systematic methodology transforms structured linguistic databases into specialized conversational AI systems through four integrated stages: systematic dataset generation, resource-efficient model fine-tuning, domain-adaptive response generation, and intelligent knowledge integration. This pipeline suggests that expert-curated lexical resources can serve as useful foundations for specialized AI development, offering a practical alternative to corpus-intensive approaches for low-resource languages.

3.1 Dataset Creation Pipeline↩︎

3.1.1 Structured Knowledge Processing↩︎

We systematically convert Hindi WordNet’s structured semantic data into diverse conversational training examples. The resource contains 56,928 words with rich semantic relationships including hypernymy, hyponymy, meronymy, antonymy, and ontological hierarchies. Our automated pipeline generates four complementary types of instruction-response pairs designed to preserve the structured knowledge while creating natural conversational interactions (see Appendix 9 for detailed examples):

  • Basic Instructional Pairs establish fundamental question-answer patterns for core linguistic concepts.

  • Complex Multi-Aspect Pairs integrate multiple semantic relationships within single responses, teaching comprehensive word understanding including definitions, synonyms, examples, and grammatical categories within complete linguistic contexts.

  • Ontological Hierarchy Pairs leverage WordNet’s taxonomic structure to teach categorical relationships.

  • Disambiguation Pairs address polysemy by explicitly teaching multiple word meanings with contextual differentiation, crucial for morphologically rich languages like Hindi.

3.1.2 Relational Coverage and Quality Assurance↩︎

Hindi WordNet’s 23 semantic relationship types [12] are mapped to educational terminology through expert linguistic consultation. To prevent information overload while ensuring complete coverage, we implemented a dynamic chunking algorithm for dense semantic relationships. For entries with extensive relational lists (exceeding 10 related terms), our algorithm splits the data into digestible segments of up to 10 items. Crucially, we enforce a 33% overlap (approx. 3 words) between consecutive chunks. This overlapping sliding-window strategy ensures the model learns the continuity of semantic categories across training examples rather than treating them as disjoint sets.

Furthermore, to foster multi-hop semantic reasoning, the pipeline dynamically combines distinct relationship types into unified complex queries. For example, a single instruction might require the model to identify both the Hypernym and Antonym of a target word. We implemented a coverage check to ensure that every unique word in a relation list appears in at least one training example, whether in a single or combined query. Finally, the pipeline implements hash based deduplication using an instruction-response hash comparison, removing 847,000 duplicate examples from an initial 2.1 million generated pairs. The final dataset consists of 1,253,847 unique pairs with balanced representation across all relationship types.

3.2 Resource-Efficient Model Specialization↩︎

3.2.1 Base Model Selection and Optimization↩︎

We select Gemma-3-12B-IT as our foundation model for its demonstrated multilingual capabilities and instruction-following performance [25]. To enable deployment in resource-constrained environments, we implemented 4-bit quantization using NF4 (Normalized Float 4) with double quantization [26], reducing memory requirements from 48GB to approximately 12GB while preserving model performance - a critical consideration for low-resource language applications where computational resources are limited.

3.2.2 Parameter-Efficient Fine-Tuning Configuration↩︎

We specialize the model using Low-Rank Adaptation (LoRA) [27] with optimized hyperparameters balancing adaptation capability with efficiency: Rank (r): 32, providing sufficient expressiveness for domain specialization; Alpha: 64, ensuring appropriate scaling for knowledge adaptation; Target modules: all attention projections and MLP components for comprehensive adaptation; and Dropout: 0.05 for regularization without overfitting. This configuration fine-tunes only 0.2% of the total parameters (67M out of 12B), enabling rapid specialization while preserving pre-trained multilingual knowledge, essential for maintaining general linguistic competence during domain adaptation.

3.2.3 Training Configuration and Efficiency↩︎

Our training employs distributed setup with gradient accumulation achieving effective batch sizes of 8 across available hardware. Key parameters include 2e-5 learning rate with cosine scheduling [28], 15% warmup steps, gradient clipping at 0.5 for stability [29], and 3 training epochs with early stopping. The complete training process requires approximately 40 hours on 2×NVIDIA A100 80G GPUs, demonstrating practical feasibility for educational institutions and research organizations in developing regions.

3.3 Domain-Adaptive Response Generation↩︎

We implement systematic level adaptation aligned with educational curricula through structured prompt templates defining five proficiency levels - from प्राथमिक (Beginner, 2–3 simple sentences with everyday vocabulary and concrete examples), माध्यमिक (Intermediate, 4–5 sentences with practical examples), कुशल (Proficient, 6–8 sentences with increased grammatical nuance and varied examples), उन्नत (Advanced, 8–10 sentences incorporating abstract and cultural context), to विशेषज्ञ (Expert, 10+ sentences with technical linguistic terminology and interdisciplinary analysis). Each template explicitly controls vocabulary complexity, sentence length, explanation depth, and example types, enabling consistent and reproducible response adaptation across proficiency levels.

Given the educational deployment context targeting children, safety constraints are embedded directly into the base system prompt, restricting responses to family, school, and nature domains while blocking inappropriate, violent, or adult content, with fallback mechanisms for unsafe queries [30]. Full prompt templates for all five levels are provided in Appendix 8.

We refer to this fine-tuned Gemma-3-12B-IT model as Shabdabot throughout the remainder of the paper.

4 Results↩︎

4.1 Evaluation Setup and Metrics↩︎

We conducted a rigorous comparative evaluation using 40 carefully designed Hindi language questions spanning five proficiency levels (प्राथमिक (Beginner) to विशेषज्ञ (Expert)). Expert linguists created golden reference answers for each question-level combination, resulting in 200 reference responses. We obtained responses from five models- Shabdabot, GPT-4.1 [31], Claude-Sonnet-4 [32], Gemini-2.5Pro [33], and Gemma-3-12B-IT [25]-using identical prompts and system settings to ensure fair comparison.

To eliminate evaluation bias, all responses were anonymized during metric calculation. We employed two complementary evaluation metrics designed to assess both semantic accuracy and pedagogical effectiveness:

Semantic Answer Similarity (SAS) measures the semantic fidelity between model responses and expert-created golden answers. This metric employs the multilingual sentence transformer paraphrase-multilingual-MiniLM-L12-v2 [34] to generate vector embeddings for both model responses and reference answers. Semantic similarity is calculated using cosine similarity between these embeddings, producing scores ranging from 0 to 1, where higher values indicate greater semantic alignment with expert-authored content. The multilingual model was specifically chosen for its demonstrated effectiveness in cross-lingual semantic similarity tasks and strong performance on Hindi text. This metric captures how well models preserve the core meaning and factual content of expert responses, independent of stylistic or pedagogical considerations.

Level Adaptation Quality (LAQ) assesses pedagogical effectiveness and appropriateness for educational contexts through expert evaluation. We employed Claude-Sonnet-4 as an automated expert judge, chosen for its demonstrated reliability in educational content evaluation and ability to process Hindi text with cultural and linguistic nuance. The LAQ evaluation employs a comprehensive rubric that evaluates five pedagogical criteria: (1) Pedagogical Clarity - how easily the target learner can understand the explanation; (2) Factual accuracy - correctness and precision of provided information; (3) Relevance & Examples-appropriateness and quality of examples for the proficiency level; (4) Language Appropriateness-suitability of vocabulary, syntax, and tone for the intended learner; and (5) Educational Value - general utility as a teaching tool for the specific proficiency level. Each criterion receives a score from 0-20 points, yielding total scores from 0-100, with higher scores indicating superior educational effectiveness. To ensure evaluation reliability, we provided detailed scoring rubrics with level-specific criteria and conducted consistency validation across multiple evaluation runs.

These complementary metrics enable comprehensive assessment of both semantic competence and domain-specific effectiveness, addressing the critical question of whether specialized systems can maintain linguistic accuracy while achieving superior pedagogical outcomes compared to general-purpose models.

To validate the reliability of this automated judging, we conducted a human-in-the-loop verification process. A team of expert Hindi linguists reviewed a randomized subset of the model responses and the corresponding scores assigned by Claude-Sonnet-4. The experts verified that the AI judge consistently applied the rubric criteria regarding all five pedagogical criteria. This expert cross-verification confirmed that the automated scores were not random and aligned closely with human pedagogical assessment standards, validating the use of the LLM as a scalable proxy for expert evaluation.

Table 1: Overall Model Performance
Model LAQ Score LAQ Rank Consistency (\(\sigma\)) SAS Score SAS Rank
Shabdabot 91.0 1st 1.0 0.731 2nd
GPT-4.1 79.4 5th 7.4 0.762 1st
Gemma-3-12B-IT 80.8 4th 2.4 0.728 3rd
Claude-Sonnet-4 81.9 3rd 6.4 0.712 4th
Gemini-2.5Pro 83.6 2nd 5.7 0.705 5th

4.2 Overall Performance Analysis↩︎

The results reveal a critical insight for specialized AI development: while GPT-4.1 achieved highest semantic similarity to expert-created answers, our structured-knowledge-based system dramatically outperformed all models in domain-specific effectiveness with a 91.0 LAQ score-an 11.6-point advantage over the second-best model and a remarkable 12.6% improvement over its base model (see Table 1).

4.3 Proficiency Level Performance Patterns↩︎

Figure 1 illustrates semantic performance across proficiency levels, revealing distinct patterns supporting our structured-knowledge approach.

Figure 1: SAS Analysis visualization across proficiency levels.

Critical Finding: Shabdabot uniquely peaks at the उन्नत (Advanced) level, achieving highest performance among all models at this level. The performance decline at the विशेषज्ञ (Expert) level reflects training data characteristics-our structured-knowledge conversion emphasized educational clarity over lengthy academic discourse typical of expert-level responses.

The LAQ evaluation shows Shabdabot’s consistent performance across all proficiency levels:

  • Primary to Expert levels: 83.0-83.8 (standard deviation: 0.37)

  • Best performer: All five proficiency levels

  • Stability: Unlike general-purpose models showing significant performance degradation with difficulty increases

4.4 Statistical Significance and Reliability Analysis↩︎

One-way ANOVA confirmed significant differences between models (\(F(4,995) = 5.491, p < 0.001\)). Key findings include:

  • Semantic Performance: GPT-4.1 vs. Shabdabot significant difference (\(p = 0.019\), Cohen’s d = 0.236) [35], while Shabdabot vs. Gemma-3-12B-IT showed non-significant difference (\(p = 0.819\)), indicating preserved semantic competence during specialization.

  • Reliability Advantage: Figure 2 highlights a key advantage of our approach-Shabdabot achieved high consistency with \(\sigma = 1.0\) compared to 7.4 for GPT-4.1, representing an 86% improvement in predictability. Reliability metrics are detailed in Table 2.

Table 2: Reliability Metrics Comparison
Model
Std Dev
(>90%)
Shabdabot 1.0 93%
Gemma-3-12B-IT 2.4 0%
Gemini-2.5Pro 5.7 6%
Claude-Sonnet-4 6.4 5.5%
GPT-4.1 7.4 0%
Figure 2: Performance vs. Consistency scatter plot.

4.5 Domain Specialization Effectiveness↩︎

Figure 3 shows that Shabdabot received higher pedagogical scores across all pedagogical criteria. The model achieved high scores in Pedagogical Clarity (18.2/20), Language Appropriateness (18.4/20), Relevance & Examples (18.1/20), and Educational Value (17.8/20), while maintaining competitive Factual Accuracy (18.5/20).

Figure 3: Radar Chart of Performance Across Pedagogical Criteria.

4.6 Structured-Knowledge Impact Analysis↩︎

Here, domain effectiveness refers to the Level Adaptation Quality (LAQ) score (0–100), our primary metric for pedagogical quality in the target educational domain. Direct comparison between our system and its base model reveals the effectiveness of structured-knowledge specialization, as shown in Table 3.

Table 3: Specialization Impact
Metric
12B-IT Shabdabot
ment
Comp. 0.728 0.731 +0.4%
Eff.(LAQ) 80.8 91.0 +12.6%
Consistency 2.4\(\sigma\) 1.0\(\sigma\) +58%
SAS 0.737 0.759 +2.9%
Failures 0 0 Maintained

Direct comparison between our system and its base model reveals the effectiveness of structured-knowledge specialization, as shown in Table 3. Domain effectiveness improves by 12.6% while semantic competence is preserved, and response consistency improves by 58% (\(\sigma: 2.4 \to 1.0\)) - suggesting that structured knowledge integration enhances rather than constrains general linguistic capability, while producing a more predictable and reliable system.

Together, these results confirm that domain specialization and practical deployability are not in tension - structured knowledge integration achieves both simultaneously.

5 Discussions↩︎

The performance gap between Shabdabot and general-purpose models reveals a counterintuitive insight: semantic similarity to expert answers does not predict pedagogical effectiveness in specialized domains. The results show important patterns: while general-purpose models like GPT-4.1 achieve higher semantic similarity to expert-created responses, our structured-knowledge-based system shows higher domain-specific effectiveness. This challenges the prevailing assumption that general-purpose foundation models are inherently optimal for specialized, pedagogical applications.

The high consistency achieved by our approach-an 86% improvement in reliability compared to leading general-purpose models-addresses practical concerns for AI deployment, particularly in educational contexts where unpredictable responses can confuse learners. We hypothesize that this reliability stems from systematic structured knowledge integration, where generation is grounded in expert-curated linguistic relationships rather than statistical patterns derived from unstructured web text. By demonstrating that 1.25 million structured examples can create specialized systems that can be competitive with models trained on billions of general examples, we establish that expert-curated knowledge can effectively complement or substitute for corpus-intensive approaches.

Several limitations suggest important considerations for future applications. Expert-level performance decline points to a training data gap we detail in Section 6. Evaluation of long-term learning outcomes in authentic classrooms remains an important open question. Cross-linguistic validation beyond Hindi remains necessary to establish generalizability.

6 Conclusion↩︎

This work reframes how we think about data for low-resource AI development. The prevailing assumption is that more general-purpose data produces better systems - our results directly challenge this, showing that 1.25 million wordnet generated structured examples outperform models trained on orders of magnitude more unstructured text, specifically in the domain they are designed for. The consistency gap is particularly telling: Shabdabot’s σ=1.0 against GPT-4.1’s σ=7.4 suggests that grounding generation in structured knowledge doesn’t just improve accuracy - it fundamentally changes the reliability profile of the system.

Crucially, the methodology’s resource efficiency-achieving superior domain performance while requiring only 12GB RAM-directly addresses the computational barriers that prevent communities from accessing sophisticated AI technologies. With WordNets and similar structured resources available for over 200 languages, this pipeline offers a highly reproducible development pathway. Ultimately, this work provides a practical framework for democratizing AI, leveraging decades of linguistic scholarship to deliver equitable, domain-specific systems for billions of underserved language speakers worldwide.

7 Limitations↩︎

While our results demonstrate the effectiveness of structured-knowledge approaches for specialized AI development, several limitations warrant consideration:

Training Data Coverage: Our automated pipeline emphasized educational clarity and conciseness, potentially underrepresenting the verbose, technically dense responses characteristic of expert-level academic discourse. This is evident in the Expert-level SAS score drop to 0.688 - the lowest across all levels - compared to 0.759 at Advanced. Future pipelines could address this by supplementing WordNet with academic corpora or long-form Wikipedia text specifically for expert-level examples.

Dependence on Structured Resource Availability. A limitation of our approach is its dependence on the availability and quality of structured linguistic resources. While WordNets and similar databases exist for many languages, their coverage, granularity, and domain completeness vary significantly, and may be limited or absent for truly low-resource languages. In such cases, additional effort is required to construct or augment these resources, which introduces overhead in adopting the methodology. However, compared to corpus-intensive approaches, structured resources are significantly more compact and reusable, making them a promising foundation for scalable multilingual AI development once such resources are available.

Domain and Language Scope: Our evaluation focuses exclusively on Hindi language education. Specifically, agglutinative languages like Tamil or Turkish, and isolating languages like Mandarin, present structurally different WordNet organizations that may require pipeline modifications - this remains untested.

Long-term Impact Assessment: Our evaluation measures immediate response quality and pedagogical appropriateness rather than actual learning outcomes. Longitudinal studies tracking learner vocabulary retention over 4–8 weeks, using pre/post assessments, would provide the most meaningful validation of actual educational impact beyond our current response-quality metrics.

These limitations suggest important directions for future work while not diminishing the core contribution of demonstrating that structured linguistic resources can effectively serve as foundations for specialized AI development in low-resource language contexts.

8 Prompt Engineering Templates↩︎

This appendix outlines the specific system instructions and level-adaptive prompts used in the generation pipeline. All prompts were administered in Hindi to ensure linguistic consistency.

8.1 Base System Instruction↩︎

All proficiency levels shared the following core system prompt, which establishes the persona, scope, and safety constraints:

आप एक हिंदी भाषा शिक्षण चैटबॉट हैं जिसका एकमात्र उद्देश्य बच्चों को हिंदी भाषा संबंधी शैक्षिक जानकारी प्रदान करना है। कृपया नीचे दिए गए नियमों का कड़ाई से पालन करें:

  1. केवल हिंदी भाषा के अर्थ, व्याकरण, समानार्थी, विलोम, पराजाति-अपराजाति, अवयव-अवयवी संबंध, वाक्य में शब्दों का प्रयोग, और पदानुक्रम (ontology) संबंधी प्रश्नों का उत्तर दें।

  2. आपकी जानकारी सरल, स्पष्ट, सकारात्मक, और बच्चों के लिए पूरी तरह सुरक्षित होनी चाहिए।

  3. उदाहरण केवल परिवार, स्कूल, घर, प्रकृति, पशु-पक्षी, मित्रता और सकारात्मक गतिविधियों तक सीमित रखें।

  4. मित्रता या परिवार से बाहर के संबंधों के संदर्भ को गलत समझे जाने वाले उदाहरण न दें।

  5. अनुचित, हिंसक, डरावनी, वयस्क, या अश्लील सामग्री का उल्लेख किसी भी परिस्थिति में न करें।

You are a Hindi language teaching chatbot whose sole purpose is to provide children with educational information related to the Hindi language. Please strictly follow the rules given below:

  1. Answer only questions related to Hindi language meaning, grammar, synonyms, antonyms, hypernym-hyponym relations, meronym-holonym relations, word usage in sentences, and ontology hierarchy.

  2. Your information must be simple, clear, positive, and completely safe for children.

  3. Keep examples limited only to family, school, home, nature, animals and birds, friendship, and positive activities.

  4. Do not provide examples that could be misinterpreted in the context of relationships outside friendship or family.

  5. Do not mention inappropriate, violent, frightening, adult, or obscene content under any circumstances.

8.2 Proficiency Level Instructions↩︎

Specific instructions were injected dynamically based on the target proficiency level.

8.2.0.1 Level 1: प्राथमिक (Beginner)

आप एक सहायक हिंदी शिक्षक हैं। उत्तर बिल्कुल सरल भाषा में दें:

  • बहुत आसान शब्दों का प्रयोग करें

  • छोटे वाक्य बनाएं

  • यदि जरूरी हो तो अंग्रेजी शब्द का भी प्रयोग कर सकते हैं

  • उदाहरण रोजमर्रा की जिंदगी से दें

  • उत्तर संक्षिप्त रखें (2-3 वाक्य)

  • बच्चों को समझ आने वाली भाषा का प्रयोग करें

8.2.0.2 Level 1: Beginner

You are a helpful Hindi teacher. Please answer in very simple language:

  • Use very easy words.

  • Make short sentences.

  • You can also use English words if necessary.

  • Give examples from everyday life.

  • Keep the answer brief (2-3 sentences).

  • Use language that children can understand.

8.2.0.3 Level 2: माध्यमिक (Intermediate)

आप एक अनुभवी हिंदी शिक्षक हैं। उत्तर मध्यम स्तर की भाषा में दें:

  • सामान्य हिंदी शब्दावली का प्रयोग करें

  • मध्यम लंबाई के वाक्य बनाएं

  • व्यावहारिक उदाहरण दें

  • मुख्य बिंदुओं को स्पष्ट रूप से समझाएं

  • उत्तर 4-5 वाक्यों में दें

  • विषय की बुनियादी जानकारी प्रदान करें

8.2.0.4 Level 2: Intermediate

You are an experienced Hindi teacher. Please answer in intermediate-level language:

  • Use common Hindi vocabulary.

  • Make medium-length sentences.

  • Give practical examples.

  • Explain the main points clearly.

  • Provide the answer in 4-5 sentences.

  • Provide basic information about the topic.

8.2.0.5 Level 3: कुशल (Proficient)

आप एक कुशल हिंदी भाषा विशेषज्ञ हैं। उत्तर अच्छी गुणवत्ता की भाषा में दें:

  • उचित हिंदी शब्दावली का प्रयोग करें

  • संतुलित लंबाई के वाक्य बनाएं

  • विविध प्रकार के उदाहरण दें

  • विषय की गहरी समझ प्रदान करें

  • उत्तर विस्तृत और पूर्ण दें (6-8 वाक्य)

  • संदर्भ और व्याकरण की बारीकियों का उल्लेख करें

8.2.0.6 Level 3: Proficient

You are a proficient Hindi language expert. Please answer in high-quality language:

  • Use appropriate Hindi vocabulary.

  • Make sentences of balanced length.

  • Provide diverse examples.

  • Provide a deep understanding of the topic.

  • Give a detailed and complete answer (6-8 sentences).

  • Mention context and grammatical nuances.

8.2.0.7 Level 4: उन्नत (Advanced)

आप एक उच्च योग्यता प्राप्त हिंदी भाषा-शास्त्री हैं। उत्तर उन्नत स्तर की भाषा में दें:

  • परिष्कृत हिंदी शब्दावली का प्रयोग करें

  • जटिल व्याकरणिक संरचनाओं का उपयोग करें

  • अमूर्त और तकनीकी उदाहरण दें

  • गहन विश्लेषण प्रदान करें

  • उत्तर व्यापक और बहुआयामी दें (8-10 वाक्य)

  • भाषाविज्ञान के सिद्धांतों का प्रयोग करें

  • विषय के ऐतिहासिक और सांस्कृतिक संदर्भ दें

8.2.0.8 Level 4: Advanced

You are a highly qualified Hindi linguist. Please answer in advanced-level language:

  • Use sophisticated Hindi vocabulary.

  • Use complex grammatical structures.

  • Give abstract and technical examples.

  • Provide in-depth analysis.

  • Give a comprehensive and multi-dimensional answer (8-10 sentences).

  • Use principles of linguistics.

  • Provide historical and cultural context for the topic.

8.2.0.9 Level 5: विशेषज्ञ (Expert)

आप एक अग्रणी हिंदी भाषाविज्ञान विशेषज्ञ हैं। उत्तर विशेषज्ञ स्तर की भाषा में दें:

  • उच्चतम स्तर की तकनीकी शब्दावली का प्रयोग करें

  • अत्यधिक जटिल भाषिक संरचनाओं का उपयोग करें

  • गहन तकनीकी और सैद्धांतिक उदाहरण दें

  • विषय का संपूर्ण और बहुस्तरीय विश्लेषण प्रदान करें

  • उत्तर अत्यंत विस्तृत और शोधपूर्ण दें (10+ वाक्य)

  • अत्याधुनिक भाषाविज्ञान अनुसंधान का संदर्भ दें

  • अंतःविषयक दृष्टिकोण अपनाएं

  • भाषा के दार्शनिक पहलुओं पर चर्चा करें

8.2.0.10 Level 5: Expert

You are a leading Hindi linguistics expert. Please answer in expert-level language:

  • Use the highest level of technical vocabulary.

  • Use highly complex linguistic structures.

  • Give deep technical and theoretical examples.

  • Provide a complete and multi-layered analysis of the topic.

  • Give an extremely detailed and research-oriented answer (10+ sentences).

  • Reference cutting-edge linguistics research.

  • Adopt an interdisciplinary approach.

  • Discuss the philosophical aspects of language.

9 Dataset Generation Examples↩︎

This appendix provides concrete examples of the instruction-response pairs generated by our pipeline, illustrating how structured WordNet data is converted into conversational formats.

9.1 Basic Instructional Examples↩︎

These examples focus on direct concept queries.

  • Instruction: "‘प्रेम’ का अर्थ क्या है?" (What is the meaning of ‘Love’?)

  • Response: "‘प्रेम’ का अर्थ है: गहरा स्नेह..." (The meaning of ‘Love’ is: deep affection...)

9.2 Complex Multi-Aspect Examples↩︎

These examples combine multiple semantic facets (definition, part-of-speech, synonyms, and specific relations) into a single, comprehensive response.

  • Instruction: "हिंदी शब्द ‘सूर्य’ के बारे में विस्तृत जानकारी दें।" (Give detailed information about the Hindi word ‘Sun’.)

  • Response: अर्थ: सौरमंडल का प्रधान ग्रह जो एक बहुत बड़ा और जलता हुआ गोला है।
    समानार्थी शब्द: सूरज, दिनकर, रवि, भानु
    उदाहरण: सूर्य पूर्व दिशा से निकलता है।
    व्याकरणिक श्रेणी: संज्ञा
    (Meaning: The principal planet of the solar system... Synonyms: Suraj, Dinkar... Example: The sun rises in the east. POS: Noun)

  • Instruction: "हिंदी शब्द ‘वृक्ष’ के पर्यायवाची और अवयव संबंधों का वर्णन करें।" (Describe the synonym and meronym relations for the Hindi word ‘Tree’.)

  • Response: समानार्थी: पेड़, तरु, पादप, विटप
    अवयव_सदस्य_संग्रह: वन, जंगल
    अवयव_घटक_पदार्थ: जड़, तना, शाखा, पत्ता
    (Synonyms: Ped, Taru... Member_of_collection: Forest... Component_parts: Root, Trunk, Branch, Leaf)

9.3 Ontological Hierarchy Examples↩︎

These examples teach the taxonomic structure of objects.

  • Instruction: "हिंदी शब्द ‘गुलाब’ के लिए वर्गीकरण पदानुक्रम क्या है?" (What is the classification hierarchy for the Hindi word ‘Rose’?)

  • Response: "‘गुलाब’ का वर्गीकरण: जीव -> पौधा -> फूल वाला पौधा -> गुलाब" (Classification of ‘Rose’: Organism \(\to\) Plant \(\to\) Flowering Plant \(\to\) Rose)

9.4 Disambiguation Examples↩︎

These examples explicitly handle polysemy by presenting multiple distinct meanings for a single word form.

  • Instruction: "हिंदी शब्द ‘आम’ के विभिन्न अर्थों को समझाएं।" (Explain the different meanings of the Hindi word ‘Aam’.)

  • Response: ‘आम’ के विभिन्न अर्थ हैं:

    अर्थ 1: एक प्रकार का प्रसिद्ध मीठा और रसीला फल
    व्याकरणिक श्रेणी: संज्ञा
    उदाहरण: तोता आम खा रहा है।

    अर्थ 2: जो विशिष्ट न होकर साधारण हो
    व्याकरणिक श्रेणी: विशेषण
    उदाहरण: यह आम रास्ता नहीं है।
    (Meanings of ‘Aam’:
    Meaning 1: A famous sweet juicy fruit (Noun)...
    Meaning 2: Common or ordinary, not specific (Adjective)...)

References↩︎

[1]
Desta Haileselassie Hagos, Rick Battle, and Danda B. Rawat. 2024. https://doi.org/10.1109/TAI.2024.3444742. IEEE Transactions on Artificial Intelligence, 5(12):5873–5893.
[2]
Tianyang Zhong, Zhenyuan Yang, Zhengliang Liu, Ruidong Zhang, Yiheng Liu, Haiyang Sun, Yi Pan, Yiwei Li, Yifan Zhou, Hanqi Jiang, Junhao Chen, and Tianming Liu. 2024. http://arxiv.org/abs/2412.04497.
[3]
M. A. Hasan et al. 2024. http://arxiv.org/abs/2408.02237.
[4]
Qingyao Li, Lingyue Fu, Weiming Zhang, Xianyu Chen, Jingwei Yu, Wei Xia, Weinan Zhang, Ruiming Tang, and Yong Yu. 2024. http://arxiv.org/abs/2401.08664.
[5]
UNESCO. 2010. https://unesdoc.unesco.org/ark:/48223/pf0000187026. Accessed: 2025-06-21.
[6]
Endangered Languages Project. Endangered languages project. https://www.endangeredlanguages.com/. Accessed: 2025-06-21.
[7]
Elena Cryst, Juan N. Pava, Caroline Meinhardt, Haifa Badi Uz Zaman, Toni F., Sang Truong, Daniel Zhang, Vukosi Marivate, and Sanmi Koyejo. 2025. https://hai-production.s3.amazonaws.com/files/hai-taf-pretoria-white-paper-mind-the-language-gap.pdf. Technical report, Stanford Institute for Human-Centered AI (HAI), The Asia Foundation, University of Pretoria. White Paper.
[8]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf. In Advances in Neural Information Processing Systems, volume 33, pages 1877–1901. Curran Associates, Inc.
[9]
Stefan Baack. 2024. https://doi.org/10.1145/3630106.3659033. In The 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’24), pages 2199–2208, New York, NY, USA. Association for Computing Machinery.
[10]
Global WordNet Association. Wordnets in the world. https://globalwordnet.org/resources/wordnets-in-the-world. Accessed: 2024-07-23.
[11]
Roberto Navigli and Simone P. Ponzetto. 2010. Babelnet: A large multilingual encyclopedic dictionary and semantic network. https://babelnet.org/about. Accessed: 2024-07-23.
[12]
Pushpak Bhattacharyya. 2010. ndoWordNet. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta. European Language Resources Association (ELRA).
[13]
Pushpak Bhattacharyya, Prabhakar Pande, and Laxmi Lupu. 2008. https://doi.org/10.35111/s81s-5n27. Web Download. Web Download.
[14]
Centre for Indian Language Technology, IIT Bombay. 2025. Hindi wordnet – a lexical database for hindi. https://www.cfilt.iitb.ac.in/wordnet/webhwn/wn.php. Accessed: 28 June 2025.
[15]
Hanumant Redkar, Rajita Shukla, Sandhya Singh, Jaya Saraswati, Laxmi Kashyap, Diptesh Kanojia, Preethi Jyothi, Malhar Kulkarni, and Pushpak Bhattacharyya. 2018. https://aclanthology.org/2018.gwc-1.37/. In Proceedings of the 9th Global Wordnet Conference, pages 314–323, Nanyang Technological University (NTU), Singapore. Global Wordnet Association.
[16]
Xuesong Zhai, Xiaoyan Chu, Ching Chai, Morris Jong, Andreja Istenic Starcic, Jonathan Spector, Jia-Bao Liu, Jing Yuan, and Yan Li. 2021. https://doi.org/10.1155/2021/8812542. Complexity, 2021:1–18.
[17]
Wei Xu and Fang Ouyang. 2022. https://doi.org/10.1007/s10639-021-10774-y. Education and Information Technologies, 27:4195–4223.
[18]
Weijiao Huang, Khe Foon Hew, and Luke K. Fryer. 2022. https://doi.org/https://doi.org/10.1111/jcal.12610. Journal of Computer Assisted Learning, 38(1):237–257.
[19]
Kleopatra Mageira, Dimitra Pittou, Andreas Papasalouros, Konstantinos Kotis, Paraskevi Zangogianni, and Thanasis Daradoumis. 2022. https://doi.org/10.3390/app12073239. Applied Sciences, 12:3239.
[20]
Zhaojun Ding, Zhengliang Liu, Hanqi Jiang, Yizhu Gao, Xiaoming Zhai, Tianming Liu, and Ninghao Liu. 2024. http://arxiv.org/abs/2412.04774.
[21]
Anirudha Paul, Asiful Haque Latif, Foysal Amin Adnan, and Rashedur M Rahman. 2019. https://doi.org/10.1080/24751839.2018.1558378. Journal of Information and Telecommunication, 3(2):248–269.
[22]
Rizal Setya Perdana, Putra Pandu Adikara, Indriati, and Diva Kurnianingtyas. 2022. https://doi.org/10.1109/EECCIS54468.2022.9902930. In 2022 11th Electrical Power, Electronics, Communications, Controls and Informatics Seminar (EECCIS), pages 310–315.
[23]
Xuan-Phi Nguyen, Mahani Aljunied, Shafiq Joty, and Lidong Bing. 2024. https://doi.org/10.18653/v1/2024.acl-long.192. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3501–3516, Bangkok, Thailand. Association for Computational Linguistics.
[24]
Abisola Rukayat Oyewole, Chukwuemeka Christian Ugwu, Adebayo Olusola Adetunmbi, and Abimbola Helen Afolayan. 2024. https://doi.org/10.1109/NIGERCON62786.2024.10927136.
[25]
Gemma Team. 2025. Gemma 3 technical report. https://storage.googleapis.com/deepmind-media/gemma/Gemma3Report.pdf. Technical Report, Released March 12, 2025.
[26]
Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. https://proceedings.neurips.cc/paper_files/paper/2023/file/1feb87871436031bdc0f2beaa62a049b-Paper-Conference.pdf. In Advances in Neural Information Processing Systems, volume 36, pages 10088–10115. Curran Associates, Inc.
[27]
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. https://openreview.net/pdf?id=nZeVKeeFYf9.
[28]
Ilya Loshchilov and Frank Hutter. 2019. https://openreview.net/pdf?id=Bkg6RiCqY7.
[29]
Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. https://proceedings.mlr.press/v28/pascanu13.html. In Proceedings of the 30th International Conference on Machine Learning, volume 28 of Proceedings of Machine Learning Research, pages 1310–1318, Atlanta, Georgia, USA. PMLR.
[30]
Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. 2020. https://doi.org/10.18653/v1/2020.findings-emnlp.301. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3356–3369, Online. Association for Computational Linguistics.
[31]
OpenAI. 2025. Introducing gpt‑4.1 in the api. https://openai.com/index/gpt-4-1/. Accessed: 2025-07-23.
[32]
Anthropic. 2025. Claude opus 4 & claude sonnet 4 system card. https://www-cdn.anthropic.com/4263b940cabb546aa0e3283f35b686f4f3b2ff47.pdf. Accessed: 2025-07-23.
[33]
Google Gemini Team. 2025. Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities. https://storage.googleapis.com/deepmind-media/gemini/gemini_v2_5_report.pdf. Accessed: 2025-07-23.
[34]
Nils Reimers and Iryna Gurevych. 2020. https://doi.org/10.18653/v1/2020.emnlp-main.365. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 4512–4525, Online. Association for Computational Linguistics.
[35]
Marc J. Diener. 2010. https://doi.org/https://doi.org/10.1002/9780470479216.corpsy0200. John Wiley & Sons, Ltd.