Data · dataset · 2018
Hindi Language Stop Words List
Listed in Teesside University Research Data Repository
Stop words are frequent, evenly distributed, function words in any document corpus which does not add any meaning to the text content.
Description
Information retrieval from the corpus is not getting affected by the removal of these words. It has been proved that removing the stop words reduces the document size to a considerable extent and saves time in text processing in Natural Language Processing.
There are two sources where Hindi stop words are available online. First is Kevin Bouge list of stop words in various languages including Hindi . Second is sarai.net list .
Read the rest (3 more)
Third source can be translation of English Stop words available in NLTK corpus into Hindi using translator. In this work, the Stop words list is the extended list using all three resources and contains words as well as phrases. The combined list is verified by one native speaker of Hindi language and finalized after necessary corrections.
For the first time, the phrases are also kept in the list because a word in present continuous verb form changes to a phrase when written in Hindi. In this way, a phrase can be removed from the document corpus in one attempt and the document corpus can be reduced, without effecting the sentiment expressed in it. The stop words list has total 264 words and phrases, where 1 phrase is of the size of four words, 3 phrases are of the size of three words, 18 phrases are of the size of two words and 242 words are of the size of one word.
This list of stop words are useful for performing many tasks in text mining/Natural Language Processing in Hindi language like sentiment analysis, text summarization, question answering etc.
Links
Where it is published
- DOI doi.org/10.17632/bsr3frvvjc.1 ↗
DOI / persistent id · from researchdata tees ac uk
Catalogue records · 1
- OAI-PMH record data.mendeley.com/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Adata… ↗
metadata API · from researchdata tees ac uk
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Engineering · Humanities · Life Sciences · Natural language processing · Social Science
- Inferred from text
- Text 75%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Teesside University Research Data Repository | oai:data.mendeley.com/bsr3frvvjc.1 | 11 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].anzsrc:field:460208 | mapping · researchdata tees ac uk | vocabulary-mapper@1.0.0 | keywords['Natural Language Processing'] |
| concepts[field].local:field:computer-science-ai | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:engineering | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[field].local:field:social-science | mapping · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · researchdata tees ac uk | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/description |
| license | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/rights |
| publication_date | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | |
| title | source · researchdata tees ac uk | connector:researchdata_tees_ac_uk@1.0.0 | /metadata/dc/title |