Hachidaishu part of speech dataset
Hilofumi Yamamoto, Bor Hodošček · Zenodo (CERN European Organization for Nuclear Research) · 2021
Hachidaishu part-of-speech dataset This dataset contains the part-of-speech information of the Imperial Anthology of Japanese Poetry and the Hachidaishu. Data offset Example: #1 Kokinshu 10001 年/名/とし の/格助/の 内/名/うち に/格助/に 春/名/はる は/係助/は き/カ変-用:来:く/き に/完-用:ぬ:ぬ/に けり/過-終:けり:けり/けり 一とせ/名/ひととせ を/*助/を こそ/名/こぞ と/格助/と や/係助/や いは/ハ四-未:言ふ:いふ/いは ん/推-終体:む:む/む ことし/名/ことし と/格助/と や/係助/や いは/ハ四-未:言ふ:いふ/いは ん/推-終体:む:む/む A line a poem: tokens are separated by spaces; and a token consists of pos elements separated by slashes. 1st column "10001" contains two elements: the first digit is an anthology ID and the rest is a poem ID; the anthology ID: 1..Kokinshu, 2..Gosenshu, 3..Shuishu, 4..Goshuishu, 5..Kin'yoshu, 6..Shikashu, 7..Senzaishu, and 8..Shinkokinshu. The poem ID is the same as in the database "Nijuichidaishu." 2nd column and the followings are the information of each token. In case of noun and particle, such as tokens not having conjugations: text/POS/reading. In case of verb, adjectives, such as tokens having conjugations: text/POS:lemma-kanji:lemma-reading/reading.