資源簡介
Yard中文分詞系統(tǒng)采用改進了的正向最大匹配算法,利用雙字哈希進行詞典組織解決了中文分詞中最長詞帶來的分詞效率低下問題。
本次發(fā)布的版本為0.1.1版能對中文詞組進行完美的切分同時利用詞組的詞頻和詞性解決了歧義劃分的問題,但是對人名、地名、組織名、英文、數(shù)字等還不能進行很好的切分,在下一個版本中將解決這些問題。中文詞典應(yīng)用了搜狗實驗室提供的互聯(lián)網(wǎng)詞庫。純java編寫源碼和詞典在附件中可以下載。本軟件為開源軟件你可以進行任何修改以適應(yīng)你的需求,如果你加入了新功能請發(fā)送一份副本給我,我們一同完善改進。
分詞精度為多少?朋友們自己去測試吧不會讓你失望的!!
代碼片段和文件信息
?屬性????????????大小?????日期????時間???名稱
-----------?---------??----------?-----??----
?????文件???????5712??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\InitDictionary.class
?????文件???????2267??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\LastPart.class
?????文件???????1620??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\PartOne.class
?????文件???????1231??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\PartTwo.class
?????文件????????827??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\WordAttribute.class
?????文件????????967??2009-06-11?22:35??Yard0.1.1\bin\net\yard\impl\Pretreatment.class
?????文件???????2921??2009-06-15?11:29??Yard0.1.1\bin\net\yard\impl\SplitEntrance.class
?????文件???????1523??2009-06-11?22:35??Yard0.1.1\bin\net\yard\impl\TokendWords.class
?????文件??????15750??2009-06-15?12:55??Yard0.1.1\bin\net\yard\impl\TokenImpl.class
?????文件????2961902??2009-06-15?11:24??Yard0.1.1\data\SogouLabDic.dic
?????文件?????????60??2009-06-11?16:24??Yard0.1.1\yard.bat
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard\dictionary
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard\impl
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin
?????目錄??????????0??2009-06-15?11:26??Yard0.1.1\data
?????目錄??????????0??2009-06-15?10:37??Yard0.1.1
-----------?---------??----------?-----??----
??????????????2994780????????????????????18
-----------?---------??----------?-----??----
?????文件???????5712??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\InitDictionary.class
?????文件???????2267??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\LastPart.class
?????文件???????1620??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\PartOne.class
?????文件???????1231??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\PartTwo.class
?????文件????????827??2009-06-11?22:35??Yard0.1.1\bin\net\yard\dictionary\WordAttribute.class
?????文件????????967??2009-06-11?22:35??Yard0.1.1\bin\net\yard\impl\Pretreatment.class
?????文件???????2921??2009-06-15?11:29??Yard0.1.1\bin\net\yard\impl\SplitEntrance.class
?????文件???????1523??2009-06-11?22:35??Yard0.1.1\bin\net\yard\impl\TokendWords.class
?????文件??????15750??2009-06-15?12:55??Yard0.1.1\bin\net\yard\impl\TokenImpl.class
?????文件????2961902??2009-06-15?11:24??Yard0.1.1\data\SogouLabDic.dic
?????文件?????????60??2009-06-11?16:24??Yard0.1.1\yard.bat
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard\dictionary
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard\impl
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net\yard
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin\net
?????目錄??????????0??2009-06-15?12:56??Yard0.1.1\bin
?????目錄??????????0??2009-06-15?11:26??Yard0.1.1\data
?????目錄??????????0??2009-06-15?10:37??Yard0.1.1
-----------?---------??----------?-----??----
??????????????2994780????????????????????18
評論
共有 條評論