AuroraMiddleware/scuffed-code
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

ICU-12515 C filtered break

Browse Source 
* sync rbbitst.txt with J
* fix an issue where isBoundary() didn't check the trie's presence

X-SVN-Rev: 39211
This commit is contained in:
Steven R. Loomis 2016-09-13 19:58:55 +00:00
parent b2b4154a9d
commit dea458fef7
2 changed files with 22 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
icu4c/source/common/filteredbrk.cpp
View File

@ -417,7 +417,9 @@ SimpleFilteredSentenceBreakIterator::previous(void) {
}
UBool SimpleFilteredSentenceBreakIterator::isBoundary(int32_t offset) {
if(!fDelegate->isBoundary(offset)) return false; // no break to suppress
if (!fDelegate->isBoundary(offset)) return false; // no break to suppress
if (fData->fBackwardsTrie.isNull()) return true; // no data = no suppressions
UErrorCode status = U_ZERO_ERROR;
resetState(status);

20
icu4c/source/test/testdata/rbbitst.txt vendored
View File

@ -38,7 +38,7 @@
<locale en>
<word>
<data><0>ク<400>ライアン<400>ト<400>サーバー<400></data>
# <data><0>ク<400>ライアン<400>トサーバー<400></data>
## FILTERED BREAK TESTS
@ -53,6 +53,24 @@
<data>\
•In the meantime Mr. Weston arrived with his small ship, which he had now recovered. •Capt. Gorges, who informed the Sgt. here that one purpose of his going east was to meet with Mr. Weston, took this opportunity to call him to account for some abuses he had to lay to his charge.•</data>
# This hits the case where "D." would match the end of "Ph.D.".
<locale en@ss=standard>
<sent>
<data>\
•Doctor with a D. •As in, Ph.D., you know.•</data>
# same as root (unless some exceptions are added!)
<locale tfg@ss=standard>
<sent>
<data>\
•In the meantime Mr. •Weston arrived with his small ship, which he had now recovered. •Capt. •Gorges, who informed the Sgt. here that one purpose of his going east was to meet with Mr. •Weston, took this opportunity to call him to account for some abuses he had to lay to his charge.•</data>
# same as root (unless some exceptions are added!)
<locale ja@ss=standard>
<sent>
<data>\
•In the meantime Mr. •Weston arrived with his small ship, which he had now recovered. •Capt. •Gorges, who informed the Sgt. here that one purpose of his going east was to meet with Mr. •Weston, took this opportunity to call him to account for some abuses he had to lay to his charge.•</data>
## END FILTERED BREAK TESTS