Analysis of the Penn Korean Universal Dependency Treebank (PKT-UD): Manual Revision to Build Robust Parsing Model in Korean

Tae Hwan Oh
Ji Yoon Han
Hyonsu Choe
Seokwon Park
Han He
Jinho D. Choi
Na-Rae Han
Jena D. Hwang
Hansaem Kim
IWPT
2020
View in Semantic Scholar

Abstract

In this paper, we first open on important issues regarding the Penn Korean Universal Treebank (PKT-UD) and address these issues by revising the entire corpus manually with the aim of producing cleaner UD annotations that are more faithful to Korean grammar. For compatibility to the rest of UD corpora, we follow the UDv2 guidelines, and extensively revise the part-of-speech tags and the dependency relations to reflect morphological features and flexible word- order aspects in Korean. The original and the revised versions of PKT-UD are experimented with transformer-based parsing models using biaffine attention. The parsing model trained on the revised corpus shows a significant improvement of 3.0% in labeled attachment score over the model trained on the previous corpus. Our error analysis demonstrates that this revision allows the parsing model to learn relations more robustly, reducing several critical errors that used to be made by the previous model.

1 Introduction

In 2018, Chun et al. (2018) published on three dependency treebanks in Korean that followed the latest guidelines from the Universal Dependencies (UD) project, that was UDv2. These treebanks were automatically derived from the existing treebanks, the Penn Korean Treebank (PKT; Han et al. 2001) , the Google UD Treebank (McDonald et al., 2013) , and the KAIST Treebank (Choi et al., 1994) , using head-finding rules and heuristics.

This paper first addresses the known issues in the original Penn Korean UD Treebank, henceforth PKT-UD v2018, through a sampling-based analysis (Section 3), and then describes the revised guidelines for both part-of-speech tags and dependency relations to handle those issues (Section 4). Then, a transformer-based dependency parsing approach using biaffine attention is introduced (Section 5) to experiment on both PKT-UD v2018 and the revised version, henceforth PKT-UD v2020 (Section 6). Our analysis shows a significantly reduced number of mispredicted labels by the parsing model developed on PKT-UD v2020 compared to the one developed on PKT-UD v2018, confirming the benefit of this revision in parsing performance. The contributions of this work are as follows:

1. Issue checking in PKT-UD v2018.

2. Revised Annotation Guidelines For Korean And

the release of the new corpus, PKT-UD v2020.

3. Development of a robust dependency parsing model using the latest transformer encoder.

2 Related Works

2.1 Korean Ud Corpora

According to the UD project website, 1 three Korean treebanks are officially registered and released: the Google Korean UD Treebank (McDonald et al., 2013) , the Kaist UD Treebank (Choi et al., 1994) , and the Parallel Universal Dependencies Treebank (Zeman et al., 2017) . These treebanks were created by converting and modifying the previously existing treebanks. The Korean portion of the Google UD Treebank had been re-tokenized into the morpheme level in accordance with other Korean corpora, and systematically corrected for several errors (Chun et al., 2018) . The Kaist Korean UD Treebank was derived by automatic conversion using headfinding rules and linguistic heuristics (Chun et al., 2018) . The Parallel Universal Dependencies Treebank was designed for the CoNLL 2017 shared task on Multilingual Parsing, consisting of 1K sentences extracted from newswires and Wikipedia articles. The Penn Korean UD Treebank and the Sejong UD Treebank were registered on the UD website Figure 1 : Example from v2018 and v2020, that translates to "Renault announced last January that it was negotiating an exclusive acquisition with Samsung Motors, and ...". This example continues in Figure 2 .

Figure 1: Example from v2018 and v2020, that translates to “Renault announced last January that it was negotiating an exclusive acquisition with Samsung Motors, and ...”. This example continues in Figure 2.

Figure 2: Continuing example from Figure 1 that translates to “... announced ..., and according to Korean media, the value of Samsung Motors is estimated at 1 trillion won”.

as well but unreleased due to their license issues. Similar to the Kaist UD Treebank, the Penn Korean UD Treebank 2 was automatically converted into UD structures from phrase structure trees (Chun et al., 2018) . The Sejong UD Treebank was also automatically converted from the Sejong Corpus, a phrase structure Treebank consisting of 60K sentences from 6 genres (Choi and Palmer, 2011). In a related effort, the Electronic and Telecommunication Research Institute (ETRI) in Korea conducted a research on standardizing dependency relations and structures (Lim et al., 2015) . This effort resulted in the establishment of standard annotation guidelines of Korean dependencies, giving rise to various related efforts that focused on the establishment of Korean UD guidelines that better represent the unique Korean linguistic features. These studies include Park et al. (2018) who focused on the mapping between the UD part-of-speech (POS) tags and the POS tags in the Sejong Treebank, and and Oh (2019) who provided in-depth discussions of applicability and relevance of UD's dependency relation to Korean.

2.2 Penn Korean Ud Treebank

As mentioned in Section 2.1, the Penn Korean UD Treebank (PKT-UD v2018) was automatically derived from phrase-structure based the Penn Korean Treebank and the results were published by Chun et al. (2018) . Even so, it currently does not number among the Korean UD treebanks officially released corpora under the UD project website. Our effort to officially release Chun et al. (2018) 's PKT-UD v2018 has uncovered numerous mechanical errors caused by the automatic conversion and few other unaddressed issues, leading us to a full revision of this corpus. PKT-UD v2018 made targeted attempts at addressing a number of languagespecific issues regarding complex structures such as empty categories, coordination structures, and allocation of POS tags with respect to dependency relations. However, the efforts were limited, leaving other issues such as handling of copulas, proper allocation of verbs according to their verbal endings, and grammaticalized multi-word expressions were unanswered. Thus, this paper aims to address those remaining issues while revising PKT-UD v2018 to clearly represent phenomena in Korean.

3 Observations In Pkt-Ud V2018

The Penn Korean Treebank (PKT) was originally published as a phrase-structure based treebank by Han et al. (2001) . PKT consists of 5,010 sentences from Korean newswire including 132,041 tokens. 3 Following the UDv2 guidelines, Chun et al. (2018) systematically converted PKT to PKT-UD v2018. While this effort achieved a measure of success at providing phrase-structure-to-dependency conversion in a manner consistent across three different treebanks with distinct grammatical frameworks, it stopped short of addressing more nuanced issues that arise from aligning grammatical features of Korean, that is a heavily agglutinative language, to the universal standards put forth by UDv2. In building PKT-UD v2018, the POS tags were largely mapped in a categorical manner from the Penn Korean POS tagset. The dependency relations on the other hand were established via head-finding rules that relied on Penn Korean Treebank's existing function tags, phrasal tags, and morphemes. Chun et al. (2018) did make a few targeted attempts at teasing apart more fine-grained nuances of grammatical functions. For example, the PKT POS tag (XPOS) DAN was subdivided into the UD POS tag (UPOS) DET for demonstrative prenominals (e.g., 이 (this), 그 (the), and the UPOS ADJ for attributive adjectives (e.g., 새 (new), 헌 (old)) in the recognition that the XPOS DAN, focusing primarily on grammatical distribution, conflated two semantically distinct elements. However, such efforts were limited in scope, and the project did not examine the full breadth of language-specific issues.

Moreover, the converted annotation was found to contain a share of mechanical errors. A case in point, what should have been 5,010 sentences were found to contain 5,036 roots, suggesting low-level parsing errors. Additionally, a manual examination of the first five sentences in the corpus uncovered a variety of syntactic errors that raised an alarm. The worst of the five examined sentences is shown in Figure 1 (and continued in Figure 2 ) with errors in both the UPOS and the dependency relation labels (DEPREL). While we will not delve into particulars of each error seen in this example, the example provides a general sense for the extent of errors existent that merited our attention. These observed issues inspired us to revise PKT-UD v2018, with the aim of producing cleaner syntactic annotations that would be more faithful to the Korean grammar. The following section provides specifics of the revision content.

4.1 Upos Revision

Revision of the UPOS portion of the resource was done from the ground up. That is, instead of correcting PKT-UD v2018's UPOS annotations, we implemented a new mapping from XPOS to UPOS after a careful re-examination of the original mapping schema. In particular, we consulted the POS mapping guidelines by Park et al. (2018) whose morphological tagset, carried over from the Sejong Project (Kim, 2006) , differs from PKT's in some key aspects. However, we found their nuanced view of grammatical characteristics and typology of Korean in reference to the UDv2 very much applicable.

The followings illustrate key ideas of of our UPOS revision approach. Below and throughout this paper, we italicize XPOS labels (e.g., DAN ) so they are visually distinct from UPOS labels (e.g., ADJ).

Copulas mapped to ADJ One major target of revision was the scope of the UPOS adjective label ADJ in Korean, which includes typical predicative adjectives such as '예쁘-' (pretty) and '다르-' (different). As mentioned in Section 3, PKT-UD v2018 already extended the ADJ label to include the closed class of adjectives whose distribution is limited to pre-nominal, attributive use which had been grouped together with the determiner category DAN in the original PKT. In our current work, we further extend the ADJ label to encompass the copula: CO ('-이-' (be)). In Korean, '-이-' (be) is a copula particle that attaches to a nominal to produce a predicate, much like the English 'be'. However, such copula-derived predicates in Korean are known to share semantic and syntactic traits with adjectives rather than verbs, chief among which being their inability to take on the present/habitual aspect verbal ending '-는다' (do) which is only allowed on verbs. In light of this, we made a decision to map all instances of XPOS' CO to UPOS' ADJ.

Consistent Noun Focusing On Morpheme Roles

Korean is well-known as an agglutinative language, and Josas (postpositions) are extremely common nominal suffixes that can indicate a variety of syntactic roles of the whole Eojeol unit (Figure 3 ). For example, when an adverbial case particle ('에', PAD) attaches to a noun, the resulting Eojeol serves the syntactic role of an adverb. When a conjunctive particle ('와', PCJ) is used, the Eojeol functions as a noun conjunct. Consequently, PKT-UD v2018 mapped ADV to the former and CCONJ to the latter.

Figure 3. Not extracted; please refer to original document.

학교 학교+에 학교+와 hakkyo hakkyo+PAD hakkyo+PCJ (school) (at school) (school and) However, this distinction underscores a syntactic role rather than a morphological one: while the syntactic role changes with the attachment of the postposition, the POS of the noun itself remains unaffected. UPOS, as a marker that solely demonstrates morphological characteristics of Eojeol rather than its syntactic function, should reflect the morphological status of the nominal. Therefore, we made a decision to allocate the NOUN label to these cases.

Verbal endings signal VERB Korean has verbal endings on predicates that dictate the syntactic role of Eojeol (Figure 4 ). In PKT-UD v2018, predicates marked with ENM (nominalization verbal ending) and ECS (conjunctive ending) are mapped to NOUN and SCONJ, respectively. However, as with the earlier case involving nominals, these verbal ending suffixes should not be treated as fundamentally altering the underlying POS of the predicate itself. This work revises both cases of UPOS to VERB. Extending the same principle, parallel cases with the same verbal endings involving an adjective or a copula were likewise re-assigned to ADJ.

Figure 4: Korean verbal endings, marked in bold.

먹+다 먹+기 먹+고 mek+ta mek+ki mek+ko (Eat) (Eating) (Eat and)

Table 1: Korean UD Treebanks. Each abbreviations indicate genres of source texts: webblogs(Blog), newswire(News), literatures(Litr), academic(Acdm), manuscripts(Mscr), military(Milt).

Statistics Of V2018 And V2020

The complete distributions of PKT-UD v2018 and v2020 are listed in Table 2

Table 2: Universal POS tagset comparison between the 2018 and 2020 versions of the Penn Universal Dependency Treebank. v2018/v2020: the number of tokens in those versions respectively, PC: percentage change.

The complete DE-PREL distributions of PKT-UD v2018 and v2020 are listed in Table 3 . Table 3 : Universal dependency label comparison between v2018 and v2020 of the Penn Universal Dependency Treebank. v2018/v2020: the number of tokens in those versions respectively, PC: percentage change. Figure 7 : Revision of the DEPREL of the separated postposition 을 at "'하늘'을 봐 (Look at the 'sky')" in PKT-UD v2020, where case relation for orphaned postposition revised to goeswith.

Table 3: Universal dependency label comparison between v2018 and v2020 of the Penn Universal Dependency Treebank. v2018/v2020: the number of tokens in those versions respectively, PC: percentage change.

DEPREL

4.2 Deprel Revision

In re-examining PTK-UD v2018's dependency relations, we consulted two existing dependency annotation guidelines for Korean: and Oh (2019) . They offer a thorough analysis on applicability of the universal dependency relation labels to Korean, and further identify a list of dependency relations such as iobj, xcomp, expl, and cop (among others) as not suited for capturing characteristics of Korean grammar. Additionally, where applicable, we took into consideration the UD Japanese Treebank , since Japanese exhibits many parallel syntactic phenomena as another strictly head-final agglutinative language .

Reevaluation Of Iobj

We turned our attention to iobj, the DEPREL label for indirect object. We found PKT-UD v2018's decision to assign nominals with dative case markings to iobj questionable, for the following reasons. First, unlike English, where word order distinguishes indirect objects from direct objects (e.g. "She gave me:iobj a box:obj"), Korean has no such structural constraint that forms the basis for identifying instances of iobj. The only potential identifier, then, is dative postpositions such as '-에게'(to) and '-한테'(by), which correspond roughly to English preposition 'to' as in "She gave it to me". The problem is, these markers do not exclusively encode the dative case, as seen in examples such as "개에게 물렸다" ("I was bit by a dog").

Hence, we adopted a new approach of reassigning all instances of iobj to the oblique relation obl. This move brings language-internal consistency, as postpositions, in many instances, can simply be dropped if contextually recoverable, rendering any such nominals practically indistinguishable from other nominal adverbials that are assigned to obl. This overall approach is also in line with UD Japanese Treebank, where iobj is categorically absent and 'に (ni)', a postposition whose usage largely parallels the two Korean postpositions above, mapping to obl. Figure 5 , Korean predicates take on various syntactic functions depending on the attached verbal ending. Predicates with the declarative verbal ending '-다' (ta) are assigned to root, which is straightforward. Endings '-은' (un) and '-을' (ul) on the other hand turn the verb into a modifier to an upcoming noun; the acl relation therefore is the best fit here. Predicates with endings such as '-어서' (ese) and '-게' (key) modify other predicates, which calls for an advcl assignment. In PKT-UD v2018, these cases had received an array of inconsistent allocations such as clausal complements (ccomp/xcomp), auxiliaries (aux), and conjuncts (conj). These were corrected to acl and advcl.

Figure 5: Examples of Korean verbal ending.

먹+다

먹+은/을 먹+어서 mek-ta mek-un/ul mek-ese (eat) (ate/to-eat) (eat because)

Orphaned Postpositions And Verbal Endings

In Korean, verbal endings and postpositions are bound to verbs and nominals, respectively, and cannot occupy their own Eojeol. In natural text, however, they can occasionally be separated from the constituent they attach to via quotation marks, white spaces, or parentheses. PKT-UD v2018 had assigned such orphaned bound morphemes to UPOS of PART (particle) and ADP (adposition) with the DEPREL of mark (marker) and case (case marker), respectively as seen in Figure 6 . However, verbal endings and postpositions can express syntactic function only if they are attached to their modifying predicates and nominals. While PKT-UD v2018's assignment of the UPOS and DEPREL are not categorically incorrect, they address morphological relationship between these morphemes rather than their syntactic relationship. That is, even if these bound morphemes are notationally distanced from their heads by punctuation or white spaces, they form a single syntactic unit with their nominals and postpositions. Hence, mark and case were updated to goeswith, used for divided words as seen in Figure 7 , making it clear that the seemingly separate Eojeols (e.g. nominal and postposition) are actually one unit.

Figure 6: PKT-UD v2018 treatment of separated postposition ‘-을’ (ul) in "‘하늘’을봐 (Look at the ‘sky’)".

Figure 7: Revision of the DEPREL of the separated postposition 을 at "‘하늘’을 봐 (Look at the ‘sky’)" in PKT-UD v2020, where case relation for orphaned postposition revised to goeswith.

Orphaned copulas Similar revisions were applied to copulas. Korean copula morpheme '-이-' (i) combines with a nominal on the left and a verbal ending to the right. These copulas too can occasionally be detached via intervening punctuation or white space. To such cases, PKT-UD v2018 had assigned cop as the DEPREL. These instances have been updated to goeswith in accordance with the treatment given to verbal endings and postpostions.

roots and flats The number of root is adjusted from 5,036 to 5,010 after correcting sentences with zero or more roots. Additionally, DE-PREL of Eojeols that used to be incorrectly mapped to compound are now assigned to flat.

5 Parsing Approach

Our dependency parsing model is based on the biaffine parser using contextualized embeddings such as BERT (Devlin et al., 2019) that has shown the state-of-the-art results on both syntactic and semantic dependency parsing tasks in multiple languages (He and Choi, 2020) . This model is simplified from the original biaffine parser introduced by Dozat and Manning (2017) such that trainable token embeddings are removed and lemmas are used instead of word forms. This section proposes an even more simplified model that no longer uses embeddings from POS tags, so it can be easily adapted to languages that do not have dedicated POS taggers, and drops the Bidirectional LSTM encoder while integrating the transformer layers directly into the biaffine decoder so that it minimizes the redundancy of having multiple encoders for the generation of contextualized embeddings. Given an input sentence, every token w i is first segmented into one or more sub-tokens by the Sen-tencePiece tokenizer (Kudo and Richardson, 2018) and fed into a transformer. The output embedding corresponding to the first sub-token of w i is treated as the embedding representation of w i , say e i , and fed into four types of multilayer perceptron (MLP) layers to extract features for w i being a head (*-h) or a dependent (*-d) for the arc relations (arc-*) and the labels (rel-*) (k and l are the dimensions of the arc and label representations, respectively):

h (arc-h) i = MLP (arc-h) (e i ) ∈ R k×1 h (arc-d) i = MLP (arc-d) (e i ) ∈ R k×1 h (rel-h) i = MLP (rel-h) (e i ) ∈ R l×1 h (rel-d) i = MLP (rel-d) (e i ) ∈ R l×1

All feature vectors, h * 1 , . . . , h * n , from each representation are stacked into a matrix (n is the number

1 1 1 1 ✕ ✕ = 1 1 1 1 = ✕ ✕ ✕ + MLP (arc-h)

< l a t e x i t s h a 1 _ b a s e 6 4 = "

Y O j G C a 0 F 6 q z E k 1 B N K K O N G f R v 9 y 8 = " > A A A C B H i c b V A 7 S w N B E J 6 L r 3 i + o p Z p D o M Q C 8 O d j T Z i 0 M Z C I Y J 5 Q B L D 3 m a T L N l 7 s D s n h u N A G / + K j Y U i t r b 2 d v 4 b N 4 9 C E z 8 Y + P i + G W b m c 0 P B F d r 2 t 5 G a m 1 9 Y X E o v m y u r a + s b m c 2 t i g o i S V m Z B i K Q N Z c o J r j P y s h R s F o o G f F c w a p u / 2 z o V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + 7 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V O f e E w 1 4 9 E T i b W r l b b V C a Q u H 6 2 R + n s i J p 5 S A 8 / V n c O T 1 b Q 3 F P / z 6 h F 2 j p o x 9 8 M I m U / H i z q R s D C w h o l Y b S 4 Z R T H Q h F D J 9 a 0 W 7 R F J K O r c T B 2 C M / 3 y L K k c F B y 7 4 F z Z u e I p j J G G L O x A H h w 4 h C K c Q w n K Q O E B n u A F X o 1 H 4 9 l 4 M 9 7 H r S l j M r M N f 2 B 8 / A A U W 5 n b < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " V R F A l + d f + s 3 j e P + h y 0 Z W X z / O W c 8 = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f p 5 Z p D o M Q C 8 O d j T Z i 0 M Z C I Y L 5 g N w Z 9 j a b Z M n e B 7 t z Y j i u s P G P W N h Y K G J r a 2 8 j / h v 3 k h S a + G D g 8 d 4 M M / O 8 i D M J l v W t z c z O z S 8 s 5 p b 0 5 Z X V t X V j Y 7 M m w 1 g Q W i U h D 0 X D w 5 J y F t A q M O C 0 E Q m K f Y / T u t c / z f z 6 D R W S h c E V D C L q + r g b s A 4 j G J T U M v K O j 6 E n / O T i v J J e O 0 B v I S l i Q f Z 6 u 2 n L K F g l a w h z m t h j U j j + 0 I + i h y + 9 0 j I + n X Z I Y p 8 G Q D i W s m l b E b g J F s A I p 6 n u x J J G m P R x l z Y V D b B P p Z s M n 0 j N H a W 0 z U 4 o V A V g D t X f E w n 2 p R z 4 n u r M T p a T X i b + 5 z V j 6 B y 6 C Q u i G G h A R o s 6 M T c h N L N E z D Y T l A A f K I K J Y O p W k / S w w A R U b r o K w Z 5 8 e Z r U 9 k u 2 V b I v r U L 5 B I 2 Q Q 3 m 0 j Y r I R g e o j M 5 Q B V U R Q X f o E T 2 j F +

1 e e 9 J e t b d R 6 4 w 2 n t l C f 6 C 9 / w A F 6 p t P < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " V R F A l + d f + s 3 j e P + h y 0 Z W X z / O W c 8 = " > A A A C B H i c b

V A 9 S w N B E N 3 z M 5 5 f p 5 Z p D o M Q C 8 O d j T Z i 0 M Z C I Y L 5 g N w Z 9 j a b Z M n e B 7 t z Y j i u s P G P W N h Y K G J r a 2 8 j / h v 3 k h S a + G D g 8 d 4 M M / O 8 i D M J l v W t z c z O z S 8 s 5 p b 0 5 Z X V t X V j Y 7 M m w 1 g Q W i U h D 0 X D w 5 J y F t A q M O C 0 E Q m K f Y / T u t c / z f z 6 D R W S h c E V D C L q + r g b s A 4 j G J T U M v K O j 6 E n / O T i v J J e O 0 B v I S l i Q f Z 6 u 2 n L K F g l a w h z m t h j U j j + 0 I + i h y + 9 0 j I + n X Z I Y p 8 G Q D i W s m l b E b g J F s A I p 6 n u x J J G m P R x l z Y V D b B P p Z s M n 0 j N H a W 0 z U 4 o V A V g D t X f E w n 2 p R z 4 n u r M T p a T X i b + 5 z V j 6 B y 6 C Q u i G G h A R o s 6 M T c h N L N E z D Y T l A A f K I K J Y O p W k / S w w A R U b r o K w Z 5 8 e Z r U 9 k u 2 V b I v r U L 5 B I 2 Q Q 3 m 0 j Y r I R g e o j M 5 Q B V U R Q X f o E T 2 j F +

1 e e 9 J e t b d R 6 4 w 2 n t l C f 6 C 9 / w A F 6 p t P < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " a 2 k C N s F

K I G D G L z m w u 9 1 C K p A 1 Q F U = " > A A A C B H i c b V B N S 8 N A E N 3 U r 1 q / o h 5 7 C R a h H i y J F z 0 W v X h Q q G A / o I 1 l s 9 2 0 S 3 e T s D s R S 8 j B i 3 / F i w d F v P o j v P l v 3 L Q 5 a O u D g c d 7 M 8 z M 8 y L O F N j 2 t 1 F Y W l 5 Z X S u u l z Y 2 t 7 Z 3 z N 2 9 l g p j S W i T h D y U H Q 8 r y l l A m 8 C A 0 0 4 k K R Y e p 2 1 v f J H 5 7 X s q F Q u D W 5 h E 1 B V 4 G D C f E Q x a 6 p v l n s A w k i K 5 v m q k d z 2 g D 5 B U s S T H o 6 O 0 b 1 b s m j 2 F t U i c n F R Q j k b f / O o N Q h I L G g D h W K m u Y 0 f g J l g C I 5 y m p V 6 s a I T J G A 9 p V 9 M A C 6 r c Z P p E a h 1 q Z W D 5 o d Q V g D V V f 0 8 k W C g 1 E Z 7 u z E 5 W 8 1 4 m / u d 1 Y / D P 3 I Q F U Q w 0 I L N F f s w t C K 0 s E W v A J C X A J 5 p g I p m + 1 S I j L D E B n V t J h + D M v 7 x I W i c 1 x 6 4 5 N 3 a l f p 7 H U U R l d I C q y E G n q I 4 u U Q M 1 E U G P 6 B m 9 o j f j y X g x 3 o 2 P W W v B y G f 2 0 R 8 Y n z + l F J g O < / l a t e x i t > MLP (arc-d) < l a t e x i t s h a 1 _ b a s e 6 4 = " Y 4 E Q E D w f s G N G d j k N N 2 q d W S x 5 Z S M = " > A A A C B H i c b V A 7 S w N B E J 6 L r 3 i + o p Z p D o M Q C 8 O d j T Z i 0 M Z C I Y J 5 Q B L D 3 m a T L N l 7 s D s n h u N A G / + K j Y U i t r b 2 d v 4 b N 4 9 C E z 8 Y + P i + G W b m c 0 P B F d r 2 t 5 G a m 1 9 Y X E o v m y u r a + s b m c 2 t i g o i S V m Z B i K Q N Z c o J r j P y s h R s F o o G f F c w a p u / 2 z o V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + + 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V O f e E w 1 4 9 E T i b W r l b b V C a Q u H 6 2 R + n s i J p 5 S A 8 / V n c O T 1 b Q 3 F P / z 6 h F 2 j p o x 9 8 M I m U / H i z q R s D C w h o l Y b S 4 Z R T H Q h F D J 9 a 0 W 7 R F J K O r c T B 2 C M / 3 y L K k c F B y 7 4 F z Z u e I p j J G G L O x A H h w 4 h C K c Q w n K Q O E B n u A F X o 1 H 4 9 l 4 M 9 7 H r S l j M r M N f 2 B 8 / A A O Q 5 n X < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4 v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A e 6 b C G p g H x m W o m w y c G e E c r b e y F U l c A e K j + n k i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M / o x b g 3 n o x X 4 2 3 U O m O M Z 7 b Q H x j v P / / D m 0 s = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4 v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A e 6 b C G p g H x m W o m w y c G e E c r b e y F U l c A e K j + n k i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M / o x b g 3 n o x X 4 2 3 U O m O M Z 7 b Q H x j v P / / D m 0 s = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " h P + 6 L r U f 2 d 3 t Z a l d q a Q Q v E K M X y w = " > A A A B 2 X i c b Z D N S g M x F I X v 1 L 8 6 V q 1 r N 8 E i u C o z b n Q p u H F Z w b Z C O 5 R M 5 k 4 b m s k M y R 2 h D H 0 B F 2 5 E f C 9 3 v o 3 p z 0 J b D w Q + z k n I v S c u l L Q U B N 9 e b W d 3 b / + g f u g f N f z j k 9 N m o 2 f z 0 g j s i l z l 5 j n m F p X U 2 C V J C p 8 L g z y L F f b j 6 f 0 i 7 7 + g s T L X T z Q r M M r 4 W M t U C k 7 O 6 o y a r a A d L M W 2 I V x D C 9 Y a N b + G S S 7 K D D U J x a 0 d h E F B U c U N S a F w 7 g 9 L i w U X U z 7 G g U P N M 7 R R t R x z z i 6 d k 7 A 0 N + 5 o Y k v 3 9 4 u K Z 9 b O s t j d z D h N 7 G a 2 M P / L B i W l t 1 E l d V E S a r H 6 K C 0 V o 5 w t d m a J N C h I z R x w Y a S b l Y k J N 1 y Q a 8 Z 3 H Y S b G 2 9 D 7 7 o d B u 3 w M Y A 6 n M M F X E E I N 3 A H D 9 C B L g h I 4

B X e v Y n 3 5 n 2 s u q p 5 6 9 L O 4 I + 8 z x 8 4 x I o 4 < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " C b K 0 9 L o l 6 b l 2 4 S e 0 X i t j 7 o 5

x b Y l p 8 = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " C b K 0 9 L o l 6 b l 2 4 S e 0 X i t j 7 o 5

+ 3 M M = " > A A A B + X i c b Z D N S s N A F I V v 6 l + t V a P b b o J F q A t L 4 k a X g h s X C h V s K z S x T C a T d u j k h 5 k b s Y Q u 3 P g q b l w o 4 o u 4 8 2 2 c t F 1 o 6 4 G B j 3 N m m H u P n w q u 0 L a / j d L K 6 t r 6 R n m z s l X d 3 t k 1 9 6 o d l W S S s j Z N R C L v f K K Y 4 D F r I 0 f B 7 l L J S O Q L 1 v V H F 0 X e f W B S 8 S S + x X H K v I g M Y h 5 y S l B b f b P m R g S H M s q v r 1 q T e x f Z I + Y N I u l x c D T p m 3 W 7 a U 9 l L Y M z h z r M 1 e q b X 2 6 Q 0 C x i M V J B l O o 5 d o p e T i R y K t i k 4 m a K p Y S O y I D 1 N M Y k Y s r L p 0 t M r E P t B F a Y S H 1 i t K b u 7 x c 5 i Z Q a R 7 6 + W Y y s F r P C / C / r Z R i e e T m P 0 w x Z T G c f h Z m w M L G K R q y A S 0 Z R j D U Q K r m e 1 a J D I g l F 3 V t F l + A s r r w M n Z O m Y z e d G x v K U I M D a I A D p 3 A O l 9 C C N l B 4 g h d 4 g 3 f j 2 X g 1 P m Z 1 l Y x 5 b / v w R 8 b n D x b Y l p 8 = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I C k a X S L 7 m B 1 k O 9 w Q P S J b o J 3 Z H O o = " > A A A C B H i c b V C 7 T s N A E D y H V w g v A 2 U a i w g p F E Q 2 D Z Q R N B Q g B Y k 8 p N h E 5 / M 5 O e X 8 0 N 0 a E V k u a P g V G g o Q o u U j 6 P g b z o k L S B h p p d H M r n Z 3 3 J g z C a b 5 r Z W W l l d W 1 8 r r l Y 3 N r e 0 d f X e v I 6 N E E N o m E Y 9 E z 8 W S c h b S N j D g t B c L i g O X 0 6 4 7 v s j 9 7 j 0 V k k X h L U x i 6 g R 4 G D K f E Q x K G u h V O 8 A w E k F 6 f d X K 7 m y g D 5 D W s S D H 3 l E 2 0 G t m w 5 z C W C R W Q W q o Q G u g f 9 l e R J K A h k A 4 l r J v m T E 4 K R b A C K d Z x U 4 k j T E Z 4 y H t K x r i g E o n n T 6 R G Y d K 8 Q w / E q p C M K b q 7 4 k U B 1 J O A l d 1 5 i f L e S 8 X / / P 6 C f h n T s r C O A E a k t k i P + E G R E a e i O E x Q Q n w i S K Y C K Z u N c g I C 0 x A 5 V Z R I V j z L y + S z k n D M h v W j V l r n h d x l F E V H a A 6 s t A p a q J L 1 E J t R N

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = "

I C k a X S L 7 m B 1 k O 9 w Q P S J b o J 3 Z H O o = " > A A A C B H i c b V C 7 T s N A E D y H V w g v A 2 U a i w g p F E Q 2 D Z Q R N B Q g B Y k 8 p N h E 5 / M 5 O e X 8 0 N 0 a E V k u a P g V G g o Q o u U j 6 P g b z o k L S B h p p d H M r n Z 3 3 J g z C a b 5 r Z W W l l d W 1 8 r r l Y 3 N r e 0 d f X e v I 6 N E E N o m E Y 9 E z 8 W S c h b S N j D g t B c L i g O X 0 6 4 7 v s j 9 7 j 0 V k k X h L U x i 6 g R 4 G D K f E Q x K G u h V O 8 A w E k F 6 f d X K 7 m y g D 5 D W s S D H 3 l E 2 0 G t m w 5 z C W C R W Q W q o Q G u g f 9 l e R J K A h k A 4 l r J v m T E 4 K R b A C K d Z x U 4 k j T E Z 4 y H t K x r i g E o n n T 6 R G Y d K 8 Q w / E q p C M K b q 7 4 k U B 1 J O A l d 1 5 i f L e S 8 X / / P 6 C f h n T s r C O A E a k t k i P + E G R E a e i O E x Q Q n w i S K Y C K Z u N c g I C 0 x A 5 V Z R I V j z L y + S z k n D M h v W j V l r n h d x l F E V H a A 6 s t A p a q J L 1 E J t R N

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g

C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4 v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A e 6 b C G p g H x m W o m w y c G e E c r b e y F U l c A e K j + n k i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M / o x b g 3 n o x X 4 2 3 U O m O M Z 7 b Q H x j v P / / D m 0 s = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4 v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A e 6 b C G p g H x m W o m w y c G e E c r b e y F U l c A e K j + n k i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M / o x b g 3 n o x X 4 2 3 U O m O M Z 7 b Q H x j v P / / D m 0 s = < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4 v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A

i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M / o x b g 3 n o x X 4 2 3 U O m O M Z 7 b Q H x j v

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y z e 2 d p n 7 t h k n F w + A K + h F r + q Q T c I 9 T A l p q Z X O O T 6 A r / e T i v D y 4 d o D d Q l I g k u 6 1 d w e t b N 4 q W k P g a W K P S f 7 4 w z y K H r 7 M c i v 7 6 b R D G v s s A C q I U g 3 b i q C Z E A m c C j Y w n V i x i N A

V C 7 T s N A E D y H V w g v A 2 U a i w g p F E Q 2 D Z Q R N B Q g B Y k 8 p N h E 5 / M 5 O e X 8 0 N 0 a E V k u a P g V G g o Q o u U j 6 P g b z o k L S B h p p d H M r n Z 3 3 J g z C a b 5 r Z W W l l d W 1 8 r r l Y 3 N r e 0 d f X e v I 6 N E E N o m E Y 9 E z 8 W S c h b S N j D g t B c L i g O X 0 6 4 7 v s j 9 7 j 0 V k k X h L U x i 6 g R 4 G D K f E Q x K G u h V O 8 A w E k F 6 f d X K 7 m y g D 5 D W s S D H 3 l E 2 0 G t m w 5 z C W C R W Q W q o Q G u g f 9 l e R J K A h k A 4 l r J v m T E 4 K R b A C K d Z x U 4 k j T E Z 4 y H t K x r i g E o n n T 6 R G Y d K 8 Q w / E q p C M K b q 7 4 k U B 1 J O A l d 1 5 i f L e S 8 X / / P 6 C f h n T s r C O A E a k t k i P + E G R E a e i O E x Q Q n w i S K Y C K Z u N c g I C 0 x A 5 V Z R I V j z L y + S z k n D M h v W j V l r n h d x l F E V H a A 6 s t A p a q J L 1 E J t R N

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > MLP (rel-h) < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e

h (rel-h) i < l a t e x i t s h a 1 _ b a s e 6 4 = " I r C f X k m L i W B t o l o J f v d z z / R U 4 z 8 = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v q G W a w y D E w n A n g p Z B G 8 s I 5 g N y M e x t 5 n J L 9 j 7 Y n R P D c Y W N f 8 X G Q h F b f 4 S d / 8 a 9 J I U m P h h 4 v D f D z D w 3 F l y h Z X 0 b S 8 s r q 2 v r h Y 3 i 5 t b 2 z m 5 p b 7 + l o k Q y a L J I R L L j U g W C h 9 B E j g I 6 s Q Q a u A L a 7 u g q 9 9 v 3 I B W P w l s c x 9 A L 6 D D k H m c U t d Q v l Z 2 A o u 9 6 q Z / 1 + Z 2 D 8 I B p V Y I 4 8 Y + z f q l i 1 a w J z E V i z 0 i F z N D o l 7 6 c Q c S S A E J k g i r V t a 0 Y e y m V y J m A r O g k C m L K R n Q I X U 1 D G o D q p Z M n M v N I K w P T i 6 S u E M 2 J + n s i p Y F S 4 8 D V n f n J a t 7 L x f + 8 b o L e R S / l Y Z w g h G y 6 y E u E i Z G Z J 2 I O u A S G Y q w J Z Z L r W 0 3 m U 0 k Z 6 t y K O g R 7 / u V F 0 j q t 2 V b N v

I r C f X k m L i W B t o l o J f v d z z / R U 4 z 8 = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v q G W a w y D E w n A n g p Z B G 8 s I 5 g N y M e x t 5 n J L 9 j 7 Y n R P D c Y W N f 8 X G Q h F b f 4 S d / 8 a 9 J I U m P h h 4 v D f D z D w 3 F l y h Z X 0 b S 8 s r q 2 v r h Y 3 i 5 t b 2 z m 5 p b 7 + l o k Q y a L J I R L L j U g W C h 9 B E j g I 6 s Q Q a u A L a 7 u g q 9 9 v 3 I B W P w l s c x 9 A L 6 D D k H m c U t d Q v l Z 2 A o u 9 6 q Z / 1 + Z 2 D 8 I B p V Y I 4 8 Y + z f q l i 1 a w J z E V i z 0 i F z N D o l 7 6 c Q c S S A E J k g i r V t a 0 Y e y m V y J m A r O g k C m L K R n Q I X U 1 D G o D q p Z M n M v N I K w P T i 6 S u E M 2 J + n s i p Y F S 4 8 D V n f n J a t 7 L x f + 8 b o L e R S / l Y Z w g h G y 6 y E u E i Z G Z J 2 I O u A S G Y q w J Z Z L r W 0 3 m U 0 k Z 6 t y K O g R 7 / u V F 0 j q t 2 V b N v

v d m 1 u S w W 9 W M q O d K M 1 n A = " > A A A C B H i c b V D J S g N B E O 1 x j X G L e s x l M A j x Y J g R Q Y 9 B L x 4 U I p g F M m P o 6 d Q k T X o W u m v E M M z B i 7 / i x Y M i X v 0 I b / 6 N n e W g i Q 8 K H u 9 V U V X P i w V X a F n f x s L i 0 v L K a m 4 t v 7 6 x u b V d 2 N l t q C i R D O o s E p F s e V S B 4 C H U k a O A V i y B B p 6 A p j e 4 G P n N e 5 C K R + E t D m N w A 9 o L u c 8 Z R S 1 1 C k U n o N i X Q X p 9 V c v u H I Q H T M s S x F H / M O s U S l b F G s O c J / a U l M g U t U 7 h y + l G L A k g R C a o U m 3 b i t F N q U T O B G R 5 J 1 E Q U z a g P W h r G t I A l J u O n 8 j M A 6 1 0 T T + S u k I 0 x + r v i Z Q G S g 0 D T 3 e O T l a z 3 k j 8 z 2 s n 6 J + 5 K Q / j B C F k k 0 V + I k y M z F E i Z p d L Y C i G m l A m u b 7 V Z H 0 q K U O d W 1 6 H Y M + + P E 8 a x x X b q t g 3 J 6 X q + T S O H C m S f V I m N j k l V X J J a q R O G H k k z + S V v B l P x o v

x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e

c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e

c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > MLP (rel-d) < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b

h (rel-d) i < l a t e x i t s h a 1 _ b a s e 6 4 = " L K / Z 6 d b o 7 y n v g u h e V k u J 0 Y 3 B D X o = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v q G W a w y D E w n A n g p Z B G 8 s I 5 g N y M e z t z S V L 9 j 7 Y n R P D c Y W N f 8 X G Q h F b f 4 S d / 8 a 9 J I U m P h h 4 v D f D z D w 3 F l y h Z X 0 b S 8 s r q 2 v r h Y 3 i 5 t b 2 z m 5 p b 7 + l o k Q y a L J I R L L j U g W C h 9 B E j g I 6 s Q Q a u A L a 7 u g q 9 9 v 3 I B W P w l s c x 9 A L 6 C D k P m c U t d Q v l Z 2 A 4 t D 1 0 2 H W 5 3 c O w g O m V Q n i x D v O + q W K V b M m M B e J P S M V M k O j X / p y v I g l A Y T I B F W q a 1 s x 9 l I q k T M B W d F J F M S U j e g A u p q G N A D V S y d P Z O a R V j z T j 6 S u E M 2 J + n s i p Y F S 4 8 D V n f n J a t 7 L x f + 8 b o L + R S / l Y Z w g h G y 6 y E + E i Z G Z J 2 J 6 X A J D M d a E M s n 1 r S Y b U k k Z 6 t y K O g R 7 / u V F 0 j q t 2 V b N v

v g u h e V k u J 0 Y 3 B D X o = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v q G W a w y D E w n A n g p Z B G 8 s I 5 g N y M e z t z S V L 9 j 7 Y n R P D c Y W N f 8 X G Q h F b f 4 S d / 8 a 9 J I U m P h h 4 v D f D z D w 3 F l y h Z X 0 b S 8 s r q 2 v r h Y 3 i 5 t b 2 z m 5 p b 7 + l o k Q y a L J I R L L j U g W C h 9 B E j g I 6 s Q Q a u A L a 7 u g q 9 9 v 3 I B W P w l s c x 9 A L 6 C D k P m c U t d Q v l Z 2 A 4 t D 1 0 2 H W 5 3 c O w g O m V Q n i x D v O + q W K V b M m M B e J P S M V M k O j X / p y v I g l A Y T I B F W q a 1 s x 9 l I q k T M B W d F J F M S U j e g A u p q G N A D V S y d P Z O a R V j z T j 6 S u E M 2 J + n s i p Y F S 4 8 D V n f n J a t 7 L x f + 8 b o L + R S / l Y Z w g h G y 6 y E + E i Z G Z J 2 J 6 X A J D M d a E M s n 1 r S Y b U k k Z 6 t y K O g R 7 / u V F 0 j q t 2 V b N v

V A 9 S w N B E N 3 z M 8 a v U 8 s 0 h 0 G I h e F O B C 2 D N h Y K E c w H J G f Y 2 5 s k S / Y + 2 J 0 T w 5 H C x r 9 i Y 6 G I r T / C z n / j X p J C E x 8 M P N 6 b Y W a e F w u u 0 L a / j Y X F p e W V 1 d x a f n 1 j c 2 v b 3 N m t q y i R D G o s E p F s e l S B 4 C H U k K O A Z i y B B p 6 A h j e 4 y P z G P U j F o / A W h z G 4 A e 2 F v M s Z R S 1 1 z E I 7 o N i X Q X p 9 V R 3 d t R E e M C 1 J E E f + 4 a h j F u 2 y P Y Y 1 T 5 w p K Z I p q h 3 z q + 1 H L A k g R C a o U i 3 H j t F N q U T O B I z y 7 U R B T N m A 9 q C l a U g D U G 4 6 f m J k H W j F t 7 q R 1 B W i N V Z / T 6 Q 0 U G o Y e L o z O 1 n N e p n 4 n 9 d K s H v m p j y M E 4 S Q T R Z 1 E 2 F h Z G W J W D 6 X w F A M N a F M c n 2 r x f p U U o Y 6 t 7 w O w Z l 9 e Z 7 U j 8 u O X X Z u T o q V 8 2 k c O V I g + 6 R E H H J K K u S S V E m N M P J I n s k r e

T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b

J E E f + 4 a h j F u 2 y P Y Y 1 T 5 w p K Z I p q h 3 z q + 1 H L A k g R C a o U i 3 H j t F N q U T O B I z y 7 U R B T N m A 9 q C l a U g D U G 4 6 f m J k H W j F t 7 q R 1 B W i N V Z / T 6 Q 0 U G o Y e L o z O 1 n N e p n 4 n 9 d K s H v m p j y M E 4 S Q T R Z 1 E 2 F h Z G W J W D 6 X w F A M N a F M c n 2 r x f p U U o Y 6 t 7 w O w Z l 9 e Z 7 U j 8 u O X X Z u T o q V 8 2 k c O V I g + 6 R E H H J K K u S S V E m N M P J I n s k r e T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v U 8 s 0 h 0 G I h e F O B C 2 D N h Y K E c w H J G f Y 2 5 s k S / Y + 2 J 0 T w 5 H C x r 9 i Y 6 G I r T / C z n / j X p J C E x 8 M P N 6 b Y W a e F w u u 0 L a / j Y X F p e W V 1 d x a f n 1 j c 2 v b 3 N m t q y i R D G o s E p F s e l S B 4 C H U k K O A Z i y B B p 6 A h j e 4 y P z G P U j F o / A W h z G 4 A e 2 F v M s Z R S 1 1 z E I 7 o N i X Q X p 9 V R 3 d t R E e M C 1 J E E f + 4 a h j F u 2 y P Y Y 1 T 5 w p K Z I p q h 3 z q + 1 H L A k g R C a o U i 3 H j t F N q U T O B I z y 7 U R B T N m A 9 q C l a U g D U G 4 6 f m J k H W j F t 7 q R 1 B W i N V Z / T 6 Q 0 U G o Y e L o z O 1 n N e p n 4 n 9 d K s H v m p j y M E 4 S Q T R Z 1 E 2 F h Z G W J W D 6 X w F A M N a F M c n 2 r x f p U U o Y 6 t 7 w O w Z l 9 e Z 7 U j 8 u O X X Z u T o q V 8 2 k c O V I g + 6 R E H H J K K u S S V E m N M P J I n s k r e T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > MLP (arc-h) < l a t e x i t s h a 1 _ b a s e 6 4 = " Y O j G C a 0 F 6 q z E k 1 B N K K O N G f R v 9 y 8 = " > A A A C B H i c b

V A 7 S w N B E J 6 L r 3 i + o p Z p D o M Q C 8 O d j T Z i 0 M Z C I Y J 5 Q B L D 3 m a T L N l 7 s D s n h u N A G / + K j Y U i t r b 2 d v

V m Z B i K Q N Z c o J r j P y s h R s F o o G f F c w a p u / 2 z o V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + 7 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V

8 e Z r U 9 k u 2 V b I v r U L 5 B I 2 Q Q 3 m 0 j Y r I R g e o j M 5 Q B V U R Q X f o E T 2 j F + 1 e e 9 J e t b d R 6 4 w 2 n t l C f 6 C 9 / w A F 6 p t P < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " V R F A l + d f + s 3 j e P + h y 0 Z W X z / O W c 8 = " > A A A C B H i c b

8 e Z r U 9 k u 2 V b I v r U L 5 B I 2 Q Q 3 m 0 j Y r I R g e o j M 5 Q B V U R Q X f o E T 2 j F + 1 e e 9 J e t b d R 6 4 w 2 n t l C f 6 C 9 / w A F 6 p t P < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " a 2 k C N s F K I G D G L z m w u 9 1 C K p A 1 Q F U = " > A A A C B H i c b

V B N S 8 N A E N 3 U r 1 q / o h 5 7 C R a h H i y J F z 0 W v X h Q q G A / o I 1 l s 9 2 0 S 3 e T s D s R S 8 j B i 3 / F i w d F v P o j v P l v 3 L Q 5 a O u D g c d 7 M 8 z M 8 y L O F N j 2 t 1 F Y W l 5 Z X S u u l z Y 2 t 7 Z 3 z N 2 9 l g p j S W i T h D y U H Q 8 r y l l A m 8 C A 0 0 4 k K R Y e p 2 1 v f J H 5 7 X s q F Q u D W 5 h E 1 B V 4 G D C f E Q x a 6 p v l n s A w k i K 5 v m q k d z 2 g D 5 B U s S T H o 6 O 0 b 1 b s m j 2 F t U i c n F R Q j k b f / O o N Q h I L G g D h W K m u Y 0 f g J l g C I 5 y m p V 6 s a I T J G A 9 p V 9 M A C 6 r c Z P p E a h 1 q Z W D 5 o d Q V g D V V f 0 8 k W C g 1 E Z 7 u z E 5 W 8 1 4 m / u d 1 Y / D P 3 I Q F U Q w 0 I L N F f s w t C K 0 s E W v A J C X A J 5 p g I p m + 1 S I j L D E B n V t J h + D M v 7

x I W i c 1 x 6 4 5 N 3 a l f p 7 H U U R l d I C q y E G n q I 4 u U Q M 1 E U G P 6 B m 9 o j f j y X g x 3 o 2 P W W v B y G f 2 0 R 8 Y n z + l F J g O < / l a t e x i t > MLP (arc-d) < l a t e x i t s h a 1 _ b a s e 6 4 = "

Y 4 E Q E D w f s G N G d j k N N 2 q d W S x 5 Z S M = " > A A A C B H i c b V A 7 S w N B E J 6 L r 3 i + o p Z p D o M Q C 8 O d j T Z i 0 M Z C I Y J 5 Q B L D 3 m a T L N l 7 s D s n h u N A G / + K j Y U i t r b 2 d v

V m Z B i K Q N Z c o J r j P y s h R s F o o G f F c w a p u / 2 z o V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + + 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y

v E K M X y w = " > A A A B 2 X i c b Z D N S g M x F I X v 1 L 8 6 V q 1 r N 8 E i u C o z b n Q p u H F Z w b Z C O 5 R M 5 k 4 b m s k M y R 2 h D H 0 B F 2 5 E f C 9 3 v o 3 p z 0 J b D w Q + z k n I v S c u l L Q U B N 9 e b W d 3 b / + g f u g f N f z j k 9 N m o 2 f z 0 g j s i l z l 5 j n m F p X U 2 C V J C p 8 L g z y L F f b j 6 f 0 i 7 7 + g s T L X T z Q r M M r 4 W M t U C k 7 O 6 o y a r a A d L M W 2 I V x D C 9 Y a N b + G S S 7 K D D U J x a 0 d h E F B U c U N S a F w 7 g 9 L i w U X U z 7 G g U P N M 7 R R t R x z z i 6 d k 7 A 0 N + 5 o Y k v 3 9 4 u K Z 9 b O s t j d z D h N 7 G a 2 M P / L B i W l t 1 E l d V E S a r H 6 K C 0 V o 5 w t d m a J N C h I z R x w Y a S b l Y k J N 1 y Q a 8 Z 3 H Y S b G 2 9 D 7 7 o d B u 3 w M Y A 6 n M M F X E E I N 3 A H D 9 C B L g h I 4 B X e v

V v 6 l + t V a P b b o J F q A t L 4 k a X g h s X C h V s K z S x T C a T d u j k h 5 k b s Y Q u 3 P g q b l w o 4 o u 4 8 2 2 c t F 1 o 6 4 G B j 3 N m m H u P n w q u 0 L a / j d L K 6 t r 6 R n m z s l X d 3 t k 1 9 6 o d l W S S s j Z N R C L v f K K Y 4 D F r I 0 f B 7 l L J S O Q L 1 v V

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I C k a X S L 7 m B 1 k O 9 w Q P S J b o J 3 Z H O o = " > A A A C B H i c b

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > MLP (rel-h) < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e

x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e

x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > MLP (rel-d) < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b

EQUATION E: Not extracted; please refer to original document.

m N M P J I n s k r e T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b

EQUATION E: Not extracted; please refer to original document.

m N M P J I n s k r e T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " r I M 4 M 6 c Q c 6 g q I S t n H i x J x P I q P P g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 8 a v U 8 s 0 h 0 G I h e F O B C 2 D N h Y K E c w H J G f Y 2 5 s k S / Y + 2 J 0 T w 5 H C x r 9 i Y 6 G I r T / C z n / j X p J C E x 8 M P N 6 b Y W a e F w u u 0 L a / j Y X F p e W V 1 d x a f n 1 j c 2 v b 3 N m t q y i R D G o s E p F s e l S B 4 C H U k K O A Z i y B B p 6 A h j e 4 y P z G P U j F o / A W h z G 4 A e 2 F v M s Z R S 1 1 z E I 7 o N i X Q X p 9 V R 3 d t R E e M C 1 J E E f + 4 a h j F u 2 y P Y Y 1 T 5 w p K Z I p q h 3 z q + 1 H L A k g R C a o U i 3 H j t F N q U T O B I z y 7 U R B T N m A 9 q C l a U g D U G 4 6 f m J k H W j F t 7 q R 1 B W i N V Z / T 6 Q 0 U G o Y e L o z O 1 n N e p n 4 n 9 d K s H v m p j y M E 4 S Q T R Z 1 E 2 F h Z G W J W D 6 X w F A M N a F M c n 2 r x f p U U o Y 6 t 7 w O w Z l 9 e Z 7 U j 8 u O X X Z u T o q V 8 2 k c O V I g + 6 R E H H J K K u S S V E m N M P J I n s k r e T O e j B f j 3 f i Y t C 4 Y 0 5 k 9 8 g f G 5 w + 0 O Z g b < / l a t e x i t > MLP (arc-h) < l a t e x i t s h a 1 _ b a s e 6 4 = " Y O j G C a 0 F 6 q z E k 1 B N K K O N G f R v 9 y 8 = " > A A A C B H i c b

V A 7 S w N B E J 6 L r 3 i + o p Z p D o M Q C 8 O d j T Z i 0 M Z C I Y J 5 Q B L D

V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + 7 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V

Z X V t X V j Y 7 M m w 1 g Q W i U h D 0 X D w 5 J y F t A q M O C 0 E Q m K f Y / T u t c / z f z 6 D R W S h c E V D C L q + r g b s A 4 j G J T U M v K O j 6 E n / O T i v J J e O 0 B v I S l i Q f Z 6 u 2 n L K F g l a w h z m t h j U j j + 0 I + i h y + 9 0 j I + n X Z I Y p 8 G Q D i W s m l b E b g J F s A I p 6 n u x J J G m P R x l z Y V D b B P p Z s M n 0 j N H a W 0 z U 4 o V A V g D t X f E w n 2 p R z 4 n u r M T p a T X i b + 5 z V j 6 B y 6 C Q u i G G h A R o s 6 M T c h N L N E z D Y T l A A f K I K J Y O p W k / S w w A R U b r o K w Z 5

F i w d F v P o j v P l v 3 L Q 5 a O u D g c d 7 M 8 z M 8 y L O F N j 2 t 1 F Y W l 5 Z X S u u l z Y 2 t 7 Z 3 z N 2 9 l g p j S W i T h D y U H Q 8 r y l l A m 8 C A 0 0 4 k K R Y e p 2 1 v f J H 5 7 X s q F Q u D W 5 h E 1 B V 4 G D C f E Q x a 6 p v l n s A w k i K 5 v m q k d z 2 g D 5 B U s S T H o 6 O 0 b 1 b s m j 2 F t U i c n F R Q j k b f / O o N Q h I L G g D h W K m u Y 0 f g J l g C I 5 y m p V 6 s a I T J G A 9 p V 9 M A C 6 r c Z P p E a h 1 q Z W D 5 o d Q V g D V V f 0 8 k W C g 1 E Z 7 u z E 5 W 8 1 4 m / u d 1 Y / D P 3 I Q F U Q w 0 I L N F f s w t C K 0 s E W v A J C X A J 5 p g I p m + 1 S I j L D E B n V t J h + D M v 7

x I W i c 1 x 6 4 5 N 3 a l f p 7 H U U R l d I C q y E G n q I 4 u U Q M 1 E U G P 6 B m 9 o j f j y X g x 3 o 2 P W W v B y G f 2 0 R 8 Y n z + l F J g O < / l a t e x i t > MLP (arc-d) <

V 2 + Z V D z w r 3 E Q s q Z H u j 7 v c E p Q S 6 1 M t u E R 7 E k v v r w o J T c N Z H c Y 5 4 m k + + 2 9 p J X J 2 Q V 7 B G u W O B O S O / k 0 j + 8 B o N T K f D X a A Y 0 8 5 i M V R K m 6 Y 4 f Y j I l E T g V L z E a k W E h o n 3 R Z X V

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v

n m F p X U 2 C V J C p 8 L g z y L F f b j 6 f 0 i 7 7 + g s T L X T z Q r M M r 4 W M t U C k 7 O 6 o y a r a A d L M W 2 I V x D C 9 Y a N b + G S S 7 K D D U J x a 0 d h E F B U c U N S a F w 7 g 9 L i w U X U z 7 G g U P N M 7 R R t R x z z i 6 d k 7 A 0 N + 5 o Y k v 3 9 4 u K Z 9 b O s t j d z D h N 7 G a 2 M P / L B i W l t 1 E l d V E S a r H 6 K C 0 V o 5 w t d m a J N C h I z R x w Y a S b l Y k J N 1 y Q a 8 Z 3 H Y S b G 2 9 D 7 7 o d B u 3 w M Y A 6 n M M F X E E I N 3 A H D 9 C B L g h I 4

B X e v Y n 3 5 n 2 s u q p 5 6 9 L O 4 I + 8 z x 8 4 x I o 4 < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " C b K 0 9 L o l 6 b l 2 4 S e 0 X i t j 7 o 5 + 3 M M = " > A A A B

+ X i c b Z D N S s N A F I V v 6 l + t V a P b b o J F q A t L 4 k a X g h s X C h V s K z S x T C a T d u j k h 5 k b s Y Q u 3 P g q b l w o 4 o u 4 8 2 2 c t F 1 o 6 4 G B j 3 N m m H u P n w q u 0 L a / j d L K 6 t r 6 R n m z s l X d 3 t k 1 9 6 o d l W S S s j Z N R C L v f K K Y 4 D F r I 0 f B 7 l L J S O Q L 1 v V

A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " A g C I d r G t D z G R C 4 O 2 P E A O + x 8 z T U g = " > A A A C B H i c b V A 9 S w N B E N 3 z M 5 5 f U c s 0 i 0 G I h e H O R h s x a G O h E M F 8 Q C 6 G v c 1 e s m T v g 9 0 5 M R w p b P w j F j Y W i t j a 2 t u I / 8 a 9 J I U m P h h 4

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y

i I r 1 T f d 3 V n e r K a 9 F L x P 6 8 R g 3 f Y T H g Q x c A C O l r k x Q J D i N N E c J t L R k H 0 N S F U c n 0 r p l 0 i C Q W d m 6 l D s C d f n i b V / a J t F e 1 L K 1 8 6 Q S N k U A 5 t o w K y 0 Q E q o T N U R h V E 0 R 1 6 R M /

v D f D z D w 3 E l y B Z X 0 b M 7 N z 8 w u L m S V z e W V 1 b T 2 7 s V l V Y S w p q 9 B Q h L L u E s U E D 1 g F O A h W j y Q j v i t Y

V C 7 T s N A E D y H V w g v A 2 U a i w g p F E Q 2 D Z Q R N B Q g B Y k 8 p N h E 5 / M

Table 4. Not extracted; please refer to original document.

5 O e X 8 0 N 0 a E V k u a P g V G g o Q o u U j 6 P g b z o k L S B h p p d H M r n Z 3 3 J g z C a b 5 r Z W W l l d W 1 8 r r l Y 3 N r e 0 d f X e v I 6 N E E N o m E Y 9 E z 8 W S c h b S N j D g t B c L i g O X 0 6 4 7 v s j 9 7 j 0 V k k X h L U x i 6 g R 4 G D K f E Q x K G u h V O 8 A w E k F 6 f d X K 7 m y g D 5 D W s S D H 3 l E 2 0 G t m w 5 z C W C R W Q W q o Q G u g f 9 l e R J K A h k A 4 l r J v m T E 4 K R b A C K d Z x U 4 k j T E Z 4 y H t K x r i g E o n n T 6 R G Y d K 8 Q w / E q p C M K b q 7 4 k U B 1 J O A l d 1 5 i f L e S 8 X / / P 6 C f h n T s r C O A E a k t k i P + E G R E a e i O E x Q Q n w i S K Y C K Z u N c g I C 0 x A 5 V Z R I V j z L y + S z k n D M h v W j V l r n h d x l F E V H a A 6 s t A p a q J L 1 E J t R N A j e k a v 6 E 1 7 0 l 6 0 d + 1 j 1 l r S i p l 9 9 A f a 5 w + e / J g K < / l a t e x i t > MLP (rel-h) < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e v d m 1 u S w W 9 W M q O d K M 1 n A = " > A A A C B H i c b V D J S g N B E O 1 x j X G L e s x l M A j x Y J g R Q Y 9 B L x 4 U I p g F M m P o 6 d Q k T X o W u m v E M M z B i 7 / i x Y M i X v 0 I b / 6 N n e W g i Q 8 K H u 9 V U V X P i w V X a F n f x s L i 0 v L K a m 4 t v 7 6 x u b V d 2 N l t q C i R D O o s E p F s e V S B 4 C H U k a O A V i y B B p 6 A p j e 4 G P n N e 5 C K R + E t D m N w A 9 o L u c 8 Z R S 1 1 C k U n o N i X Q X p 9 V c v u H I Q H T M s S x F H / M O s U S l b F G s O c J / a U l M g U t U 7 h y + l G L A k g R C a o U m 3 b i t F N q U T O B G R 5 J 1 E Q U z a g P W h r G t I A l J u O n 8 j M A 6 1 0 T T + S u k I 0 x + r v i Z Q G S g 0 D T 3 e O T l a z 3 k j 8 z 2 s n 6 J + 5 K Q / j B C F k k 0 V + I k y M z F E i Z p d L Y C i G m l A m u b 7 V Z H 0 q K U O d W 1 6 H Y M + + P E 8 a x x X b q t g 3 J 6 X q + T S O H C m S f V I m N j k l V X J J a q R O G H k k z + S V v B l P x o v x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e v d m 1 u S w W 9 W M q O d K M 1 n A = " > A A A C B H i c b V D J S g N B E O 1 x j X G L e s x l M A j x Y J g R Q Y 9 B L x 4 U I p g F M m P o 6 d Q k T X o W u m v E M M z B i 7 / i x Y M i X v 0 I b / 6 N n e W g i Q 8 K H u 9 V U V X P i w V X a F n f x s L i 0 v L K a m 4 t v 7 6 x u b V d 2 N l t q C i R D O o s E p F s e V S B 4 C H U k a O A V i y B B p 6 A p j e 4 G P n N e 5 C K R + E t D m N w A 9 o L u c 8 Z R S 1 1 C k U n o N i X Q X p 9 V c v u H I Q H T M s S x F H / M O s U S l b F G s O c J / a U l M g U t U 7 h y + l G L A k g R C a o U m 3 b i t F N q U T O B G R 5 J 1 E Q U z a g P W h r G t I A l J u O n 8 j M A 6 1 0 T T + S u k I 0 x + r v i Z Q G S g 0 D T 3 e O T l a z 3 k j 8 z 2 s n 6 J + 5 K Q / j B C F k k 0 V + I k y M z F E i Z p d L Y C i G m l A m u b 7 V Z H 0 q K U O d W 1 6 H Y M + + P E 8 a x x X b q t g 3 J 6 X q + T S O H C m S f V I m N j k l V X J J a q R O G H k k z + S V v B l P x o v x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e v d m 1 u S w W 9 W M q O d K M 1 n A = " > A A A C B H i c b V D J S g N B E O 1 x j X G L e s x l M A j x Y J g R Q Y 9 B L x 4 U I p g F M m P o 6 d Q k T X o W u m v E M M z B i 7 / i x Y M i X v 0 I b / 6 N n e W g i Q 8 K H u 9 V U V X P i w V X a F n f x s L i 0 v L K a m 4 t v 7 6 x u b V d 2 N l t q C i R D O o s E p F s e V S B 4 C H U k a O A V i y B B p 6 A p j e 4 G P n N e 5 C K R + E t D m N w A 9 o L u c 8 Z R S 1 1 C k U n o N i X Q X p 9 V c v u H I Q H T M s S x F H / M O s U S l b F G s O c J / a U l M g U t U 7 h y + l G L A k g R C a o U m 3 b i t F N q U T O B G R 5 J 1 E Q U z a g P W h r G t I A l J u O n 8 j M A 6 1 0 T T + S u k I 0 x + r v i Z Q G S g 0 D T 3 e O T l a z 3 k j 8 z 2 s n 6 J + 5 K Q / j B C F k k 0 V + I k y M z F E i Z p d L Y C i G m l A m u b 7 V Z H 0 q K U O d W 1 6 H Y M + + P E 8 a x x X b q t g 3 J 6 X q + T S O H C m S f V I m N j k l V X J J a q R O G H k k z + S V v B l P x o v x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > < l a t e x i t s h a 1 _ b a s e 6 4 = " I j g z h N A e v d m 1 u S w W 9 W M q O d K M 1 n A = " > A A A C B H i c b V D J S g N B E O 1 x j X G L e s x l M A j x Y J g R Q Y 9 B L x 4 U I p g F M m P o 6 d Q k T X o W u m v E M M z B i 7 / i x Y M i X v 0 I b / 6 N n e W g i Q 8 K H u 9 V U V X P i w V X a F n f x s L i 0 v L K a m 4 t v 7 6 x u b V d 2 N l t q C i R D O o s E p F s e V S B 4 C H U k a O A V i y B B p 6 A p j e 4 G P n N e 5 C K R + E t D m N w A 9 o L u c 8 Z R S 1 1 C k U n o N i X Q X p 9 V c v u H I Q H T M s S x F H / M O s U S l b F G s O c J / a U l M g U t U 7 h y + l G L A k g R C a o U m 3 b i t F N q U T O B G R 5 J 1 E Q U z a g P W h r G t I A l J u O n 8 j M A 6 1 0 T T + S u k I 0 x + r v i Z Q G S g 0 D T 3 e O T l a z 3 k j 8 z 2 s n 6 J + 5 K Q / j B C F k k 0 V + I k y M z F E i Z p d L Y C i G m l A m u b 7 V Z H 0 q K U O d W 1 6 H Y M + + P E 8 a x x X b q t g 3 J 6 X q + T S O H C m S f V I m N j k l V X J J a q R O G H k k z + S V v B l P x o v x b n x M W h e M 6 c w e + Q P j 8 w e 6 U Z g f < / l a t e x i t > MLP (rel-d) Table 5 shows the results achieved by the v2018 and v2020 models. The v2020 model shows a significantly improvement of 3.0% in LAS over the v2018 model. This makes sense because the major parts of the revision are dedicated to DEPREL consistency, yielding more robust parsing performance in labeling. The v2020 model also gives a good improvement of 0.6% in finding dependency arcs. The improved parsing results ensure the higher quality annotation in PKT-UD v2020 that is encouraging.

Uas Las

v2018 90.7 (±0.2) 86.0 (±0.1) v2020 91.3 (±0.1) 89.0 (±0.1) Table 5 : Results by the v2018 and v2020 models.

7 Error Analysis

PKT-UD v2018 We perform an error analysis on the parsing outputs generated by the v2018 model. Our analysis shows that the head error occurred in 1,360 Eojeols and the label error occurred in 4,292 Eojeols. Table 6 shows the distribution of head and label errors per label based on the revised test set. The relations advcl, nummod, acl, and obl have a high error rate, which are due to the inconsistencies seen in the data we handled by establishing clear criteria. Moreover, the labels goeswith and flat saw 100% error, again, due to the errors we observed during the revision process. There is an observable trend in these errors. For example, a number of error cases report advcl as xcomp, conj, or ccomp while nummod tends to be wrongly parsed to compound, acl to ccomp, and obl to advcl. Multiple cases of parsing errors due to errors in the UPOS are also found. Incor-rect UPOS appears to commit errors while allocating edge and DEPREL. The annotation guideline based on XPOS is already described in Section 4.

Deprel Error

PKT-UD v2020 After revising the data according to the criteria presented in Section 4, many improvements have been made. The error rate of advcl decreased from 98.93% to 2.36%, the nummod also decreased significantly from 97.37% to 0.5%, and the acl error from 86.73% to 0.9%. The error rate of obl was also reduced from 79.14% to 5.5%. In addition, the error rate is reduced for goeswith and flat. In the case of ccomp, errors decreased by more than 35% from 44.51% to 8.67%. These results is indicative of the effect of improving training data by ensuring consistency of annotations.

8 Conclusion

In this study, we revise the Penn Korean Universal Dependency Treebank (PKT-UD) and compare parsing performance between models trained on the original and revised versions of PKT. Our new guidelines follow the UDv2 guidelines. UPOS and DEPREL are revised to reflect Korean morphological features and flexible word-order aspects with reference to Korean UD studies such as Park et al. (2018) , , and Oh (2019) . In UPOS, ADJ, NOUN, and VERB are revised extensively. In DEPREL, iobj, acl, advcl, and goeswith are thoroughly revised. The revision results showing the percentage change of each label are presented in Table 2 and Table 3 . As a result of the parsing experiment, the v2020 model improves UAS by 0.6% and LAS by 3.0% over the v2018 model. In particular, obl, acl, nummod, and advcl errors are significantly reduced. This study, which improves parsing accuracy by applying characteristics of Korean, can also contribute to improve the quality of other Korean UD treebanks. In the future, we will explore the possibility of extending PKT-UD with enhanced dependency types 5 by incorporating empty categories from the original PKT.

The annotation with the word-forms of the Penn Korean UD Treebank can be found here: https://github.com/ emorynlp/ud-korean.

While most Korean resources have what is known as Eojeol representing a token and white space is used as delimiter, PTK tokenizes apart symbols, punctuation and even occasional morphemes where strictly required by syntactic structure.

https://github.com/google-research/bert/ blob/master/multilingual.md

https://universaldependencies.org/u/ overview/enhanced-syntax.html

Figure 8: The overview of our transformer-based biaffine dependency parsing model.

Table 7: DEPREL error comparison between PKT-UD v2018 and v2020.

Analysis of the Penn Korean Universal Dependency Treebank (PKT-UD): Manual Revision to Build Robust Parsing Model in Korean

Authors

Abstract

1 Introduction

2. Revised Annotation Guidelines For Korean And

2.1 Korean Ud Corpora

2.2 Penn Korean Ud Treebank

3 Observations In Pkt-Ud V2018

4.1 Upos Revision

Consistent Noun Focusing On Morpheme Roles

Statistics Of V2018 And V2020

4.2 Deprel Revision

Reevaluation Of Iobj

먹+다

Orphaned Postpositions And Verbal Endings

5 Parsing Approach

Uas Las

7 Error Analysis

Deprel Error

8 Conclusion