If an annotator labels a key phrase or role that was not suggested, Adaptation Studio creates a tentative role type to account for it. It is up to the manager to review these tentative extractors and either remove them or use them to further refine the model.
Note
Labels applied with tentative role types are not used to train the model.
Before a tentative role type is added to the schema, a manager must accept it. A manager can also reject any tentative role type. Follow these steps to review tentative role types:
-
Select Adjudicate from the project navigation bar.
-
In the Annotations table to the right of the sample, select the Resolve button next to a label with a tentative extractor. Only labels with tentative extractors display the Resolve button.
-
There are different options for resolving a tentative depending on whether the annotation is for a role or a key phrase. For roles, choose one of the following and then select OK:
-
Update the semantic-phrase extractor: The model will extract phrases with similar meaning. This is useful for cases in which the model did not recognize a phrase, such as "$2 million," and you want it to extract that and similar phrases from now on, such as "$3 million" or "$400 million."
-
Update the morphological extractor: The model will extract all forms of this phrase. For example, it would extract both singular and plural versions of the same noun.
-
Update the exact extractor: The model will extract other instances of this phrase exactly as it appears. This is useful for cases in which the model did not recognize a specific phrase, and you want it to extract that phrase from now on.
-
Do not modify extractors: No extractors will be changed based on this instance of the role. The role will still be used in training the event model. Choose this when the label is correct and should be used to train the model, but shouldn't cause the extractors' behavior to change.
Key phrases have different options because they only use morphological extractors. For key phrases, choose one of the following and then select OK:
-
Add this key phrase: Choose this if the key phrase is a valid mention of the event. A new key phrase will be added to the event type in the project schema.
-
Reject the event: Choose this if the key phrase is not a valid mention of the event.
-
Select Adjudicate. The schema is adjusted each time you do this.
-
Repeat steps 2-4 until there are no remaining samples to adjudicate.