If an annotator labels a key phrase or role that was not suggested, Adaptation Studio creates a tentative role type to account for it. It is up to the manager to review these tentative extractors and either remove them or use them to further refine the model.
Note
Labels applied with tentative role types are not used to train the model.
Before a tentative role type is added to the schema, a manager must accept it. A manager can also reject any tentative role type. Follow these steps to review tentative role types:
-
Select Project Schema from the project navigation bar.
Note
The Project Schema tab will have a red asterisk next to it when there are tentative extractors.
-
Expand Role Types. Role types with tentative extractors are identified as such in the Tentative column.
-
Select Configure next to a Role type with tentative extractors. Adaptation Studio displays a list of samples containing tentative extractors below all existing extractors.
-
Choose one of the following options for each sample containing tentative extractors:
-
Accept the tentative extractor and select the extractor type it should use.
-
Exact: the model will extract other instances of this phrase exactly as it appears. This is useful for cases in which the model did not recognize a specific phrase, and you want it to extract that phrase from now on.
-
Semantic: the model will extract phrases with similar meaning. This is useful for cases in which the model did not recognize a phrase, such as "$2 million," and you want it to extract that and similar phrases from now on, such as "3 million" or "400 million."
-
Morphological: the model will extract all forms of this phrase. For example, it would extract both singular and plural versions of the same noun.
-
Ignore the tentative extractor. Choose this if the tentative label is wrong and you do not want it to affect model training.
The schema is adjusted each time you select Accept or Ignore.
-
Repeat steps 3-4 until there are no remaining tentative role types.
-
Save the project schema.