Now that you have created the project, defined the event schema, and uploaded the training and validation documents, it is time to annotate. For this tutorial, you will annotate yourself. To start annotating, follow these steps:
-
Select Annotate from the project navigation bar. Adaptation Studio displays a single sample for annotation. This sample may be from the training set or the validation set.
-
Select the event key phrase and select investment (Event) to focus on it. A key phrase will be highlighted and display the word KEY above it when you are focusing on it.
-
Adaptation Studio may automatically suggest events. If you agree with the suggestion, proceed to step 3. Otherwise, remove the suggestion by selecting it and then select a different key phrase.
-
Identify event roles by selecting a word or phrase and then selecting the appropriate role type while you are focusing on the event. Do this for each word or phrase in the sample that matches a role in the event schema.
-
Select Annotate. Adaptation Studio displays the next sample. Repeat steps 2-4 until there are no more samples to display.
The effectiveness of the model being trained depends entirely on the quality and quantity of the data. Therefore, it is important to have a large amount of documents and annotators, and to make sure the annotations are accurate. When you have multiple annotators, you should provide them with annotation guidelines to ensure they create high quality data that fits the purposes of your project. For this tutorial, annotate with these guidelines in mind:
-
The key phrase should be forms of the noun “investment” (investments, et cetera) and the verb/action “invest” (invested, investing, et cetera).
-
The money role applies to an amount of money exchanged during an investment.
-
The investor role applies to a person or organization that invests an amount of money in another organization.
-
The asset role applies to an organization that a person or organization is investing money in.
For more detailed annotation guidelines, see the Annotation Guidelines .pdf file in Rosette Adaptation Studio Events Tutorial\File Package.