Note
You must be registered as a manager for the project.
Manager options can be accessed from these locations:
Common tasks that are a part of managing a project are found on the Manage menu on the navigation bar.
Annotators: Add and remove annotators and adjudicators. You can also see how many samples have been assigned to each annotator as well as how many they have completed.
-
System Status: This section displays the status of the servers - RTS (REX Training Server) and Rosette. A green checkmark indicates they are up and connected. The timestamp indicates when they were last checked.
Three other statuses are displayed:
-
Model: The status of the model being trained. Statuses include:
Idle: No active training occurring
Training: The model is being trained. Any suggestions will come from a previously trained version.
Serializing: The model is trained and being used for suggestions, but is still being serialized into a final format to be available for export. Export is available, but you will be exporting the previously trained model and may not include the latest annotations.
-
Word classes: Shows whether word classes have been generated and are available. The model can be exported when the word classes are not available. Statuses include:
Not available: Word classes generation has not completed. Model training may occur, but will not include word classes.
Available: Word classes have been generated and are being used for training the model.
-
Project: The reconciliation status. When reconciled, the confidence scores for each sample, along with the precision, recall, and F1 measure are current. When unreconciled, the scores may be inconsistent with the latest trained model. To reconcile the model immediately, select Reconcile from the project menu. This task is run every night. Statuses include:
Unreconciled: The confidence scores for each sample, along with the precision, recall, and F1 scores may not be current.
Reconciled: The reconciliation status values are current.
The Export Model button downloads the model trained from the annotations in the project. This file is copied into Rosette Server in your production environment to deploy the model. The option is disabled while the model is actively training and being written to disk. It will become enabled once the model is ready for export, which is approximately 10 minutes after the last annotations.
The model may be exported before word classes are available.
Guidelines File: Add the URL of your written annotation or other project guidelines. The guidelines can be in any format, such as google doc, pdf, or html page. The guidelines should be available to all users of the Studio.
Exported Versions: A list of projects exported. You can download or delete the export files from here.
The Manage page also displays information about the project.
Inter-Annotator Agreement: Values to measure how well the annotators agree with each other.
Documents: A list of all uploaded documents along with assigned annotators and annotation statistics. You can view the original document, rename the document, unassign annotators, or delete the document from the project.
These tasks are available from the project menu in the upper right-hand corner of the project dashboard.
Show Guidelines: Displays the uploaded project guidelines.
Rename: Renames the project.
Clone: Creates a copy of the project. This is the equivalent to exporting and then importing the project.
Configure: Modify the project configuration options.
Reconcile: Recalculates the confidence scores for all the samples in addition to the precision, recall, and F1 measure. As this can be time intensive, the scores are recalculated every night. The reconcile task allows you to update scores at any time.
Export Project: Creates a backup file for the project. Once exported, the project will be listed in the Exported Versions section of the Manage page. From here, you can download or delete the file.
-
Extract ADMs: Downloads a zip file of .json files containing the annotations in ADM format with one file for each document.
These .adm files contain much useful information about the annotation work that was done, including each of the annotations, which annotator performed each, and timestamps.
These additional options are only available when viewing all projects, not when you're in a project: