UBIAI LLM Fine-tuning
  • Welcome to UbiAI
  • Getting Started with UbiAI
  • Create Your Dataset
    • Prompt-Response Datasets
    • Text-Based Datasets
    • Document-Based Datasets
    • Image-Based Datasets
    • Supported File Format Details
    • Setting Up Assisted Annotation
  • Fine-Tune Your Models
  • Playground
  • LLM Monitoring in UbiAI
  • Collaborations on UBIAI
  • Inter-Annotator Agreement (IAA)
Powered by GitBook
On this page
  • Project Leader Guide
  • Creating a New Collaboration
  • Adding Collaborators
  • Assigning Tasks
  • Tracking Progress
  • Collaborator Guide
  • Accessing Tasks
  • Self-Assigning Tasks
  • Reviewing and Validating Work

Collaborations on UBIAI

PreviousLLM Monitoring in UbiAINextInter-Annotator Agreement (IAA)

Last updated 5 months ago

UBIAI provides a robust collaboration system designed to simplify the annotation process, making it faster and more efficient for teams to work together. This page outlines every step and feature available to admins and collaborators, ensuring that you can fully utilize UBIAI’s capabilities for collaborative projects.

Project Leader Guide

Project Leader are responsible for creating collaborations, assigning tasks, and tracking team progress. Here’s everything you need to know about managing collaborations effectively:

Creating a New Collaboration

As a team manager in UbiAI, you can create and manage collaborations with the click of a button:

  • Access the Collaboration Menu: Navigate to the collaboration dashboard by clicking the collaborations button on the side menu.

  • To Create a Collaboration : Simply click on the "New Collaboration" Button on the top-right of that page.

  • Set Up Collaboration Details: Enter the collaboration name, project type, and annotation guidelines in the description section.

  • Click on "Create Collaboration" to finalize.

Adding Collaborators

In UbiAI you can invite collaborators to your project with ease:

  • Navigate to the Team Tab: Open the “Team” tab within the collaboration details page.

  • Add Team Members: Click on “Add Team Member” to invite new collaborators.

Once the team memebr is added you can:

  • Assign Roles: Choose between the following roles:

    • Labeler: This role restricts collaborators to annotating only the tasks assigned to them.

    • Reviewer: Reviewers can annotate their tasks, review others’ work, assign new tasks, and track progress.

  • Enable Model Predictions: Grant permissions to use model predictions from trained models to speed up annotation.

Assigning Tasks

Distribute your tasks to collaborators manually or automatically:

Manual Assignment: Click the “New Task” button in the collaboration task tab. Select documents, set deadlines, and assign them to specific team members.

Automatic Assignment: Use the “Automatic Task Assignment” feature in the “Collaboration Task” tab. Select collaborators and documents, and UbiAI will evenly distribute the tasks.

Tracking Progress

UBIAI provides comprehensive tools for monitoring team performance and project progress:

  • to the "Collaboration Details" tab to access task metrics, documents completed by your collaborators, total active time and average document annotation time per collaborator.

  • To visualize the active time per document, simply go to the "collaboration Task" tab and click on the Documents Information icone.

the active time is calculated when the user is actively annotating a document, which does not take into account switching tabs or windows

Collaborator Guide

Collaborators play a vital role in completing assigned tasks and maintaining high annotation quality. Here’s what collaborators can do on UbiAI:

Accessing Tasks

Easily locate and work on your assigned tasks:

  • Navigate to Collaborations: Go to the Collaboration menu and select “Joined Collaboration.”

  • Open Assigned Tasks: Select the relevant collaboration and access tasks through the “Collab Task” section.

Self-Assigning Tasks

Take initiative by picking additional tasks:

  • Access Unassigned Documents: In the “Collaboration Task” tab, click on the “Add New Task” button to self-assign a task.

  • Select Documents: Choose unassigned documents from the project pool and begin annotating.

Reviewing and Validating Work

For those with reviewer roles, ensure high-quality annotations:

  • Reviewer Access: Open the collaboration from the “Joined Collaboration” menu and select the reviewer icon.

  • Validate Tasks: Review and validate annotations from other team members to maintain quality and consistency.