CVAT Task Specification: Training/Test Mode for Annotation Tasks

5 days ago


Aalborg, Denmark Django Rest Framework Full time

Project Description:

We are seeking a skilled software engineer to implement a new feature in CVAT that allows designating annotation tasks as "Training" or "Test" mode. This feature will provide different permissions to annotators regarding access to quality analytics and ground truth data, enabling more effective training and evaluation of annotators.

Problem:

Currently, CVAT lacks a mechanism to differentiate between annotation tasks used for training purposes and those used for testing annotator performance.

Desired Solution:

We require a solution that modifies CVAT to allow designating tasks as "Training" or "Test" with the following functionalities:

  1. Task Mode Selection:

A new option should be added to the task creation page, allowing the task creator to select the task mode as either "Training" or "Test." This selection can be implemented as a checkbox or a dropdown menu.

  1. Annotator Permissions:

Training Mode (this is the default setting):

Annotators assigned to a "Training" task will have permission to:

  • View their individual Quality Analytics score.
  • View conflicts between their annotations and the Ground Truth.
  • All other permissions and functionalities for the annotator will remain the same as in the standard CVAT workflow.

Test Mode:

Annotators assigned to a "Test" task will not have permission to:

  • View their individual Quality Analytics score.
  • View conflicts between their annotations and the Ground Truth.

Ground Truth Visibility:

  • The Ground Truth data for a task should be completely hidden from annotators in "Test" mode.
  • The Ground Truth data should be visible to the task creator (supervisor) in both "Training" and "Test" modes.

Skills Required:

  • Proficiency in Python and Django (CVAT backend).
  • Experience with PostgreSQL database.
  • Frontend development skills (React).
  • Good understanding of REST APIs.
  • Experience with Git and version control.

Deliverables:

  • Modified CVAT codebase with the implemented solution.
  • Clear documentation of the changes made.
#J-18808-Ljbffr

  • Aalborg, Ålborg Kommune, Denmark Django Rest Framework Full time

    Project Overview: CVAT, a leading annotation platform, is seeking an experienced Django developer to implement a new feature that differentiates between training and test modes for annotation tasks.Job Description:We are looking for a skilled software engineer to develop a solution that allows task creators to select the mode as either 'Training' or 'Test.'...


  • Aalborg, Ålborg Kommune, Denmark Django Rest Framework Full time

    Project Overview:We are seeking a skilled software engineer to implement a new feature in CVAT, enabling the designation of annotation tasks as training or test modes. This innovative development will enhance the platform's functionality and user experience.Job DescriptionThe selected candidate will be responsible for designing, developing, and testing the...


  • Aalborg, Denmark ULTRAAQUA AS Full time

    Mechanical Engineer/Technical Designer for Development and Design Tasks We are looking for a skilled and committed mechanical engineer or technical designer to join our development team to help design and develop the next generation of UV disinfection systems. You will work on both development tasks and CAD design, as well as participate in projects related...


  • Aalborg, Denmark Alfa Laval Corporate AB Full time

    Every day, we get opportunities to make a positive impact – on our colleagues, partners, customers, and society. Together, we’re pioneering the solutions of the future and unlocking the full potential of precious resources. Trusted to act on initiative, we challenge conventional thinking to develop world-leading technologies that inspire progress in...


  • Aalborg, Denmark GomSpace AS Full time

    Ambitious Space Company is looking for a Mechanical Design Engineer At GomSpace, we are committed to make space accessible, affordable and useful. We are an agenda-setting player in the small satellite business and our highly skilled team is committed, dedicated and accountable. We are ambitious and believe that small satellites and our efforts,...

  • AOCS Engineer DK

    5 days ago


    Aalborg, Denmark GomSpace AS Full time

    Ambitious Space Company is looking for a AOCS Engineers At GomSpace, we are committed to make space accessible, affordable and useful. We are an agenda-setting player in the small satellite business and our highly skilled team is committed, dedicated and accountable. We are ambitious and believe that small satellites and our efforts, multidisciplinary...

  • Data Analyst

    4 days ago


    Aalborg, Ålborg Kommune, Denmark Blue Power Partners AS Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Analyst to join our Construction department as a Process Improvement Specialist. In this role, you will contribute to developing, supporting, and maintaining construction management processes and tools.The right candidate will play a central part in supporting the team with its...


  • Aalborg, Denmark LBN Medical - Medical Imaging Equipment & Parts Full time

    Technician for X-Ray Equipment Do you find excitement in working with high-power electronics, and do you have a basic understanding of and knowledge about this? If so, you might be the person we are looking for! At LBN Medical, we have purchased and sold diagnostic imaging equipment across the globe for more than two decades. This includes X-ray equipment...


  • Aalborg, Ålborg Kommune, Denmark Centrica Full time

    At Centrica, we're driving innovation in the energy sector to create a more sustainable future. As a Smart Energy Trainer, you'll play a vital role in delivering high-quality training and assessment for Smart Energy Engineers.Job DescriptionThis role is based at our Thatcham site and involves delivering the Smart Metering Qualifications, Apprentice...


  • Aalborg, Denmark Columbus AS Full time

    Solution Consultant M3 | Build the Future with M3 at Columbus! Are you ready to step into a role that blends technology, strategic thinking, and customer engagement? If you thrive on delivering within presale and enjoy crafting customized large solutions, this is your opportunity to make a difference! Location: Middelfart, Ballerup & Aarhus Welcome to...


  • Aalborg, Ålborg Kommune, Denmark LBN Medical - Medical Imaging Equipment & Parts Full time

    At LBN Medical, we are a leading provider of diagnostic imaging equipment and parts. We have been serving the medical industry for over two decades, with a strong focus on customer satisfaction and technical expertise.We are seeking an experienced Technical Specialist to join our team. As a key member of our engineering department, you will be responsible...


  • Aalborg, Ålborg Kommune, Denmark Columbus AS Full time

    Company Overview">Columbus A/S is a global IT consulting company at the forefront of digital transformation, present in 9 countries helping 1,100 customers secure their future by driving growth through data-driven insights and creating seamless digital experiences.">Job Description">We are seeking a talented Solution Consultant M3 to join our team. As a...


  • Aalborg, Denmark RINA Piraeus Team Full time

    Select how often (in days) to receive an alert: Full-stack Developer City:  Aalborg Location:  Aalborg, DK, 9200 Contract Type:  Permanent Division:  Marine Digital Solutions Level of experience:  Intermediate RINA Digital Solutions develops and implements mission-critical software solutions and is now seeking several...

  • Textile Engineer

    5 days ago


    Aalborg, Denmark Gabriel Holding AS Full time

    Are you passionate about high-end textiles and product development? We are looking for a Textile Engineer who will support the current development team, focusing on integrating technical and functional aspects in the design and product development process. In the position your focus will be to develop new upholstery fabrics or support in developing new...


  • Aalborg, Ålborg Kommune, Denmark Ramboll Full time

    At Ramboll, we are committed to excellence and making a positive impact on the nearshore environment.We invite you to bring your profound coastal and marine engineering expertise into play, taking on technical development and project responsibilities, contributing to innovation and high-quality design solutions.About the RoleYou will join a highly recognized...


  • Aalborg, Ålborg Kommune, Denmark Centrica Energy Trading Full time

    About UsWe are Centrica Energy Trading, a leading energy company revolutionising the clean and green future. Our purpose-driven organisation empowers employees to make an impact that changes tomorrow.Job OverviewAs a Trading Operations Specialist, you will thrive in a dynamic environment coordinating complex tasks, prioritising, and executing to optimise...

  • Software Engineer

    5 days ago


    Aalborg, Denmark RINA Piraeus Team Full time

    Software Engineer Posting Date: 30 Sep 2024 City: Aalborg Location: Aalborg, DK, 9200 Contract Type: Permanent Division: RINA Marine Digital Solutions Level of experience: Senior Are you passionate about developing crucial mission-critical IT solutions alongside a team of sharp developers? Are you a coding whiz and deeply passionate about your work? Then...


  • Aalborg, Ålborg Kommune, Denmark Centrica Energy Trading Full time

    We are Centrica Energy Trading, a leading energy company driving innovation and sustainability.Our MissionTo energise a fairer, more sustainable world by optimising daily operations and implementing new products and markets.As a Trading Operations Specialist, you will thrive in a collaborative environment, coordinating complex tasks across trading and...


  • Aalborg, Denmark Columbus AS Full time

    Are you passionate about building seamless integrations that drive impactful business solutions? Are you ready to lead integration strategies and deliver powerful solutions? We would love to hear from you. Apply today and become a key player in Columbus’ journey to transform businesses with innovation and expertise! Location: Ballerup, Aarhus, Middelfart,...


  • Aalborg, Denmark Shaping New Tomorrow - SNT ApS Full time

    Paid Search Specialist Apply for this job Do you want to become part of an innovative fashion company? Over the past years, SHAPING NEW TOMORROW has gone from being an ambitious start-up with only ten employees to a fast-growing scale-up company with more than 230 Shapers! Together, we are part of an informal and unique employee culture - we call it the...