Self-hosted CVAT Modification for Multi-Annotator Support
4 weeks ago
We are seeking a skilled software engineer or full-stack developer to modify the open-source Computer Vision Annotation Tool (CVAT) to enable multiple annotators to work on the same annotation job within a single task. This enhancement will allow us to efficiently benchmark annotator performance against a ground truth and improve the overall annotation workflow.
Problem:
The core issue I am aiming to address is the limitation in the open-source CVAT instance that allows only one annotator per job. This restriction hinders my ability to efficiently benchmark the performance of multiple annotators on the same dataset against a ground truth. Currently, the workaround involves creating separate tasks for each annotator, which is time-consuming and inefficient for my purpose. My goal is to modify the self-hosted CVAT workflow to enable the assignment of multiple annotators to a single job, streamlining the process of evaluating annotator performance and improving overall efficiency.
Desired Solution:
We require a solution that modifies CVAT to allow multiple annotators to work on the same job within a single task, while ensuring:
- Independent Annotations: Each annotator should have their own separate annotation instance within the job, allowing them to work independently without affecting others' annotations.
- Link to Job ID: All annotation instances should be linked to the main job ID for unified management and comparison.
- Minimal UI Changes: The solution should ideally involve minimal changes to the existing CVAT user interface to maintain a familiar user experience.
Technical Requirements:
- Database Schema Modification: Update the database schema (likely PostgreSQL) to establish a many-to-many relationship between jobs and users. This may involve creating a new join table to link jobs and users.
- API Endpoint Modification: Modify the task creation API endpoint to accept a list of user IDs (annotator IDs) instead of a single user ID.
- Annotation Instance Generation: Implement backend logic to automatically generate separate annotation instances for each assigned annotator within a job. Ensure each instance has a unique identifier and is linked to the main job ID.
- UI Modification: If required, make minimal adjustments to the task creation page in the CVAT UI to allow selecting multiple annotators. This could involve replacing the single-user selection component with a multi-user selection component (e.g., a multi-select dropdown).
Skills Required:
- Understanding of CVAT architecture and codebase or willingness to learn (I have many upcoming projects with CVAT so it will be a strong plus if you're willing to learn).
- Strong proficiency in Python and Django (CVAT backend).
- Experience with PostgreSQL database.
- Frontend development skills (JavaScript, React).
- Good understanding of REST APIs.
- Experience with Git and version control.
- Super-user of ChatGPT and/or Cursor.
Deliverables:
- Modified CVAT codebase with the implemented solution.
- Clear documentation of the changes made.
-
Aalborg, Ålborg Kommune, Denmark Django Rest Framework Full timeWe are seeking an experienced software developer to enhance the Computer Vision Annotation Tool (CVAT) and enable multiple annotators to work on the same task. This modification will facilitate efficient benchmarking of annotator performance against a ground truth and streamline the annotation workflow.Challenge: The current limitation in the open-source...
-
Aalborg, Denmark Django Rest Framework Full timeProject Description: We are seeking a skilled software engineer to implement a new feature in CVAT that allows designating annotation tasks as "Training" or "Test" mode. This feature will provide different permissions to annotators regarding access to quality analytics and ground truth data, enabling more effective training and evaluation of annotators....
-
Wind Energy Support Specialist
2 months ago
Aalborg, Ålborg Kommune, Denmark Siemens Gamesa Renewable Energy, S.A. Full timeAt Siemens Gamesa Renewable Energy, S.A., we are passionate about driving the transition to a sustainable future.We strive to be at the forefront of renewable energy, with a vision that clean energy will power generations to come. Our global team is committed to reducing carbon emissions and tackling the climate crisis.About the RoleWe are seeking a highly...
-
Aalborg, Ålborg Kommune, Denmark Patrique Mercier Recruitment Spain Full timeOverviewPatrique Mercier Recruitment Spain is a leading recruitment agency seeking highly motivated and skilled professionals to join our team in Athens, Greece.Job SummaryWe are looking for a Danish-speaking Technical Support Specialist to provide exceptional IT support to our clients through various communication channels. The ideal candidate will have...
-
Aalborg, Ålborg Kommune, Denmark Patrique Mercier Recruitment Spain Full timeDanish Speaking IT Professionals WantedAre you looking for a career opportunity in Athens, Greece? Patrique Mercier Recruitment ES is seeking highly skilled Tech Support Specialists to assist Danish-speaking clients with their technical queries. This exciting role allows you to relocate to a vibrant city known for its rich history and stunning landscapes...
-
Cloud DevOps System Engineer
4 weeks ago
Aalborg, Ålborg Kommune, Denmark LexisNexis Risk Solutions Full timeWe are seeking a passionate and skilled Cloud DevOps System Engineer to join our team. In this role, you will play a critical part in developing a Centre of Excellence responsible for delivering shared solutions for infrastructure operations across our estate.You will be responsible for configuring, deploying, monitoring, and supporting hosting of...
-
Technical Associate
2 months ago
Aalborg, Denmark LexisNexis Risk Solutions Full timeWould you like to shape the future of our global cloud infrastructure and operations teams? Are you a DevOps Engineer looking for an innovative change? About our Team DevOps is a key position within the Technology, Infrastructure, and Operations group. The incumbent in this role will play a critical part in developing a Centre of Excellence responsible...
-
Technical Associate
2 months ago
Aalborg, Denmark Elsevier Full timeWould you like to shape the future of our global cloud infrastructure and operations teams? Are you a DevOps Engineer looking for an innovative change? About our Team DevOps is a key position within the Technology, Infrastructure, and Operations group. The incumbent in this role will play a critical part in developing a Centre of Excellence responsible...
-
Aalborg, Ålborg Kommune, Denmark HOYER Rekruttering Full timeDOMISPHERE, a Copenhagen-based spin-off company from INFUSER, is seeking an experienced SCM professional to spearhead its international supply chain operations.The ideal candidate will have a solid background in supply chain management, with a minimum of 5+ years of experience as a sourcing manager or equivalent SC position at management level. A technical...
-
Cloud Infrastructure Automation Expert
2 months ago
Aalborg, Ålborg Kommune, Denmark Elsevier Full timeAbout the RoleWe are seeking a skilled DevOps System Engineer to join our team and contribute to the development and enhancement of our hosting capabilities. This role involves configuring, deploying, monitoring, and supporting applications in AWS and Alibaba cloud, ensuring the use of best practices on our infrastructure assets.The successful candidate will...
-
Cloud Infrastructure DevOps Engineer
4 weeks ago
Aalborg, Ålborg Kommune, Denmark Elsevier Full timeWe are seeking a skilled Cloud Infrastructure DevOps Engineer to join our team at Elsevier, a global leader in information and analytics. As a key member of our Technology, Infrastructure, and Operations group, you will play a critical role in developing a Centre of Excellence responsible for delivering shared solutions for infrastructure operations across...
-
Customer Success Manager
4 months ago
Aalborg, Denmark Trackunit AS Full timeCustomer Success Manager (French Market) Apply for this job Before you start reading the details, here are some highlights that we hope will spark your curiosity: Join a truly purpose-focused tech company in the business of driving digital business transformation in the construction industry - one of the biggest (and second least digital) industries in the...
-
Aalborg, Ålborg Kommune, Denmark XCI Full timeCompany OverviewXCI is a rapidly growing technology company with a crucial mission of developing innovative software solutions to combat crime. We strive to equip law enforcement agencies and intelligence services with cutting-edge technologies, empowering them to safeguard citizens effectively.About the RoleWe seek an experienced IT & Network Infrastructure...
-
Service Engineer
3 weeks ago
Aalborg, Denmark Wärtsilä Corporation Full timeBusiness Unit Parts and Field Service is a global organisation with harmonised ways of working and tools to deliver the best possible services for our customers. In our global team, we value, respect, and embrace different opinions and diversity. Safety, environment, and wellbeing are our foundation, and we never compromise them. We are now looking for an...
-
Customer Success Business Growth Ambassador
2 weeks ago
Aalborg, Ålborg Kommune, Denmark Trackunit AS Full timeAbout Trackunit A/SWe are a pioneering tech company driving digital business transformation in the construction industry, one of the largest and second least digital industries in the world.Our innovative solutions help customers create value outcomes anchored in our products and services through a program-based and consultative approach.We have locations...
-
Produktleder til automotive område
2 months ago
Aalborg, Ålborg Kommune, Denmark HOYER Rekruttering Full timeOm stillingenVi søger en produktchef med erfaring fra automotive branchen, der kan tage rollen som produktchef i et voksende team. Stillingen indebærer at du er ansvarlig for udviklingen af vores produktportfolio og skal have stor indsigt i karosseridelene på en bil.KompensationVed HOYER Rekruttering tilbyder vi en konkurrencedygtig gagepakke omfattende...
-
Business Project Manager
4 months ago
Aalborg, Denmark Centrica Energy Trading Full timeWe are Centrica! We’re so much more than an energy company. We’re a family of brands revolutionising a cleaner, greener future. Working here is #MoreThanACareer - we’re powered by purpose. Together we can make an impact that will truly change tomorrow. Whether you’re developing cutting-edge green tech, helping customers on the front line or...
-
Personlige Oversigt Kontrolør i Finansdel
4 weeks ago
Aalborg, Ålborg Kommune, Denmark Fibertex Personal Care Full timeJobbeskrivelseFibertex Personal Care søger en dygtig, engageret og god forretningsforstående Personlige Oversigt Kontrolør til at styrke vores Finance-team i Aalborg. Som Personlige Oversigt Kontrolør vil du være ansvarlig for økonomisk nøglerolle med alsidige opgaver, herunder månedsrapportering, løbende revision og statusrevision, analyse af...
-
SUPPLY CHAIN MANAGER
1 week ago
Aalborg, Denmark HOYER Rekruttering Full timeDOMISPHERE is a newly established spin-off company from INFUSER in Copenhagen. The company works with products and solutions aimed at the international market for the improvement of indoor air quality, targeting initially the non-residential (e.g. offices) appliance market, and in time also the residential segment, with a new and ground-breaking technology...
-
Postdoc in Machine Learning
1 week ago
Aalborg, Denmark Aalborg Universitet København Full timePostdoc in Machine Learning (2024-224-06141) At the Faculty of Engineering and Science, Department of Materials and Production, a PostDoc position is available. This two-year position is open for appointment from 1 April 2025 or soon thereafter. The position is funded by projects from Novo Nordisk Foundation and Sygesikring Danmark and offers a unique...
