Multiple PhDs and postdocs on evaluation metrics for multimodal health data

3 weeks ago


Copenhagen, Copenhagen, Denmark ELLIS Full time
Multiple PhDs and postdocs on evaluation metrics for multimodal health data

The PURRlab (Pattern Recognition Revisited lab) at the IT University of Copenhagen invites highly motivated individuals to apply for a PhD or a 2-year Postdoc position starting late 2025 or in 2026. The earliest possible start date is 1 October 2025.

The project is funded by the Novo Nordisk Foundation Data Science Ascending Investigator grant titled "CHEETAH: CHallenges of Evaluating Teams and Algorithms" and is led by Associate Professor Veronika Cheplygina.

Machine learning (ML) competitions are often touted as drivers of algorithm development in healthcare but face limitations in real-world applications. An example competition is detecting lung cancer in chest images, where the team correctly identifying the most images with cancer wins the competition. Such competitions attract many international teams with monetary or prestigious incentives. While competitions are said to spur innovation, they often result in too similar algorithms that only excel on a specific accuracy metric, but are not robust and fail to generalize to diverse, real-world data.

I posit that a single performance metric such as accuracy is insufficient to capture algorithm robustness, for example how the algorithm performs on rare patient cases. Having a single performance metric also leads to too similar algorithms which do not bring added value despite their high training costs and carbon footprint. Furthermore, as research on women and other underrepresented groups in computer science shows, competition may deter them from entering or staying in the field.

I therefore propose to design competitions with multiple metrics, both in what the metric measures (e.g., accuracy or sensitivity) and which subgroups of patients this is measured on. My team will focus on two multimodal disease (risk) prediction data: chest x-rays with radiology reports and retinal images with tabular clinical measurements. Inspired by techniques like generative models, transfer learning, and data distillation we will first develop novel methods to evaluate and increase the diversity of the evaluation data. We will then design how to evaluate similarity of algorithms, and develop methods to combine and reuse (parts of) them, such that robustness can be increased without the disproportionate carbon footprint. Finally, we will organize competitions in education and at conferences, where we will study how the novel design affects underrepresented groups in data science.

#J-18808-Ljbffr

  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Multiple PhD and postdoc positions on evaluation metrics for multimodal health data at the IT University of CopenhagenThe PURRlab (Pattern Recognition Revisited lab) at the IT University of Copenhagen invites highly motivated individuals to apply for a PhD or a 2 year Postdoc position starting late 2025 or in 2026. The earliest possible start date is 1...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Multiple PhD and postdoc positions on evaluation metrics for multimodal health data at the IT University of Copenhagen The PURRlab (Pattern Recognition Revisited lab) at the IT University of Copenhagen invites highly motivated individuals to apply for a PhD or a 2 year Postdoc position starting late 2025 or in 2026. The earliest possible start date is 1...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Job DescriptionThe IT University of Copenhagen invites highly motivated individuals to apply for a PhD or a 2-year postdoctoral research position starting late 2025 or in 2026. The project is funded by the Novo Nordisk Foundation Data Science Ascending Investigator grant titled "CHEETAH: CHallenges of Evaluating Teams and Algorithms" and is led by Associate...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    The PURRlab at the IT University of Copenhagen invites highly motivated individuals to apply for a PhD or a 2-year Postdoc position. The project, funded by the Novo Nordisk Foundation Data Science Ascending Investigator grant, aims to develop novel methods for evaluating teams and algorithms in healthcare.Machine learning competitions are often touted as...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    We are seeking highly motivated individuals to join our team as PhD or postdoctoral researchers in the field of multimodal health data evaluation. Our project, CHEETAH, aims to design competitions with multiple metrics to evaluate algorithm robustness.Machine learning competitions often result in too similar algorithms that excel on specific accuracy metrics...


  • Copenhagen, Copenhagen, Denmark ELLIS Full time

    Research OpportunitiesThe IT University of Copenhagen invites applications for a PhD or 2-year Postdoc position in the PURRlab. The project, funded by the Novo Nordisk Foundation, focuses on evaluating and increasing the diversity of multimodal health data evaluation metrics.Machine learning competitions often drive algorithm development but face limitations...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Are you interested in joining our team at the IT University of Copenhagen? We have PhD and postdoc positions available in multimodal health data evaluation.Our team's goal is to develop novel methods for evaluating teams and algorithms in healthcare. We focus on two multimodal disease (risk) prediction data: chest x-rays with radiology reports and retinal...


  • Copenhagen, Copenhagen, Denmark ELLIS Full time

    CHEETAH Project OverviewThe CHEETAH project, led by Associate Professor Veronika Cheplygina, aims to address the challenges of evaluating teams and algorithms in healthcare. We invite highly motivated individuals to join our team as a PhD or Postdoc researcher.Current machine learning competitions focus on single performance metrics, leading to algorithms...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    At the IT University of Copenhagen, we have an opportunity for highly motivated individuals to join our research team as PhD students or postdocs. We aim to develop novel methods for evaluating teams and algorithms in healthcare.Our team focuses on designing competitions with multiple metrics, both in what the metric measures and which subgroups of patients...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Job DescriptionWe are seeking PhD or postdoctoral researchers to join our team in Copenhagen, Denmark. The successful applicants will work on developing novel methods to evaluate and increase the diversity of the evaluation data.They will also design how to evaluate similarity of algorithms and develop methods to combine and reuse them to increase robustness...


  • Copenhagen, Copenhagen, Denmark ELLIS Full time

    Disease Prediction and Algorithm DevelopmentWe are seeking a highly motivated individual to join our team as a PhD or Postdoc researcher in the PURRlab at the IT University of Copenhagen. The project focuses on developing novel methods for disease prediction using multimodal health data.Current machine learning competitions often result in similar algorithms...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    PhD/Postdoc position in applied big data analysis – statistics and AI/machine learning - leveraging large-scale health records with genetics for improved PREDICTION of COURSE AND OUTCOME for MENTAL DISORDERS (Statistics, Bioinformatics & Computer Science)PhD/Postdoc position with focus on analyses of large-scale complex multimodal data to advance...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    PhD/Postdoc position in applied big data analysis – statistics and AI/machine learning - leveraging large-scale health records with genetics for improved PREDICTION of COURSE AND OUTCOME for MENTAL DISORDERS (Statistics, Bioinformatics & Computer Science) PhD/Postdoc position with focus on analyses of large-scale complex multimodal data to advance...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    About the ProjectThe project aims to develop novel methods to evaluate and increase the diversity of evaluation data, design how to evaluate similarity of algorithms, and develop methods to combine and reuse parts of them, increasing robustness without disproportionate carbon footprint.The project is funded by the Novo Nordisk Foundation Data Science...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    About the Project:The project aims to develop predictive models for psychiatric diseases by leveraging large-scale genetic cohorts and electronic health data. We will explore risk and prediction for adverse outcomes in relatives to mental health patients, at prediction and courses of psychiatric diseases for implementation in everyday work in a clinical...


  • Copenhagen, Copenhagen, Denmark Københavns Universitet (KU) Full time

    Novo Nordisk Foundation Center for Basic Metabolic Research Faculty of Health and Medical Sciences University of Copenhagen The University of Copenhagen is seeking a highly motivated and talented Postdoc fellow to commence on February 1, 2025, or after agreement in the Rasmussen Group at the Novo Nordisk Foundation Center for Basic Metabolic Research (CBMR),...


  • Copenhagen, Copenhagen, Denmark Københavns Universitet (KU) Full time

    Novo Nordisk Foundation Center for Basic Metabolic Research Faculty of Health and Medical Sciences University of Copenhagen The University of Copenhagen is seeking a highly motivated and talented Postdoc fellow to commence on February 1, 2025, or after agreement in the Rasmussen Group at the Novo Nordisk Foundation Center for Basic Metabolic Research...


  • Copenhagen, Copenhagen, Denmark PARETO SECURITIES AS Full time

    Our ProjectPARETO SECURITIES AS is involved in a pioneering project to leverage large-scale multimodal biomedical data combined with focused innovation in statistical and computational methods, including machine learning, to advance our understanding, treatment, and prevention of human disease. This project focuses on prediction, course, and outcome in...


  • Copenhagen, Copenhagen, Denmark Københavns Universitet Full time

    Postdoc in Machine Learning and Quantum Computing for Health Data ScienceDepartment of Computer ScienceFaculty of ScienceUniversity of CopenhagenA senior postdoc position (2 years) is available in the group of Professor Anders Krogh. The group focuses on the development of deep generative models, quantum computing, and applications to medical data. We are...


  • Copenhagen, Copenhagen, Denmark Københavns Universitet Full time

    Postdoc in Machine Learning and Quantum Computing for Health Data Science Department of Computer Science Faculty of Science University of Copenhagen A senior postdoc position (2 years) is available in the group of Professor Anders Krogh. The group focuses on the development of deep generative models, quantum computing, and applications to medical data. We...