Senior AI/ML Quality Assurance and Test Automation Specialist

1 month ago


Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time
About the Role

We are seeking a highly skilled Senior Machine Learning Quality Assurance and Test Automation Engineer to lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring.

  • Develop and implement best practices into the AI/ML development cycle to ensure high stability, issue discovery, and low maintenance.
  • Support ML Engineers in Model Evaluation, Data Quality Validation, Data Annotation, and Model Monitoring to ensure high-quality AI-driven products.
  • Collaborate with ML Engineers, MLOPs Engineers, and QA engineers to ensure a common understanding and implementation of best practices.
  • Contribute to the growth and continuous improvement of quality and testing processes within the organization.
About You

We are looking for a candidate with:

  • Strong experience in Quality Assurance and Test Automation with a focus on AI/ML.
  • Understanding of QA methodologies, tools, and processes.
  • Strong experience in statistical analysis or machine learning algorithms, natural language processing, and LLMs.
  • Experience in AI/ML System Design and Life cycle of ML Models.
Requirements

The ideal candidate will have:

  • Hands-on experience with test automation and tools such as Pytest, Giskard, and Garak.
  • Proficiency in SQL and Python.
  • Experience in Red Teaming of LLM and ML Models.
  • Experience in AI/ML Model performance validation, data quality/validation testing, model monitoring, and data pipeline.


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleAs a Senior AI/ML Quality Assurance and Test Automation Specialist at Workday Denmark ApS, you will lead the implementation of a comprehensive test strategy for data and model evaluation, as well as the fundamental ML pipeline testing and monitoring.Key Responsibilities:Develop and implement best practices into the AI/ML development cycle to...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Quality Assurance and Test Automation Engineer to lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring.Develop and implement best practices into the AI/ML development cycle to ensure high stability,...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleAs a Senior Machine Learning Quality Assurance and Test Automation Engineer, you will be responsible for leading the implementation of a comprehensive test strategy for data and model evaluation, as well as the fundamental ML pipeline testing and monitoring.Key Responsibilities:Develop and implement best practices into the AI/ML development...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Quality Assurance and Test Automation Engineer to join our team at Workday Denmark ApS.Develop and implement a comprehensive test strategy for data and model evaluation, as well as fundamental ML pipeline testing and monitoring.Implement best practices into the AI/ML development cycle to...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleWe are seeking a skilled Senior Machine Learning Quality Assurance and Test Automation Engineer to lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring.Implement best practices into the AI/ML development cycle so that it is highly stable, discovers issues...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleDevelop and implement a comprehensive test strategy for AI/ML models, ensuring their stability, reliability, and accuracy.Collaborate with ML Engineers to design and implement efficient testing methodologies, reducing the risk of errors and improving overall system quality.Lead the development and maintenance of automated test suites, ensuring...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleAs a key member of our team at Workday Denmark ApS, you will be responsible for leading the implementation of a comprehensive test strategy for AI/ML pipelines. This involves designing and implementing best practices to ensure the stability, reliability, and maintainability of our AI/ML systems.Key Responsibilities:Develop and implement a...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleAs a key member of our team at Workday Denmark ApS, you will be responsible for leading the implementation of a comprehensive test strategy for AI/ML pipelines, ensuring the highest quality and stability of our products.Key Responsibilities:Develop and implement a holistic test strategy for AI/ML pipelines, focusing on data and model...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleAs a key member of our team at Workday Denmark ApS, you will be responsible for developing and implementing a comprehensive test strategy for AI and ML models, ensuring their stability, quality, and reliability.Key Responsibilities:Lead the implementation of a holistic test strategy for data and model evaluation, as well as fundamental ML...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleLead the implementation of a comprehensive test strategy for data and model evaluation, as well as the fundamental ML pipeline testing and monitoring.Implement best practices into the AI/ML development cycle to ensure high stability, issue discovery, and low maintenance.Support ML Engineers in Model Evaluation (e.g. Error Analysis), Data...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleDevelop and lead the implementation of a comprehensive test strategy for data and model evaluation, as well as the fundamental ML pipeline testing and monitoring.Implement best practices into the AI/ML development cycle to ensure high-quality, stable, and low-maintenance outcomes.Support ML Engineers in Model Evaluation, Data Quality...


  • Copenhagen, Copenhagen, Denmark Workday Denmark ApS Full time

    About the RoleWe are seeking a Senior Quality Assurance and Test Automation Engineer with Machine Learning expertise to lead the implementation of a holistic test strategy for our AI and ML pipelines.The successful candidate will be responsible for:Developing and implementing a comprehensive test strategy to ensure the quality and reliability of our AI and...


  • Copenhagen, Copenhagen, Denmark Workday Peakon Full time

    About the RoleWe are seeking a highly skilled Machine Learning Quality Assurance and Test Automation Engineer to join our Machine Learning & Data organization. As a key member of our team, you will be responsible for leading the implementation of a holistic test strategy for data and model evaluation, as well as the fundamental ML pipeline testing and...


  • Copenhagen, Copenhagen, Denmark Workday Peakon Full time

    About the RoleWe are seeking a highly skilled Machine Learning Quality Assurance and Test Automation Engineer to join our team at Workday Peakon. As a key member of our Machine Learning & Data organization, you will play a critical role in bringing "AI first" products to life at every step of our product offering.Key Responsibilities:Lead the implementation...


  • Copenhagen, Copenhagen, Denmark Workday Peakon Full time

    About the RoleWe are seeking a highly skilled Machine Learning Quality Assurance and Test Automation Engineer to join our team at Workday Peakon. As a key member of our Machine Learning & Data organization, you will play a critical role in bringing "AI first" products to life at every step of our Workday Peakon Employee Voice product offering.Key...


  • Copenhagen, Copenhagen, Denmark The Tailored Closet and PremierGarage of Nashville Full time

    We are looking for a highly skilled Senior Quality Assurance Specialist to join our team at The Tailored Closet and PremierGarage of Nashville. In this role, you will be responsible for ensuring the quality of our software products and providing valuable inputs to improve product quality. You will work closely with the QA - Automation & Manual Test...


  • Copenhagen, Copenhagen, Denmark Genmab Full time

    About the RoleThe Senior Quality Engineering Architect, Test Specialist will play a crucial part in designing, implementing, and leading all aspects of validation and testing architectures for Genmab's extensive portfolio of research and clinical development platforms. This includes Laboratory Information Management Systems (LIMS), Electronic Lab Notebooks...


  • Copenhagen, Copenhagen, Denmark The Tailored Closet and PremierGarage of Nashville Full time

    About the RoleWe are seeking a skilled Quality Assurance Specialist to join our team at The Tailored Closet and PremierGarage of Nashville. As a key member of our QA team, you will play a crucial role in ensuring the quality of our software products.Key ResponsibilitiesDesign, implement, and maintain test solutions for iOS, Android, and Web...


  • Copenhagen, Copenhagen, Denmark Genmab Full time

    The RoleGenmab is seeking a Quality Engineering and Testing Architect to design, implement, and lead all aspects of the validation and testing architectures for our research and clinical development platforms.This role involves developing automated test frameworks, API monitoring, and CI/CD pipelines using various tools.Key Responsibilities:Design test...


  • Copenhagen, Copenhagen, Denmark Genmab Full time

    The Quality Assurance Architect will play a pivotal role in the development and implementation of validation and testing architectures for Genmab's research and clinical development platforms.This includes Laboratory Information Management Systems (LIMS), Electronic Lab Notebooks (ELN), Clinical Trial Management Systems (CTMS), Electronic Trial Master Files...