Skip to content

Image-text-to-text pipeline for transformers.js (JavaScript) #1295

@zlelik

Description

@zlelik

Pipeline description

Please implement or share the estimated release date (if it is in progress already) for Image-text-to-text pipeline. As stated here
https://huggingface.co/docs/transformers/en/tasks/image_text_to_text it is already implemented for python but if I try to create this pipeline in JavaScript with transformers.js v3.5.0, I got a error "unsupported pipeline". Especially I am interested in video processing.

Prerequisites

  • The pipeline is supported in Transformers (i.e., listed here)
  • The task is listed here

Additional information

If it exists already in JavaScript, please give me a link to video captioning example.

Your contribution

No, I cannot contribute much. Sorry.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions