Visual Question Answering
Transformers
Safetensors
llava_llama
text-generation
sharegpt4video-8b / README.md
Lin-Chen's picture
Add paper link to connect the model to the paper on Daily Papers page (#1)
a506887 verified
metadata
license: apache-2.0
inference: false
datasets:
  - Lin-Chen/ShareGPT4V
  - ShareGPT4Video/ShareGPT4Video
pipeline_tag: visual-question-answering


sharegpt4video-8b Model Card

Model details

Model type: sharegpt4video-8b is an open-source video chatbot trained by fine-tuning the entire model on open-source video instruction data. The training process takes around 5 hour on 32xA100 GPUs.

Model date: sharegpt4video-8b was trained in May 2024.

Paper or resources for more information: [Code] [Project Page]

Usage

You can utilize this model as we provide in our [repository].

Training dataset

All training data are open-sourced, you can find the usage in our repository.

  • 153K collection of various video instruction data
  • 28K high-quality video caption data from [ShareGPT4Video]

Intended use

Primary intended uses: The primary use of sharegpt4video-8b is research on large video-language models and video chatbots.

Primary intended users: The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence.

Paper

arxiv.org/abs/2406.04325