Visual language models have evolved significantly recently. However, the existing technology typically only supports one single image. They cannot reason among…
Visual language models have evolved significantly recently. However, the existing technology typically only supports one single image. They cannot reason among multiple images, support in context learning or understand videos. Also, they don’t optimize for inference speed. We developed VILA, a visual language model with a holistic pretraining, instruction tuning, and deployment pipeline that…