1-Click Installers for Most Powerful Vision Model CogVLM V2 and Batch Captioning Images, Install on Windows, RunPod and Massed Compute (Patreon)

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

=======

Info

Latest installers : CogVLM2_v10.zip

Official repository of the APP : https://github.com/THUDM/CogVLM2

This app is purely developed by me

CogVLM 2 is GPT4 level for vision tasks and it is open source and free

Check above screenshots to see how to use it

Currently the APP works amazing with 4-bit quantization very fast

I am searching to lower VRAM usage even further with like adding CPU-Offloading and other stuff if possible

All above examples generated on RTX 3090 locally on Windows with 4-bit quantization

FP16 works on 48 GB GPUs

1 May 2025 Update V10

When batch processing, it was not properly handling orientation data - like vertical image shown horizontally - this bug fixed

When batch processing, multiple GPU was not working, this bug fixed

26 April 2025 Update

All installers updated to support RTX 5000 series with newest libraries - official Torch 2.7 and CUDA 12.8

I have used my pre-compiled libraries so they should be super fast

xFormers (compiled by me for you), Flash Attention (compiled by me for you), Sage Attention (compiled by me for you on Linux), Triton

The installers will support older GPUs as well with maximum speed hopefully

If you see it is too slow, very likely that your VRAM is not sufficient, run in 4-bit mode

Also on windows now it will download models into models folder, so you can delete previously downloaded models from your Hugging Face cache folder

Windows Requirements

Python 3.10, FFmpeg, CUDA 12.4, cuDNN 8.9 and 9.4 or above, C++ tools, MSVC and Git

If it doesn't work make sure to below tutorial and install everything exactly as shown in this below tutorial

https://youtu.be/DrhUHnYfwC0

How To Install and Use:

Windows:

First watch above requirements tutorial and follow every step

Extract zip archive into a drive like c:/cogvlm2

Longer directory path causes issues

Double click and install with Windows_Install.bat and that is it

Then run with Windows_Start_App.bat

It will download around 37 GB model files into your Hugging Face cache folder when you first time load

How to Get Installation Logs and How to Change Hugging Face Cache Folder

Massed Compute (Recommend Cloud) :

Please register via this link : https://vm.massedcompute.com/signup?linkId=lp_034338&sourceId=secourses&tenantId=massed-compute

Use our coupon SECourses

Our coupon works on all GPUS now

You can see full list here : https://www.patreon.com/posts/huge-news-secourses-coupon-massed-compute-details-126671823

I recommend RTX A6000 ADA as price performance but read above post

Then select our image SECourses from Creator dropdown

Then follow Massed_Compute_Instructions_READ.txt

Same as my any other Massed Compute installer script

Example tutorial for learn how to install and use Massed Compute

(Starts at 12:58) : https://youtu.be/KW-MHmoNcqo?si=G1WbG-Qw4ujWvOtG&t=778

RunPod (Cloud):

Please register via this link : https://runpod.io?ref=1aka98lq

Then follow Runpod_Instructions_READ.txt

Same as my any other RunPod installer script

Use the template written in Runpod_Instructions_READ.txt file

Example tutorial for learn how to install and use RunPod

(starts at 22:03) : https://youtu.be/KW-MHmoNcqo?si=QN8X8Sjn13ZYu-EU&t=1323