"If a worker wants to do his job well, he must first sharpen his tools." - Confucius, "The Analects of Confucius. Lu Linggong"
Online tools
Software tutorial
Site navigation
Programming
Front page > Programming > First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

Published on 2024-08-28
Browse:175

Multi-GPU batch caption with JoyCaption. JoyCaption uses Meta-Llama-3.1–8B and google/siglip-so400m-patch14–384 and a fine tuned image captioning neural network.

Link : https://www.patreon.com/posts/110613301

Link for batch caption editor : https://www.patreon.com/posts/108992085

Coding multi-gpu in Python and Torch and bitsandbytes was truly a challange.

Our APP uses JoyCaption image captioning fine tuned model.

Our APP supports bitsandbytes 4bit model loading as well even in multi GPU mode (9.5 GB VRAM)

Tested on 8x RTX A6000 (cloud) and RTX 3090 TI RTX 3060 (my PC)

1-click to install on Windows, RunPod and Massed Compute

Excellent caption quality, automatically distributes images into each GPU, lots of features. You can resume caption with skip captioned images option.

For full details checkout screenshots

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

First fully multi-GPU supporting and very advanced batch image captioner APP with Gradio interface published

Release Statement This article is reproduced at: https://dev.to/furkangozukara/first-fully-multi-gpu-supporting-and-very-advanced-batch-image-captioner-app-with-gradio-interface-published-4l83?1 as If there is any infringement, please contact [email protected] to delete it.
Latest tutorial More>
ClassificationMore>
Learn japanese Learn Korean Learn Chinese Learn foreign language Game Common problem Technology peripherals AI Software tutorial Programming Article

Study Chinese

ToolMore>
Image base64 decoding
Chinese Pinyin
Unicode encoding
JS obfuscation encryption compression
URL hexadecimal encryption tool
UTF-8 encoding conversion tool
Online Ascii encoding and decoding tools
MD5 encryption tool
Hash/Hash text online encryption and decryption tool
Online SHA encryption

Disclaimer: All resources provided are partly from the Internet. If there is any infringement of your copyright or other rights and interests, please explain the detailed reasons and provide proof of copyright or rights and interests and then send it to the email: [email protected] We will handle it for you as soon as possible.

Copyright© 2022 湘ICP备2022001581号-3