Telegram Group & Telegram Channel
πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub



tg-me.com/machinelearning_interview/1792
Create:
Last Update:

πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub

BY Machine learning Interview




Share with your friend now:
tg-me.com/machinelearning_interview/1792

View MORE
Open in Telegram


Machine learning Interview Telegram | DID YOU KNOW?

Date: |

Telegram auto-delete message, expiring invites, and more

elegram is updating its messaging app with options for auto-deleting messages, expiring invite links, and new unlimited groups, the company shared in a blog post. Much like Signal, Telegram received a burst of new users in the confusion over WhatsApp’s privacy policy and now the company is adopting features that were already part of its competitors’ apps, features which offer more security and privacy. Auto-deleting messages were already possible in Telegram’s encrypted Secret Chats, but this new update for iOS and Android adds the option to make messages disappear in any kind of chat. Auto-delete can be enabled inside of chats, and set to delete either 24 hours or seven days after messages are sent. Auto-delete won’t remove every message though; if a message was sent before the feature was turned on, it’ll stick around. Telegram’s competitors have had similar features: WhatsApp introduced a feature in 2020 and Signal has had disappearing messages since at least 2016.

How Does Telegram Make Money?

Telegram is a free app and runs on donations. According to a blog on the telegram: We believe in fast and secure messaging that is also 100% free. Pavel Durov, who shares our vision, supplied Telegram with a generous donation, so we have quite enough money for the time being. If Telegram runs out, we will introduce non-essential paid options to support the infrastructure and finance developer salaries. But making profits will never be an end-goal for Telegram.

Machine learning Interview from hk


Telegram Machine learning Interview
FROM USA