Float16.Cloud Update [02/2024]

Matichon Maneegard

Feb 12, 2024 — 2 min read

Float16.Cloud has released a Generative AI service for Southeast Asian languages that is better than ChatGPT (GPT-3.5).

Float16.Cloud supports three new models: one for SEA languages and two for the Thai language. The pricing is 95% cheaper than ChatGPT (GPT-3.5). The models are named:

SeaLLM-7b-v2 (Alibaba)
Typhoon-7b (SCB10X)
OpenThaiGPT-13b (OpenThaiGPT).

The highlight is SeaLLM-7b-v2, developed by DAMO (Alibaba), which supports a total of 10 languages in SEA, including English and Chinese.

SeaLLM-7b-v2 had an evaluation score that was slightly behind ChatGPT by around 1-2% on the M3Exam (M3e) datasets, which included English, Chinese, Vietnamese, Indonesian, and Thai.

However, SeaLLM-7b-v2 performed at the same level as ChatGPT on the Sea-bench datasets, which included English, Chinese, Vietnamese, Indonesian, Thai, Burmese, Khmer, Lao, Tagalog, and Malay, and outperformed ChatGPT in the Burmese, Khmer, and Lao languages. [1]

Inference speed performance is another significant improvement. For example, SeaLLM-7b-v2 has a base speed of 100 tokens per second, and the inference demo video can be viewed via this YouTube link.

The use case of Generative AI for SeaLLM-7b-v2 could help us localize into the Southeast Asian region in efficient ways, including helping us draft emails in Vietnamese, generate post captions in Indonesian, find keywords in blog posts in Tagalog, provide text summarization, chatbot services, sentiment analysis, and translation.

You can try SeaLLM-7b-v2 for 'FREE' via https://float16.cloud.

Service

Float16.cloud offers Generative AI services in several options, such as API, API with custom SLA, enterprise subscription for on-premise and on-cloud, and hosting fine-tuned AI models (Bring Your Own Model).

About Float16.cloud

Float16.cloud is a new product from VulturePrime, and VulturePrime is a startup in the Nvidia Inception Program.

[1] https://huggingface.co/SeaLLMs/SeaLLM-7B-v2

Facebook: VulturePrime

Twitter: @VutlurePrime

Website : https://www.vultureprime.com

Email: business@vultureprime.com

How to get Float16, OpenAI, Anthropic API key ?

Pay as you use. No upfront. No addition charge. What is API key ? An API key is a key to access a service. An API key is used to connect a website or application to communicate or use a third-party service across websites. For example, if you want to integrate

[Preview] Southeast Asia LLM Function call benchmark.

What is function call Function call capability is crucial for creating agent-based systems. Function calls allow LLMs to use 'the tools' when 'the tools' are functions (methods) or APIs. This capability increases the reliability of LLM applications when LLM applications MUST interact with non-LLM systems. Method I used a part

SQLCoder-7b-2 is live.

Faster, Smaller, The best Text-to-SQL LLM model. Overview SQLCoder is a Text-to-SQL LLM family from Defog.ai (YC W23): a human-level AI analyst for every enterprise user. Text-to-SQL is a crucial task. This task can convert text (natural language) into SQL statements based on the table schema. Text-to-SQL enables end

The First 70B Thai LLM.

OpenThaiGPT is a volunteer group that has created an open-source model named OpenThaiGPT (OTG). They have continued training a large language model (LLM) from an open-source model, and the resulting model has scored nearly as high as Claude Sonnet on certain benchmarks. Launch date On April 8, 2024, they published

Read more

How to get Float16, OpenAI, Anthropic API key ?

[Preview] Southeast Asia LLM Function call benchmark.

SQLCoder-7b-2 is live.

The First 70B Thai LLM.