RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

huggingface.co
Visit site

Модель text-generation · лицензия llama3.1

Installation

from transformers import pipeline; pipeline(model="RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8")
Installs intotransformers, python
Not sure where to start — ask an assistant to walk you through:

Specs

Type Model
SectionModels & platforms / text-generation
Pricing open source
Platform Web only
Hostingcloud
Installpackage
Installs intotransformers, python
Site languageen
VendorRedHatAI
Views1 758
Launched2024-07-29

Can do

text-generation

Tags

endpoints_compatible transformers safetensors conversational en text-generation text-generation-inference Llama de es fr it pt 8-bit vllm compressed-tensors hi th int8

Found in sources

huggingface

Similar in «Models & platforms»

DeepSeek V3
Cost-efficient open-source MoE model rivaling GPT-4o in reasoning and math tasks
DeepSeek
Open reasoning and coding models on par with the top closed ones.
Mistral AI
European open and commercial models, Le Chat and Codestral.
sider.ai
Research faster with Sider AI—summarize web pages, take notes, generate reports, and chat with leading AI models. Powered by ChatGPT, Gemini, Claude, Grok, Deepseek, etc. Try the best AI sidebar now!
Hugging Face
The hub of models and datasets: millions of weights, Spaces, Transformers.
doubao.com
Передовая мультимодальная AI-платформа от ByteDance с современными языковыми, визуальными и речевыми моделями, а также интегрированными возможностями рассуждения и поиска.

Submit a site to the catalog

Just send the link — we will work out the rest.

We will review what you send and add it to the catalog if it fits.

Not sure how to implement it? We can help

Tell us about your task — we will pick the tools and suggest where to start.

0 / 5000
Verification code

Fields marked with an asterisk are required. Your data is used only to reply.