Text Classification
Transformers
Safetensors
English
llama
text-generation
llama-2
text-embeddings-inference
4-bit precision
gptq
Instructions to use TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ") model = AutoModelForCausalLM.from_pretrained("TheBloke/llama-2-13B-Guanaco-QLoRA-GPTQ", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K