Falcon-H1-1.5B-Deep-Instruct
A model by TII you run on your own computer, offline: how it did in our Arabic test, the size of each of its files as Hugging Face lists it, the memory a conversation takes worked out from the file itself as llama.cpp reserves it, and whether it fits your card and RAM.
The graphics card in your computer
Press the button and your browser reads the name of your computer's graphics card, which we pick in the check if the Lab has it.
The card's name is never sent to our site: it stays in this browser alone until you press "Forget my device".
Can your PC run it?
In GB, as Windows shows it under Settings > System > About.
Everything in the conversation, your questions and the model's answers. A token is a piece of a word.
Going by this page's figures
Pick the graphics card in your computer or type its RAM, and we'll say which of this model's files fit.
Worked out from the figures in the table below, not tried on your card: the file and the conversation memory, about 0.7 GB llama.cpp reserves to work in, and 1 GB of the card it leaves free for your screen and programs. Speed is not measured.
Specifications
| The model | |
|---|---|
| Parameters | 1.6 billion[1] |
| Longest conversation | 131,072 tokens[2] |
| Licence | other[1] |
| GGUF files to download | |
| Q4_K_M file | 0.94 GB[2] |
| Q5_K_M file | 1.1 GB[3] |
| Q6_K file | 1.28 GB[4] |
| Q8_0 file | 1.66 GB[5] |
| Conversation memory (llama.cpp) | |
| Conversation memory per 1,000 tokens | 67.6 MB[2] |
| Conversation memory, fixed part | 105.4 MB[2] |
| The Arabic test | |
| Arabic score | 60 %[6] Run by CoreITen from its Q4_K_M file, with llama.cpp |
| Understanding Arabic text | 85 %[6] |
| Following Arabic instructions | 50 %[6] |
| Does not invent | 44 %[6] |
| Made-up products it gave specs for (of 8) | 8[6] |
| Answers that slipped into another script (of 56) | 3[6] |
Change log
- Page published.
Sources
- [1] tiiuae/Falcon-H1-1.5B-Deep-Instruct on Hugging Face
- [2] tiiuae/Falcon-H1-1.5B-Deep-Instruct-GGUF: Falcon-H1-1.5B-Deep-Instruct-Q4_K_M.gguf
- [3] tiiuae/Falcon-H1-1.5B-Deep-Instruct-GGUF: Falcon-H1-1.5B-Deep-Instruct-Q5_K_M.gguf
- [4] tiiuae/Falcon-H1-1.5B-Deep-Instruct-GGUF: Falcon-H1-1.5B-Deep-Instruct-Q6_K.gguf
- [5] tiiuae/Falcon-H1-1.5B-Deep-Instruct-GGUF: Falcon-H1-1.5B-Deep-Instruct-Q8_0.gguf
- [6] CoreITen's Arabic test of local AI models, version 1