NVIDIA

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

A model by NVIDIA you run on your own computer, offline: how it did in our Arabic test, the size of each of its files as Hugging Face lists it, the memory a conversation takes worked out from the file itself as llama.cpp reserves it, and whether it fits your card and RAM.

Released:

Compare two products

The graphics card in your computer

Press the button and your browser reads the name of your computer's graphics card, which we pick in the check if the Lab has it.

The card's name is never sent to our site: it stays in this browser alone until you press "Forget my device".

How the name is read

Can your PC run it?

In GB, as Windows shows it under Settings > System > About.

Everything in the conversation, your questions and the model's answers. A token is a piece of a word.

Going by this page's figures

Pick the graphics card in your computer or type its RAM, and we'll say which of this model's files fit.

    We haven't worked out this model's conversation memory: its layer layout isn't checked against llama.cpp yet, so these sums count the file and working memory only, and it needs more.

    How we work out whether a model fits

    Specifications

    Specifications and their sources
    The model
    Parameters 31.6 billion[1]
    Longest conversation 1,048,576 tokens[2]
    Licence other[1]
    GGUF files to download
    Q4_K_M file 25.43 GB[2]
    Q5_K_M file 27.04 GB[3]
    Q6_K file 34.92 GB[4]
    Q8_0 file 35 GB[5]
    The Arabic test
    Arabic score 82 %[6] Run by CoreITen from its Q4_K_M file, with llama.cpp
    Understanding Arabic text 95 %[6]
    Following Arabic instructions 81 %[6]
    Does not invent 69 %[6]
    Made-up products it gave specs for (of 8) 4[6]
    Answers that slipped into another script (of 56) 1[6]

    Compare two products