Inkling (large language model)
Inkling is an open-weights large language model created by Thinking Machines company, first released on July 15, 2026.[1] It is published under an Apache 2.0 license.[2] The model allows text, images and audio as input, and can be used for tasks such as chat, software development, multilingual applications or agentic systems. [2]
Training
The first large language model released by Thinking Machines, Inkling was trained with 45 trillion tokens of text, image, audio, and video. It reasons natively from input in any of these four formats, while, at the moment, it can generate only text, including source code or structured data.[3]
Features
Inkling was designed to be adaptable and efficient when used in real-world workflows. The cost/performance relationship can be optimized, by programmatically adjusting the model's reasoning budget (that is, the amount of "thought" that the model must perform before generating an output), in a scale from 0.2 to 0.99. This way, different levels of "thinking" effort can be used according to the needs of each particular task.[4]
Unlike most other large language models (including open-weight ones), Inkling was created with a focus on resistance to censorship, providing direct answers when questioned on censored or politically sensitive topics. Its creators recommend using external tools for content moderation, since they consider that internal safety evaluation in the language models occasionally doesn't prevent the model from complying with potentially harmful prompts that shouldn't be answered.[4]
Technical information
The model allows for a context window of up to 1,048,576 tokens,[2] and can be deployed using common inference libraries such as llama.cpp.[4]
Inference hardware requirements
The 1-bit dynamic quantization variant, designated as UD-IQ1_S, requires 270 GB of disk space for storage. Operational deployment of this 1-bit quantization requires a hardware configuration such as a Mac Studio Ultra, or alternative systems equipped with a minimum combined RAM and VRAM capacity of approximately 290 GB. In comparison, while the 1-bit variant can be accommodated within a 290 GB RAM system configuration, the 6/8-bit variant necessitates a minimum of 900 GB of RAM.[2]
The following table outlines the total memory requirements (RAM + VRAM, or unified memory) required for model inference across different quantization levels:[2]
| Quantization Level | Memory Required |
|---|---|
| BF16 | 1900 GB |
| 6/8-bit | 870 GB |
| 4-bit | 600 GB |
| 3-bit | 450 GB |
| 2-bit | 325 GB |
| 1-bit | 280-295 GB |
Retained top-1 accuracy
The following table outlines the percentage of original accuracy retained by the model across different quantization levels:[2]
| Quantization Level | Accuracy Retained |
|---|---|
| BF16 | 100.0% |
| 6/8-bit | 99.8% |
| 4-bit | 94.4% |
| 3-bit | 88.7% |
| 2-bit | 81.0% |
| 1-bit | 74.2%-77.4% |
References
- ^ "Inkling: Thinking Machines' Open-Weights Model". www.datacamp.com. Retrieved 2026-07-20.
- ^ a b c d e f "Inkling - How to Run Locally | Unsloth Documentation". unsloth.ai. 2026-07-18. Retrieved 2026-07-20.
- ^ Loizos, Connie (2026-07-15). "Thinking Machines amps up its bet against one-size-fits-all AI with its first open model, Inkling". TechCrunch. Retrieved 2026-07-20.
- ^ a b c Franzen, Carl (2026-07-15). "Thinking Machines open sources first multimodal language model, Inkling, focused on low cost and 'resistance to censorship'". VentureBeat. Retrieved 2026-07-20.
Content Disclaimer
Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.
- The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
- There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
- It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
- Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
- Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.