Open-weight model
The trained parameters can be obtained and independently executed.
- Downloadable model artifact
- Self-hosting can be possible
- Fine-tuning may be possible
- Rights depend on license
A practical, vendor-neutral guide to model weights, licenses, formats, quantization, customization, inference, deployment, evaluation, security, observability and AI sovereignty.
An AI model whose trained parameters are made available so users can obtain and run the model independently, subject to the release terms and license.
Weight availability is one property of an AI release. It should not be confused with a claim that the complete AI system is open source.
Three concepts that are often mixed together but answer different questions.
The trained parameters can be obtained and independently executed.
A broader openness claim involving freedoms, licensing and sufficient material to study and modify the system.
The provider runs the model and exposes an interface instead of distributing the underlying checkpoint.
Search by concept or filter by technical layer. Select a card for a deeper explanation and practical implications.
Open weights are only the first layer. Production AI requires a chain of engineering disciplines around the model artifact.
Obtain, inspect and version the model artifact.
Adapt behavior through prompts, RAG, adapters or fine-tuning.
Test quality, safety, reliability and task fit.
Serve the model efficiently on target hardware.
Measure latency, utilization, errors, quality and drift.
Determine whether the complete system is ready for real-world use.
A compact way to think about when open-weight deployment may be attractive and where extra responsibility appears.
| Requirement | Open-weight deployment | What to verify |
|---|---|---|
| Private infrastructure | Strong fit | Network, logging, storage, telemetry and external dependencies |
| Model customization | Strong fit | License, architecture support, training stack, evaluation |
| Offline / air-gapped use | Possible | Artifact transfer, package mirrors, patching, update process |
| Minimal operations team | Higher burden | Managed inference may be preferable |
| Strict latency control | Potential advantage | Benchmark exact model/runtime/hardware combination |
| Predictable versioning | Strong fit | Pin repository revision, tokenizer, runtime and quantization |
| Zero maintenance | Poor fit | Self-hosting transfers operational responsibility to the user |
Core terminology for understanding open-weight AI systems.