Welcome to Software Development on Codidact!
Will you help us build our independent community of developers helping developers? We're small and trying to grow. We welcome questions about all aspects of software development, from design to code to QA and more. Got questions? Got answers? Got code you'd like someone to review? Please join us.
Activity for Franck Dernoncourtâ€
| Type | On... | Excerpt | Status | Date |
|---|---|---|---|---|
| Edit | Post #292940 | Initial revision | — | 4 months ago |
| Question | — |
Why are model_q4.onnx and model_q4f16.onnx not 4 times smaller than model.onnx? I see on https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct/tree/main/onnx: | File Name | Size | |--------------------|--------| | model.onnx | 654 MB | | modelfp16.onnx | 327 MB | | modelq4.onnx | 200 MB | | modelq4f16.onnx | 134 MB | I understand th... (more) |
— | 4 months ago |