10 lines
793 B
Plaintext
10 lines
793 B
Plaintext
|
ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
|
||
|
|
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
|
||
|
|
ggml_cuda_init: found 2 ROCm devices:
|
||
|
|
Device 0: AMD Radeon Graphics, gfx1201 (0x1201), VMM: no, Wave Size: 32
|
||
|
|
Device 1: AMD Radeon Graphics, gfx1201 (0x1201), VMM: no, Wave Size: 32
|
||
|
|
main: error: failed to create context with model '/home/kyuz0/models/Q3_K_S/Devstral-2-123B-Instruct-2512-Q3_K_S-00001-of-00002.gguf'
|
||
|
|
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
|
||
|
|
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
|
||
|
|
✖ ! [rocm-7.9-rocwmma] Devstral-2-123B-Instruct-2512-Q3_K_S-00001-of-00002__fa1 __longctx32768 failed (exit 0)
|