diff options
Diffstat (limited to 'llama.cpp/examples/sycl/README.md')
| -rw-r--r-- | llama.cpp/examples/sycl/README.md | 41 |
1 files changed, 41 insertions, 0 deletions
diff --git a/llama.cpp/examples/sycl/README.md b/llama.cpp/examples/sycl/README.md new file mode 100644 index 0000000..8819d87 --- /dev/null +++ b/llama.cpp/examples/sycl/README.md @@ -0,0 +1,41 @@ +# llama.cpp/example/sycl + +This example program provides the tools for llama.cpp for SYCL on Intel GPU. + +## Tool + +|Tool Name| Function|Status| +|-|-|-| +|llama-ls-sycl-device| List all SYCL devices with ID, compute capability, max work group size, ect.|Support| + +### llama-ls-sycl-device + +List all SYCL devices with ID, compute capability, max work group size, ect. + +1. Build the llama.cpp for SYCL for the specified target *(using GGML_SYCL_TARGET)*. + +2. Enable oneAPI running environment *(if GGML_SYCL_TARGET is set to INTEL -default-)* + +``` +source /opt/intel/oneapi/setvars.sh +``` + +3. Execute + +``` +./build/bin/llama-ls-sycl-device +``` + +Check the ID in startup log, like: + +``` +found 2 SYCL devices: +| | | | |Max | |Max |Global | | +| | | | |compute|Max work|sub |mem | | +|ID| Device Type| Name|Version|units |group |group|size | Driver version| +|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------| +| 0| [level_zero:gpu:0]| Intel Arc A770 Graphics| 1.3| 512| 1024| 32| 16225M| 1.3.29138| +| 1| [level_zero:gpu:1]| Intel UHD Graphics 750| 1.3| 32| 512| 32| 62631M| 1.3.29138| + +``` + |