llama-cpp-python forked version while contains some modifications, provides much more simpler inference API and demo. Integrated with my ChatBots.
By chatting or signing in you agree to the Terms and chat-message logging (revocable in History).