From 70e5f07d5ff22f4d3667569d5f1e58d78aa45905 Mon Sep 17 00:00:00 2001 From: ed Date: Mon, 12 Jun 2023 08:07:14 +0200 Subject: [PATCH] README update --- README.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index a03c7ae..e44f3d4 100644 --- a/README.md +++ b/README.md @@ -2,6 +2,13 @@ This is a port of [BlinkDL/RWKV-LM](https://github.com/BlinkDL/RWKV-LM) to [ggerganov/ggml](https://github.com/ggerganov/ggml). + +**This is NOT the original repo** + +As the AI research is evolving at a rapid pace, I, edbrz9, made a "snapshot" of [saharNooby](https://github.com/saharNooby/rwkv.cpp/tree/master)'s original repo. This snapshot was made on June 12th 2023. + +Below is the rest of the original README file. + Besides the usual **FP32**, it supports **FP16**, **quantized INT4, INT5 and INT8** inference. This project is **CPU only**. This project provides [a C library rwkv.h](rwkv.h) and [a convinient Python wrapper](rwkv%2Frwkv_cpp_model.py) for it. @@ -182,7 +189,7 @@ Example of using `rwkv.cpp` in your custom Python script: import rwkv_cpp_model import rwkv_cpp_shared_library -# Change to model paths used above (quantized or full weights) +# Change to model paths used above (quantized or full weights) model_path = r'C:\rwkv.cpp-169M.bin'