withablink's recent timeline updates

RWKV-LM RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

ChatRWKV ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

AI-Writer AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation.

Hua Hua is an AI image editor with Stable Diffusion (and more).

RWKV-CUDA The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

nanoRWKV RWKV in nanoGPT style

minGPT-tuned A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Albatross RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090

modded-nanogpt-rwkv RWKV-7: Surpassing GPT

BlinkDL.github.io A collection of State of the Art results in AI / ML / DL / RL / CV / NLP.

BlinkDL A minimalist deep learning library in Javascript using WebGL + asm.js. Run convolutional neural network in your browser.

fast.c Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.

RWKV-v2-RNN-Pile RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

LinearAttentionArena Here we will test various linear attention designs.

SmallInitEmb LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

BookCNN 《深度卷积网络：原理与实践》现已在淘宝天猫京东当当发售. 这里是其中的代码下载.

Agen Agen is a minimalist language for agent loops and state machines.

WorldModel Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business / finance / governance, and can align agents with human too.

LM-Trick-Questions Here we collect trick questions and failed tasks for open source LLMs to improve them.

Basis The Basis Programming Language

BlinkToDo A minimalist ToDo.txt page. 如果你的ToDo有一百项以上，试试这个基于txt的极简事项管理工具。

RWKV.com

AntiAging List of Anti-aging Research

zoology Understand and test language model architectures on synthetic tasks.

Nala The Nala markup, to turn a "Natural Language" sentence into a code-like statement. Nala 标注，将自然语言变为编程语言。

PathTracingJS Path tracing demo with JS in your web browser. 用浏览器JS做路径跟踪渲染。

BlinkColorTheme A colorful theme for HTML+JS+CSS.

Model_Leaderboard Leaderboard of AI models.

MathBook 一个较为系统的数学笔记（graduate level）

BasisLang.com BasisLang.com

FastChat An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.

gpt-neox An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

libai LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

OpenAudioTest

ProjectIvory Project Ivory is a simple forum written a few years ago.

withablink http://withablink.com 🏢  http://withablink.com / 联合创始人 V2EX member #49842, joined on 2013-11-16 16:27:41 +08:00

我们是个做高品质硬件的 startup ：
http://withablink.com

我的知乎是：
http://www.zhihu.com/people/bopengbopeng

欢迎关注～