HigherOrderCO/HVM
Fork: 408 Star: 10557 (更新于 2024-12-11 20:10:22)
license: Apache-2.0
Language: Cuda .
A massively parallel, optimal functional runtime in Rust
Higher-order Virtual Machine 2 (HVM2)
Higher-order Virtual Machine 2 (HVM2) is a massively parallel Interaction Combinator evaluator.
By compiling programs from high-level languages (such as Python and Haskell) to HVM, one can run these languages directly on massively parallel hardware, like GPUs, with near-ideal speedup.
HVM2 is the successor to HVM1, a 2022 prototype of this concept. Compared to its predecessor, HVM2 is simpler, faster and, most importantly, more correct. HOC provides long-term support for all features listed on its PAPER.
This repository provides a low-level IR language for specifying the HVM2 nets and a compiler from that language to C and CUDA. It is not meant for direct human usage. If you're looking for a high-level language to interface with HVM2, check Bend instead.
Usage
DISCLAIMER: Windows is currently not supported, please use WSL for now as a workaround.
First install the dependencies:
- If you want to use the C runtime, install a C-11 compatible compiler like GCC or Clang.
- If you want to use the CUDA runtime, install CUDA and nvcc (the CUDA compiler).
- HVM requires CUDA 12.x and currently only works on Nvidia GPUs.
Install HVM2:
cargo install hvm
There are multiple ways to run an HVM program:
hvm run <file.hvm> # interpret via Rust
hvm run-c <file.hvm> # interpret via C
hvm run-cu <file.hvm> # interpret via CUDA
hvm gen-c <file.hvm> # compile to standalone C
hvm gen-cu <file.hvm> # compile to standalone CUDA
All modes produce the same output. The compiled modes require you to compile the
generated file (with gcc file.c -o file
, for example), but are faster to run.
The CUDA versions have much higher peak performance but are less stable. As a
rule of thumb, gen-c
should be used in production.
Language
HVM is a low-level compile target for high-level languages. It provides a raw syntax for wiring interaction nets. For example:
@main = a
& @sum ~ (28 (0 a))
@sum = (?(((a a) @sum__C0) b) b)
@sum__C0 = ({c a} ({$([*2] $([+1] d)) $([*2] $([+0] b))} f))
&! @sum ~ (a (b $([+] $(e f))))
&! @sum ~ (c (d e))
The file above implements a recursive sum. If that looks unreadable to you - don't worry, it isn't meant to. Bend is the human-readable language and should be used both by end users and by languages aiming to target the HVM. If you're looking to learn more about the core syntax and tech, though, please check the PAPER.
最近版本更新:(数据更新于 2024-10-09 12:36:30)
HigherOrderCO/HVM同语言 Cuda最近更新仓库
2024-09-27 13:31:21 nerfstudio-project/gsplat
1970-01-01 00:00:00 leocalm/Lyra
1970-01-01 00:00:00 farkhor/CuSha
1970-01-01 00:00:00 HazyResearch/ThunderKittens
1970-01-01 00:00:00 karpathy/llm.c