Skip to content

Releases: trholding/llama2.c

L2E OS v0.1 "Temple DOS"

02 Oct 14:07
95bbc0e
Compare
Choose a tag to compare

This is the ISO release of L2E OS v0.1 "Temple DOS"

Use an app like etcher or cli tool like dd to raw copy image to a pen drive to boot on a computer.

You can also boot this in qemu using the following command as example:

qemu-system-x86_64 -display gtk,zoom-to-fit=off -m 512 -accel kvm -vga virtio -cdrom l2eos.iso

L2E 0.1 Build

26 Aug 05:22
d3b97f4
Compare
Choose a tag to compare

This release contains the following:

  • Portable cosmocc build
  • Unikernel build

The smallest model is embedded in them.

See https://github.com/trholding/llama2.c on how to run.

Experimental Standalone and Llama 2 64bit Portable Binary

27 Jul 05:25
7b31221
Compare
Choose a tag to compare

This is a experimental release compiled with the following features:

  • Aarch64 support (slow, emulated with blink, ARM64 Mac, 64bit Raspi, ARM 64 bit machines)
  • Baremetal Support (boot but not fully functiona, can't open model)
  • Standalone (Embedded model)

Due to standalone/baremetal support, this build will ignore cli arguments.

Just copy and run run.com in a cli on any 64 Bit OS

*BSD/Linux Example:

$ ./run.com

Windows Example:

C:> run.com

Initial bootup is slower as model will be uncompressed first.

x86_64 performance is a bit higher with cosmocc non openmp builds.

Test *baremetal boot like this:

qemu-system-x86_64 -serial stdio -hda run.com

*baremetal boots but not yet fully functional as model file can't be opened without a fix in toolchain.

Built with:

cosmocc -Ofast -funsafe-math-optimizations -ffast-math  \ 
-D COSMO_BLINK -D COSMO_METAL -D COSMO_ZIP -o run.com run.c -lm

Includes the following model:

https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin