llm.cpp/CITATION.cff at master · eamonsippy/llm.cpp · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: llm.cpp
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Eamon
    name-particle: 'Eamon Sippy '
    email: eamon112009@gmail.com
    family-names: EAMON
identifiers:
  - type: url
    value: 'https://github.com/LMGNU/llm.cpp'
    description: LLM training in C++ & Python.
repository-code: 'https://github.com/LMGNU/llm.cpp'
abstract: >-
  LLM training in C++ & Python.

  No third-party runtime dependency - it builds from
  main.cpp, config/config.h, and include/*.h alone.


  Character-level tokenizer built directly from the input
  corpus

  Train/validation split via DataLoader

  Token + positional embeddings

  Multi-head causal self-attention with explicit QKV
  projections

  Pre-layer-norm residual transformer blocks

  Feed-forward MLP with ReLU

  Cross-entropy loss

  Fully analytical backward pass —-every gradient
  (attention, layer norm, MLP, embeddings) is derived and
  coded in include/backward.h, not autograd

  AdamW optimizer (first/second moment estimates, weight
  decay)

  Checkpoint save/load

  Autoregressive generation and terminal chat mode
keywords:
  - llm
  - transformer
license: GPL-3.0