Skip to content

v1.3.15#38

Merged
Eamon2009 merged 4 commits into
v1.3.15from
master
Jul 16, 2026
Merged

v1.3.15#38
Eamon2009 merged 4 commits into
v1.3.15from
master

Conversation

@Eamon2009

Copy link
Copy Markdown
Member

No description provided.

Added an image and updated the quick start section.
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md
@Eamon2009 Eamon2009 merged commit c6d0dd9 into v1.3.15 Jul 16, 2026
3 checks passed
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
…uilds (#39)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
#40)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
#41)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics

* main: Add config.h with default model hyperparameters and constants
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics

* main: Add config.h with default model hyperparameters and constants

* data: Add script to stream and compile TinyStories dataset

* data: Add script to stream and compile TinyStories dataset  Introduce a data preparation script that streams the TinyStories dataset  from Hugging Face and extracts stories sequentially into a flat text file.  The script is configured to: - Enable dataset streaming mode (`streaming=True`) to minimize local    storage and RAM footprints during processing. - Intercept and append structural newline spacing (`\n\n`) between discrete    story blocks. - Track exact byte sizing to dynamically enforce an upper threshold limit    (defaulting to a 10,000 MB cap) before safely closing out output generation.  Saves the compiled corpus to 'input.txt' for downstream tokenization.
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
…ts.txt (#43)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics

* main: Add config.h with default model hyperparameters and constants

* data: Add script to stream and compile TinyStories dataset

* data: Add script to stream and compile TinyStories dataset  Introduce a data preparation script that streams the TinyStories dataset  from Hugging Face and extracts stories sequentially into a flat text file.  The script is configured to: - Enable dataset streaming mode (`streaming=True`) to minimize local    storage and RAM footprints during processing. - Intercept and append structural newline spacing (`\n\n`) between discrete    story blocks. - Track exact byte sizing to dynamically enforce an upper threshold limit    (defaulting to a 10,000 MB cap) before safely closing out output generation.  Saves the compiled corpus to 'input.txt' for downstream tokenization.

* main: Add foundational training and inference libraries to requirements.txt
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics

* main: Add config.h with default model hyperparameters and constants

* data: Add script to stream and compile TinyStories dataset

* data: Add script to stream and compile TinyStories dataset  Introduce a data preparation script that streams the TinyStories dataset  from Hugging Face and extracts stories sequentially into a flat text file.  The script is configured to: - Enable dataset streaming mode (`streaming=True`) to minimize local    storage and RAM footprints during processing. - Intercept and append structural newline spacing (`\n\n`) between discrete    story blocks. - Track exact byte sizing to dynamically enforce an upper threshold limit    (defaulting to a 10,000 MB cap) before safely closing out output generation.  Saves the compiled corpus to 'input.txt' for downstream tokenization.

* main: Add foundational training and inference libraries to requirements.txt

* ci: Add multi-platform automated compilation and release workflow
Eamon2009 added a commit that referenced this pull request Jul 16, 2026
* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* docs: Add README covering Python setups, PyTorch inference, and C++ builds

* doc: Add training and validation loss curves to assets (#38)

* Update README with image and quick start section

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets (#35)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Configure GPT-style model hyperparameters and tokenizer (#36)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* V1.3.15 (#37)

* Update README with image and quick start section (#34)

Added an image and updated the quick start section.

* doc: Add training and validation loss curves to assets

Introduce visual plots tracking cross-entropy loss over 6,000 steps
and ~78 minutes of wall-clock training time.

These curves serve as a baseline reference for the model's convergence
behavior. The plots highlight a steady decline in training loss down to
~3.4, while validation loss plateaus early on, achieving its best score
of 4.1319 at step 3900.

Adding these assets to the repository ensures we have a clear, permanent
record of this run's performance to compare against future optimization
and hyperparameter tuning passes.

* main: Config model hyperparameters and tokenizer

* Delete quadtrix_training_report.png

* Delete run.md

* doc: Update training plots with generalization gap and 7k iter metrics

* main: Add config.h with default model hyperparameters and constants

* data: Add script to stream and compile TinyStories dataset

* data: Add script to stream and compile TinyStories dataset  Introduce a data preparation script that streams the TinyStories dataset  from Hugging Face and extracts stories sequentially into a flat text file.  The script is configured to: - Enable dataset streaming mode (`streaming=True`) to minimize local    storage and RAM footprints during processing. - Intercept and append structural newline spacing (`\n\n`) between discrete    story blocks. - Track exact byte sizing to dynamically enforce an upper threshold limit    (defaulting to a 10,000 MB cap) before safely closing out output generation.  Saves the compiled corpus to 'input.txt' for downstream tokenization.

* main: Add foundational training and inference libraries to requirements.txt

* ci: Add multi-platform automated compilation and release workflow

* docker: Remove development Dockerfile for the frontend
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant