#

prenormalization

Here is 1 public repository matching this topic...

anto18671 / lumenspark

Lumenspark is a lightweight Linformer-based Language Model Trained from Scratch

training text-classification text-generation transformer low-rank-approximation pretraining linformer llm runpod prenormalization layer-scale

Updated Oct 24, 2024
Python

Improve this page

Add a description, image, and links to the prenormalization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the prenormalization topic, visit your repo's landing page and select "manage topics."