Article has comparison with other code-LLM models

Includes code generation models

Review of LLM specialized for code generation

List of LLM models on Wikipedia

Chat, models. Not open source, but instruct and relatively small (3B). The 3B instruct may be the best to try on Newspeak.

Model which generates code for Python, Javascript, Go, Shell, Perl, Swifg, Ruby, PHP

AI Code tools : Good summary. Does not talk about which pre-trained model they use. One is gemini (bard) -> alphacode2

Best summary of Natural Language Processing and terms - model (a language model - e.g. BertModel, defines encoder and decoder and their properties), transformer (a specific neural network based on attention paper), encoder (series of transformers on input), decoders (series of transformers on output). Bert does NOT use decoder. TensorFlow and PyTorch are possible backends to Transformers (NN). Summary: BERT is a highly complex and advanced language model that helps people automate language understanding.

BigCode is an open scientific collaboration working on the responsible development and use of large language models for code

Hi level only talk about training for a language

Describes how to train a new language (desperanto) model.

Look for models that could be used in Newspeak

Models and celebrity sexy photos