User:Azwaldo/Sandbox

to Alenoach: is this treatment of "parameters" sufficient? https://en.wikipedia.org/wiki/Parameter#Computer_programming

Lorem ipsum

A lot of articles are too complex for readers who discover the topic, and the second paragraph is indeed quite technical.

1. There should probably be an article to explain what a parameter is in machine learning. The parameters are basically the values that are modified during the training. 1 billion is very little for a LLM, 2 trillion is quite a lot (needs nearly a hundred GPUs to run the model).

2. The term "instruction fine-tuned" is correct. If the term is too complicated, maybe it could be changed to "fine-tuned" if clearer.

3. Same as a parameter, so we could reuse that term instead. Using two different terms to refer to the same thing can be confusing for unfamiliar readers.

4. Yes, that's what it means.

5. Depends on whether there are examples of applications are particularly notable. Alenoach (talk) 10:15, 6 December 2025 (UTC)

1 There should probably be an article to explain what a parameter is in machine learning Perhaps; then, a resulting Page Preview tooltip could be helpful to the reader. Would a brief parenthetical be suitable, such as the following?

"...ranging from 1 billion to 2 trillion parameters (values that are modified during the training to optimize the output)."

2 If clarity is at issue, the the use of "instruction" here has meaning that is particular to the subject (jargon). (Is it somehow different from saying that a teacher is fine-tuning her pupils?)

Special:Search