# FAQs on LLM Training and Data Labelling

- [LLMs Main Concepts Explained](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/llms-main-concepts-explained.md)
- [LLM Evaluation](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/llm-evaluation.md): LLM INFO AND PARAMETERS
- [Building Datasets](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/building-datasets.md)
- [Kili Technology](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/building-datasets/kili-technology.md)
- [Text Annotation](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/building-datasets/text-annotation.md)
- [SmartOne Data Labeling Services](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/building-datasets/smartone-data-labeling-services.md)
- [What is an 'Uncensored LLM'](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-is-an-uncensored-llm.md): Uncensored Models by Eric Hartford
- [Open Source AI Will Outcompete Google and OpenAI](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-is-an-uncensored-llm/open-source-ai-will-outcompete-google-and-openai.md)
- [What are Parameters in LLMs?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-parameters-in-llms.md)
- [Parameters vs Tokens in LLMs?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/parameters-vs-tokens-in-llms.md): Parameters vs Tokens in LLMs?
- [What are Model Weights?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-model-weights.md)
- [What is 'Inference Cost'?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-is-inference-cost.md)
- [Training Corpus and Datasets](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/training-corpus-and-datasets.md)
- [Open-Sourced Training Datasets for LLMs](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/training-corpus-and-datasets/open-sourced-training-datasets-for-llms.md): Open-Sourced Training Datasets for Large Language Models (LLMs)
- [Datasets List from Dr. Alan Thompson](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/training-corpus-and-datasets/datasets-list-from-dr.-alan-thompson.md)
- [Corpus Used by Large Language Models (LLMs) for Different Applications](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/training-corpus-and-datasets/corpus-used-by-large-language-models-llms-for-different-applications.md)
- [What are 'Tokens' ?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-tokens.md)
- [What are Token Limits?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-token-limits.md)
- [What Are Context Windows?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-context-windows.md)
- [Is 'Context Window' and 'Token Limit' the same?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-context-windows/is-context-window-and-token-limit-the-same.md)
- [LLM with Largest Context Window?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-context-windows/llm-with-largest-context-window.md)
- [Tokens, Words and Pages](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-are-context-windows/tokens-words-and-pages.md)
- [How to Fine Tune LLMs?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/how-to-fine-tune-llms.md): How to fine tune large language models (LLMs)
- [Case Study of Fine-Tuning an LLM](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm.md)
- [How to'Tokenize' the data?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/how-totokenize-the-data.md)
- [What are OOV Tokens?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/what-are-oov-tokens.md)
- [Arrays and Tensors](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/arrays-and-tensors.md)
- [Difference between Numpy and TensorFlow](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/arrays-and-tensors/difference-between-numpy-and-tensorflow.md)
- [NumPy or TensorFlow?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/arrays-and-tensors/numpy-or-tensorflow.md)
- [Setting Training Parameters](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/setting-training-parameters.md)
- [Do you  need to adjust Model Weights during training?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/do-you-need-to-adjust-model-weights-during-training.md)
- [Why do some models have 'Open Weights' and others 'Closed Weights'?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/why-do-some-models-have-open-weights-and-others-closed-weights.md)
- [Inference Parameters vs. Training Parameters](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/inference-parameters-vs.-training-parameters.md)
- [AutoTrain LLMs at HuggingFace](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/autotrain-llms-at-huggingface.md)
- ['TheBloke' at Huggingface?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/autotrain-llms-at-huggingface/thebloke-at-huggingface.md)
- [What are GGUF Format Model Files?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/autotrain-llms-at-huggingface/what-are-gguf-format-model-files.md)
- [What does 'Mistral 7B quantized in 4-bit with AutoAWQ' mean?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/autotrain-llms-at-huggingface/what-does-mistral-7b-quantized-in-4-bit-with-autoawq-mean.md)
- [What does a 'Quantized Version' of an LLM mean?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/case-study-of-fine-tuning-an-llm/autotrain-llms-at-huggingface/what-does-a-quantized-version-of-an-llm-mean.md)
- [What is "RAG," (Retrieval-Augmented Generation)?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-is-rag-retrieval-augmented-generation.md)
- [𝐑𝐀𝐆 𝐅𝐫𝐨𝐦 𝐒𝐜𝐫𝐚𝐭𝐜𝐡](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-is-rag-retrieval-augmented-generation/undefined.md)
- [What does "Release Base, Instruct and Reward Model" mean?](https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling/what-does-release-base-instruct-and-reward-model-mean.md)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://metaverse-imagen.gitbook.io/ai-tools-research/about-ai-tools-research/frequently-asked-questions-faqs/faqs-on-llm-training-and-data-labelling.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.