🚨 Important 🚨
For those using LoRA/QLoRA for fine-tuning their model: If you add special tokens to the tokenizer, such as <special_token1>, <special_token2>, etc., ensure you also add the embed_tokens module to your LoRA config target modules. Without this, the embeddings for