How to import only the layers relevant for creating embeddings?
#254
by Shashwat-AI-wiz - opened
I am using Google Colab to build a RAG system using Llamaindex. I intend to use the Mixtral model as a text embedding model. However, when I am loading the model in my notebook, it fills up the entire storage available to me. Hence, I want to extract only the layers that can be used for creating text embedding vectors. Can anyone help me with this?