-
- Downloads
Added config/changed preprocessing to work with ollama
- added .env config for test with Llama3.2 for pool PC (TODO: rename to .env.llama3.2.example) - added langchain-ollama python package and changed Chat and Embeddings calls accordingly (mainly constructors) - switched preprocessing to ollama3.2, model needs to be configured in CHESS/src/database_utils/db_catalog/preprocess.py - added engine config (models their config for each agent, preprocessing (embedding api, generating tokens) does not use this - changed retrieve_entity.py to also use OllamaEmbeddings, because Embeddings are configured separately - adapted run scripts to work with configured env - adapted tool/agent configs to work with new ollama config - added a place to put ollama and models locally, more or less to prepare different places (data buckets on server) - added some things to gitignore - TODO: documentation of the changes and configs above - TODO: documentation on how and where to get the datasets and where to put them
Showing
- .gitignore 5 additions, 0 deletions.gitignore
- CHESS/.env.ollama3.2.example 20 additions, 0 deletionsCHESS/.env.ollama3.2.example
- CHESS/requirements.txt 2 additions, 1 deletionCHESS/requirements.txt
- CHESS/run/configs/CHESS_IR_CG_UT_LLAMA3-2.yaml 68 additions, 0 deletionsCHESS/run/configs/CHESS_IR_CG_UT_LLAMA3-2.yaml
- CHESS/run/configs/CHESS_IR_SS_CG_LLAMA3-2.yaml 69 additions, 0 deletionsCHESS/run/configs/CHESS_IR_SS_CG_LLAMA3-2.yaml
- CHESS/run/run_main_ir_cg_ut_llama3.2.sh 11 additions, 0 deletionsCHESS/run/run_main_ir_cg_ut_llama3.2.sh
- CHESS/run/run_main_ir_ss_cg_llama3.2.sh 11 additions, 0 deletionsCHESS/run/run_main_ir_ss_cg_llama3.2.sh
- CHESS/run/run_preprocess.sh 0 additions, 0 deletionsCHESS/run/run_preprocess.sh
- CHESS/src/database_utils/db_catalog/preprocess.py 3 additions, 1 deletionCHESS/src/database_utils/db_catalog/preprocess.py
- CHESS/src/llm/engine_configs.py 12 additions, 0 deletionsCHESS/src/llm/engine_configs.py
- CHESS/src/workflow/agents/information_retriever/tool_kit/retrieve_entity.py 4 additions, 2 deletions.../agents/information_retriever/tool_kit/retrieve_entity.py
- README.md 44 additions, 1 deletionREADME.md
- ollama/.gitignore 0 additions, 0 deletionsollama/.gitignore
- ollama/models/.gitignore 0 additions, 0 deletionsollama/models/.gitignore
Loading
Please register or sign in to comment