consolidate pipelines and config

[harsha-simhadri]

We now have an agentic_Retriever.py and dynamic_retriever.py and corresponding config files which are some what different. Let us consolidate the config files or remove redundant ones.