Llama_index basically does that. You have even some tuto using Streamlit that creates a UI around it for you.