Release notes from ragbuilder

v0.1.6

2025-05-20T03:53:01Z

Release 0.1.6

v0.1.5

2025-01-07T09:02:25Z

Release version 0.1.5

v0.1.4

2024-12-31T18:11:26Z

What's Changed

New SDK that allows for module-wise optimization.

Basic Usage:

from ragbuilder import RAGBuilder

# Initialize and optimize
builder = RAGBuilder.from_source_with_defaults(input_source='data.pdf')
results = builder.optimize()

# Run a query through the complete pipeline
response = results.invoke("What is HNSW?")

# View optimization summary
print(results.summary())

Advanced Configuration
For fine-grained control, you can customize every aspect:

from ragbuilder.config import (
    DataIngestOptionsConfig,
    RetrievalOptionsConfig,
    GenerationOptionsConfig
)

# Configure data ingestion
data_ingest_config = DataIngestOptionsConfig(
    input_source="data.pdf",
    document_loaders=[
        {"type": "pymupdf"},
        {"type": "unstructured"}
    ],
    chunking_strategies=[{
        "type": "RecursiveCharacterTextSplitter",
        "chunker_kwargs": {"separators": ["\n\n", "\n", " ", ""]}
    }],
    chunk_size={"min": 500, "max": 2000, "stepsize": 500},
    embedding_models=[{
        "type": "openai",
        "model_kwargs": {"model": "text-embedding-3-large"}
    }]
)

# Configure retrieval
retrieval_config = RetrievalOptionsConfig(
    retrievers=[
        {
            "type": "vector_similarity",
            "retriever_k": [20],
            "weight": 0.5
        },
        {
            "type": "bm25",
            "retriever_k": [20],
            "weight": 0.5
        }
    ],
    rerankers=[{
        "type": "BAAI/bge-reranker-base"
    }],
    top_k=[3, 5]
)

# Initialize with custom configs
builder = RAGBuilder(
    data_ingest_config=data_ingest_config,
    retrieval_config=retrieval_config
)

# Access individual components
vectorstore = results.data_ingest.get_vectorstore()
docs = results.retrieval.invoke("What is RAG?")
answer = results.generation.invoke("What is RAG?")

Full Changelog: 0.0.22...v0.1.4

v0.1.3

2024-12-28T15:43:18Z

Release version 0.1.3

v0.1.1

2024-12-26T18:38:48Z

repr fix

v0.1.0: End to end working v0

2024-12-16T19:47:03Z

Save retriever pipeline.retriever_chain as the optimized_retriever instead of the pipeline itself.
Deprecated lazy_load2
Fixed study_name default setting in OptimizationConfig

0.0.22

2024-10-25T02:37:12Z

What's Changed

Enhance DataProcessor Class for Error Handling, Efficiency, and Logging Improvements by @Mefisto04 in #72
Bug fixes by @aravind10x in #77

New Contributors

@Akhsuna07 made their first contribution in #75
@Mefisto04 made their first contribution in #72

Full Changelog: 0.0.21...0.0.22

0.0.21

2024-10-19T12:45:22Z

What's Changed

VectorDB Support: Qdrant & Weaviate by @ashwinzyx in #73
Docker-Brew fix by @ashwinzyx in #74

Full Changelog: 0.0.20...0.0.21

0.0.20

2024-10-15T08:46:49Z

What's Changed

Add chat playground by @aravind10x in #64

New Contributors

@eltociear made their first contribution in #48
@FarukhS52 made their first contribution in #60
@Ruhi14 made their first contribution in #61

Full Changelog: 0.0.18...0.0.20

0.0.18

2024-10-06T05:49:27Z

What's Changed

Colbert Retriever by @ashwinzyx in #53
Change re-ranker selection to 1 at a time by @aravind10x in #54

Full Changelog: 0.0.17...0.0.18