Skip to content

feat: add sqlite storage backend#69

Merged
hanxiao merged 68 commits intomainfrom
feat-persist
Jan 25, 2022
Merged

feat: add sqlite storage backend#69
hanxiao merged 68 commits intomainfrom
feat-persist

Conversation

@hanxiao
Copy link
Copy Markdown
Member

@hanxiao hanxiao commented Jan 20, 2022

  • pass the test test_advance_indexing.py
  • sugar API on DocumentArray (what @alaeddine-13 proposed)
  • have some basic sense of the speed. how much slowdown one should expect by using sqlite storage.

class BaseDocumentArray(ABC):
def __init__(self, *args, storage: str = 'memory', **kwargs):
super().__init__()
self._init_storage(*args, **kwargs)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is _init_storage() still necessary?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh im actually not so sure now, will wait for @alaeddine-13

@hanxiao hanxiao marked this pull request as ready for review January 25, 2022 17:24
@hanxiao hanxiao merged commit ab788b2 into main Jan 25, 2022
@hanxiao hanxiao deleted the feat-persist branch January 25, 2022 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants