Skip to content

feat: storage option#78

Merged
winstonww merged 11 commits intomainfrom
feat-w-3
Jan 28, 2022
Merged

feat: storage option#78
winstonww merged 11 commits intomainfrom
feat-w-3

Conversation

@winstonww
Copy link
Copy Markdown
Contributor

@winstonww winstonww commented Jan 26, 2022

To better keep track of the TODO items, I have compiled the TODOs from the code into the following summary:

  • Investigate into get/set attribute support (e.g. da[1, ['text', 'id']])
  • Clarify, Investigate and refactor the current set attribute logic
  • Add test coverage for AllMixin
  • Combine DocumentArray and its meta object into one single schema
  • Investigate and use/test base class' _set_doc_value_pairs; add test coverage
  • Currently, vectorIndexConfig is disabled to allow docs with no embeddings to be added. But this needs to change as it also disables vector search functionality. Will stay tuned and address this in the next step.
  • Add match function

This PR incorporated some previous changes from @alaeddine-13 on test setup and also some initial suggestions from @numb3r3. Thanks for the feedback.

@codecov
Copy link
Copy Markdown

codecov bot commented Jan 26, 2022

Codecov Report

Merging #78 (bfbc336) into main (1ed4ddd) will increase coverage by 0.67%.
The diff coverage is 91.33%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main      #78      +/-   ##
==========================================
+ Coverage   82.98%   83.65%   +0.67%     
==========================================
  Files          87       92       +5     
  Lines        3814     4105     +291     
==========================================
+ Hits         3165     3434     +269     
- Misses        649      671      +22     
Flag Coverage Δ
docarray 83.65% <91.33%> (+0.67%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
docarray/array/storage/sqlite/seqlike.py 71.42% <ø> (+3.09%) ⬆️
docarray/array/storage/base/getsetdel.py 53.52% <20.00%> (-0.90%) ⬇️
docarray/array/storage/sqlite/getsetdel.py 98.33% <66.66%> (-1.67%) ⬇️
docarray/array/storage/weaviate/backend.py 84.84% <84.84%> (ø)
docarray/array/mixins/getitem.py 85.71% <85.71%> (-0.50%) ⬇️
docarray/array/storage/memory/getsetdel.py 96.55% <90.90%> (-1.37%) ⬇️
docarray/array/storage/weaviate/seqlike.py 94.28% <94.28%> (ø)
docarray/array/mixins/setitem.py 86.13% <95.45%> (+6.39%) ⬆️
docarray/array/storage/weaviate/getsetdel.py 99.01% <99.01%> (ø)
docarray/array/document.py 81.48% <100.00%> (+2.31%) ⬆️
... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1ed4ddd...bfbc336. Read the comment docs.

@winstonww winstonww force-pushed the feat-w-3 branch 2 times, most recently from 24e412b to 16ee772 Compare January 26, 2022 08:40
@winstonww winstonww marked this pull request as ready for review January 28, 2022 08:41
Copy link
Copy Markdown
Contributor

@numb3r3 numb3r3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@winstonww winstonww merged commit f55fb47 into main Jan 28, 2022
@winstonww winstonww deleted the feat-w-3 branch January 28, 2022 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants