Skip to content

Go bindings tensors#1

Open
alonsovidales wants to merge 2030 commits intotmc:go_bindingsfrom
alonsovidales:go_bindings_tensors
Open

Go bindings tensors#1
alonsovidales wants to merge 2030 commits intotmc:go_bindingsfrom
alonsovidales:go_bindings_tensors

Conversation

@alonsovidales
Copy link
Copy Markdown

Hi Travis,
I have been working today on some helpers to access to the data contained in the tensors, as also adding some more tests. This is still a work in progress I just doing this PR just to show what I'm working on and to know what do you think, are you working on something similar? Please feel you free to take a look :)
I had been trying to do the binding with Swig and Bazel time ago, but since I have no experience with both of this tools and I had some personal problems I finally gave up. Thanks a lot for taking the time to prepare this.
I think that I could contribute with finishing the helpers to access the data as also to create tensors from Go and so.
By the moment, from the next data, types the ones with the V are supported:

  • TF_FLOAT V V
  • TF_DOUBLE V V
  • TF_INT32 V V
  • TF_UINT8 V V
  • TF_UINT16 ? Unsupported?: tensor_test.go:17: line 8: invalid tensorflow.DataType: DT_UINT16
  • TF_INT16 V V
  • TF_INT8 V V
  • TF_STRING V V
  • TF_COMPLEX ?
  • TF_INT64 V V
  • TF_BOOL V V
  • TF_QINT8 X
  • TF_QUINT8 X
  • TF_QINT32 X
  • TF_BFLOAT16 X
  • TF_QINT16 X
  • TF_QUINT16 X

@alonsovidales alonsovidales force-pushed the go_bindings_tensors branch 3 times, most recently from e902a21 to 9257bf5 Compare April 4, 2016 23:15
@tmc
Copy link
Copy Markdown
Owner

tmc commented Apr 8, 2016

This is great, I'll try to make time to review this in detail today.

@alonsovidales
Copy link
Copy Markdown
Author

Awesome, thanks a lot :) I made a PR to TensorFlow
I'm working right now on the autogeneration of the MarkDowns from godoc. I think that with the current functionality it could be ready to merge. I'm also porting this tuto to Go: Convolutional Neural Networks , just to play a bit with the libraries and see if it is possible to cover all the functionality.

Dan Mané and others added 5 commits April 11, 2016 16:43
Update bower dependencies.
Also force urls to lowercase.
Change: 119584968
Goals:
- Have enough of each summary type that tag grouping is useful.
(Wound up recording e.g. mean and stddev and min/max for each variable)
- Use every summary type (adds images)
- Write to multiple directories so there are several "runs"
Change: 119585022
@alonsovidales
Copy link
Copy Markdown
Author

@tmc may I have your approval to use your bindings so the TensorFlow guys can start reviewing the code?

mrry and others added 13 commits April 11, 2016 17:41
Usage example: ./remote_test.sh --num-workers 3 --sync-replicas

Also changed:
    1) In local and remote tests, let different workers contact separate GRPC
    sessions.
    2) In local and remote tests, adding the capacity to specify the number of
    workers. Before it was hard-coded at 2.
    Usage example:
    ./remote_test.sh --num-workers 2 --sync-replicas
    3) Using device setter in mnist_replica.py
Change: 119599547
…nsorflow#1864)

* Moved mnist reading from input_data in tutorial to learn/datasets
…w#1866)

* Update TF Mechanics 101 Tutorial to match recent code
In the section of Inputs and Placeholders, the IMAGE_PIXELS should be mnist.IMAGE_PIXELS
@alonsovidales alonsovidales force-pushed the go_bindings_tensors branch 2 times, most recently from 5bace3b to 29b9392 Compare April 12, 2016 16:34
A. Unique TensorFlower and others added 11 commits April 18, 2016 18:43
Change: 120192253
- Oneof values should be printed even when equal to the default.
- Fields should be printed in tag number order, not declaration order.
Change: 120223509
* Removed TensorInt interface
* Remove unsupported data types
Alonso Vidales and others added 5 commits April 20, 2016 01:19
…w#1987)

During initialization, we check whether the loaded version
of the cudnn library matches the version of the library that
the binary was compiled against.  When there is a mismatch,
throw an error.

Example: I built with cudnnv5 but I am loading V4, and I get:

E tensorflow/stream_executor/cuda/cuda_dnn.cc:298] Loaded cudnn library: 4007 but source was compiled against 5004.  If using a binary install, upgrade your cudnn library to match.  If building from sources, make sure the library loaded matches the version you specified during compile configuration.

I then copy the v5 version of libcudnn.so into /usr/local/cuda/lib64
and when I re-run the program, the error goes away.

Thoughts, @zheng-xq, @leary-google ?
martinwicke and others added 9 commits April 19, 2016 20:27
…#2027)

CUDNN_TENSOR_NHWC the only other format is still not supported
since kInputYXOutput would correspond to CUDNN_TENSOR_CHWN which
doesn’t exist

for issue tensorflow#1786
The keys in the _word2id are bytes literals.
The keys in the _word2id are bytes literals.
* Fixed some typos
* Relocated errors after types
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.