TL;DR

Is (a and b) equivalent to tf.logical_and(a, b) in terms of optimization and performance? (a and b are tensorflow tensors)

Details

I use Python with Tensorflow. My priorities are

1. Make the code run fast
2. Make it readable.

I have working and fast code that, for my personal feeling, looks ugly:

@tf.function
# @tf.function(jit_compile=True)
def my_tf_func():
    # ...

    a = ... # some tensorflow tensor
    b = ... # another tensorflow tensor

    # currently ugly: prefix notation with tf.logical_and
    c = tf.math.count_nonzero(tf.logical_and(a, b))

    # more readable alternative: infix notation:
    c = tf.math.count_nonzero(a and b)

    # ...

The code that uses prefix notation works and runs fast, but I don't think it's very readable due to the prefix notation (it's called prefix notation, because the name of the operation logical_and comes before the operands a and b).

Can I use infix notation, i.e. the alternative at the end of above code, with usual python operators like and, +, -, or == and still get all the benefits of tensorflow on the GPU and compile it with XLA support? Will it compile to the same result?

The same question applies to unary operators like not vs. tf.logical_not(...).

_{This question was crossposted at
https://stackoverflow.com/questions/77045818/is-it-okay-to-use-python-operators-for-tensorflow-tensors .}

posted about 1 year ago

CC BY-SA 4.0

1y ago by meta user‭

daniel_s‭

16 reputation 3 0 3 5