AI/tensorflow

[tf.data] data transform하여 dataset 추가하기

교 향 2022. 12. 22. 15:58

https://stackoverflow.com/questions/47337031/how-to-expand-tf-data-dataset-with-additional-example-transformations-in-tensorf?rq=1 

 

How to expand tf.data.Dataset with additional example transformations in Tensorflow

I would like to double the size of an existing dataset I'm using to train a neural network in tensorflow on the fly by adding random noise to it. So when I'm done I'll have all the existing example...

stackoverflow.com

def generate_permutations(features, labels):
    regular_ds = tf.data.Dataset.from_tensors((features, labels))
    noisy_ds = tf.data.Dataset.from_tensors((add_noise(features), labels))
    return regular_ds.concatenate(noisy_ds)

dataset = dataset.flat_map(generate_permutations)

 

regular_ds에 noisy_ds를 합치어 dataset을 만들어 내는 방법

(* noisy_ds가 후방위치)