deeplearn@ML-RefVm-967342:~$ mkdir fashion deeplearn@ML-RefVm-967342:~$ cd fashion deeplearn@ML-RefVm-967342:~/fashion$ kaggle competitions download -c ml530-2022-fall-fashion Downloading ml530-2022-fall-fashion.zip to /home/deeplearn/fashion 73%|████████████████████████████████████████████████████████████████████▊ | 34.0M/46.4M [00:00<00:00, 185MB/s] 100%|██████████████████████████████████████████████████████████████████████████████████████████████| 46.4M/46.4M [00:00<00:00, 187MB/s] deeplearn@ML-RefVm-967342:~/fashion$ wget https://cross-entropy.net/ML530/fashion-search-complete.py.txt --2022-10-15 17:25:37-- https://cross-entropy.net/ML530/fashion-search-complete.py.txt Resolving cross-entropy.net (cross-entropy.net)... 107.180.57.14 Connecting to cross-entropy.net (cross-entropy.net)|107.180.57.14|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 7009 (6.8K) [text/plain] Saving to: ‘fashion-search-complete.py.txt’ fashion-search-complete.py.txt 100%[============================================================>] 6.84K --.-KB/s in 0s 2022-10-15 17:25:37 (4.66 GB/s) - ‘fashion-search-complete.py.txt’ saved [7009/7009] deeplearn@ML-RefVm-967342:~/fashion$ time python fashion-search-complete.py.txt 2022-10-15 17:26:08.071971: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2022-10-15 17:26:18.784557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 10790 MB memory: -> device: 0, name: Tesla K80, pci bus id: 0001:00:00.0, compute capability: 3.7 Search space summary Default search space size: 12 convolution_depth (Int) {'default': None, 'conditions': [], 'min_value': 0, 'max_value': 4, 'step': 1, 'sampling': None} convolution_width (Choice) {'default': 16, 'conditions': [], 'values': [16, 32, 64, 128], 'ordered': True} dense_depth (Int) {'default': None, 'conditions': [], 'min_value': 0, 'max_value': 4, 'step': 1, 'sampling': None} dense_width (Choice) {'default': 64, 'conditions': [], 'values': [64, 128, 256, 512], 'ordered': True} activation (Choice) {'default': 'relu', 'conditions': [], 'values': ['relu', 'sigmoid', 'swish', 'tanh', 'leaky', 'elu'], 'ordered': False} regularization_function (Choice) {'default': 'none', 'conditions': [], 'values': ['none', 'l1', 'l2', 'l1_l2'], 'ordered': False} regularization_penalty (Choice) {'default': 0.0001, 'conditions': [], 'values': [0.0001, 1e-05], 'ordered': True} dropout (Float) {'default': 0.0, 'conditions': [], 'min_value': 0.0, 'max_value': 0.5, 'step': 0.1, 'sampling': None} optimizer (Choice) {'default': 'adam', 'conditions': [], 'values': ['adam', 'rmsprop', 'sgd'], 'ordered': False} learning_rate (Choice) {'default': 0.01, 'conditions': [], 'values': [0.01, 0.001, 0.0001], 'ordered': True} learning_rate_schedule (Choice) {'default': 'none', 'conditions': [], 'values': ['none', 'exponential', 'cosine'], 'ordered': False} batch_size (Choice) {'default': 32, 'conditions': [], 'values': [32, 64, 128, 256, 512, 1024], 'ordered': True} Search: Running Trial #1 Value |Best Value So Far |Hyperparameter 1 |? |convolution_depth 128 |? |convolution_width 2 |? |dense_depth 64 |? |dense_width relu |? |activation l1_l2 |? |regularization_function 1e-05 |? |regularization_penalty 0.2 |? |dropout rmsprop |? |optimizer 0.0001 |? |learning_rate none |? |learning_rate_schedule 32 |? |batch_size 3 |? |tuner/epochs 0 |? |tuner/initial_epoch 3 |? |tuner/bracket 0 |? |tuner/round Epoch 1/3 2022-10-15 17:26:37.997966: I tensorflow/stream_executor/cuda/cuda_dnn.cc:384] Loaded cuDNN version 8500 1688/1688 [==============================] - 68s 18ms/step - loss: 0.8495 - accuracy: 0.7808 - val_loss: 0.5168 - val_accuracy: 0.8817 Epoch 2/3 1688/1688 [==============================] - 31s 18ms/step - loss: 0.5942 - accuracy: 0.8573 - val_loss: 0.4699 - val_accuracy: 0.8910 Epoch 3/3 1688/1688 [==============================] - 31s 18ms/step - loss: 0.5122 - accuracy: 0.8780 - val_loss: 0.4504 - val_accuracy: 0.9008 Trial 1 Complete [00h 02m 10s] val_accuracy: 0.9008333086967468 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 02m 10s Search: Running Trial #2 Value |Best Value So Far |Hyperparameter 3 |1 |convolution_depth 16 |128 |convolution_width 0 |2 |dense_depth 512 |64 |dense_width sigmoid |relu |activation l1_l2 |l1_l2 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout sgd |rmsprop |optimizer 0.001 |0.0001 |learning_rate none |none |learning_rate_schedule 256 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 211/211 [==============================] - 6s 23ms/step - loss: 1.5256 - accuracy: 0.5550 - val_loss: 2.3337 - val_accuracy: 0.1247 Epoch 2/3 211/211 [==============================] - 4s 20ms/step - loss: 0.7869 - accuracy: 0.7436 - val_loss: 1.6156 - val_accuracy: 0.4620 Epoch 3/3 211/211 [==============================] - 4s 20ms/step - loss: 0.6661 - accuracy: 0.7877 - val_loss: 0.6528 - val_accuracy: 0.8042 Trial 2 Complete [00h 00m 16s] val_accuracy: 0.8041666746139526 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 02m 26s Search: Running Trial #3 Value |Best Value So Far |Hyperparameter 2 |1 |convolution_depth 32 |128 |convolution_width 4 |2 |dense_depth 128 |64 |dense_width swish |relu |activation l1 |l1_l2 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |rmsprop |optimizer 0.0001 |0.0001 |learning_rate none |none |learning_rate_schedule 512 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/106 [>.............................] - ETA: 5s - loss: 3.4031 - accuracy: 0.1556WARNING:tensorflow:Callback method `on_train_batch_106/106 [==============================] - 9s 66ms/step - loss: 2.2596 - accuracy: 0.5985 - val_loss: 3.3913 - val_accuracy: 0.1510 Epoch 2/3 106/106 [==============================] - 6s 58ms/step - loss: 1.6923 - accuracy: 0.7779 - val_loss: 3.3463 - val_accuracy: 0.1570 Epoch 3/3 106/106 [==============================] - 6s 58ms/step - loss: 1.5620 - accuracy: 0.8204 - val_loss: 3.0489 - val_accuracy: 0.1938 Trial 3 Complete [00h 00m 21s] val_accuracy: 0.1938333362340927 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 02m 47s Search: Running Trial #4 Value |Best Value So Far |Hyperparameter 1 |1 |convolution_depth 32 |128 |convolution_width 2 |2 |dense_depth 256 |64 |dense_width leaky |relu |activation none |l1_l2 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.3 |0.2 |dropout sgd |rmsprop |optimizer 0.0001 |0.0001 |learning_rate none |none |learning_rate_schedule 1024 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 3s - loss: 2.4533 - accuracy: 0.3174WARNING:tensorflow:Callback method `on_train_batch_en53/53 [==============================] - 7s 106ms/step - loss: 1.0201 - accuracy: 0.6731 - val_loss: 1.9792 - val_accuracy: 0.5940 Epoch 2/3 53/53 [==============================] - 4s 84ms/step - loss: 0.5626 - accuracy: 0.8045 - val_loss: 1.8910 - val_accuracy: 0.5167 Epoch 3/3 53/53 [==============================] - 4s 84ms/step - loss: 0.4894 - accuracy: 0.8311 - val_loss: 1.8303 - val_accuracy: 0.4540 Trial 4 Complete [00h 00m 16s] val_accuracy: 0.593999981880188 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 03m 04s Search: Running Trial #5 Value |Best Value So Far |Hyperparameter 0 |1 |convolution_depth 64 |128 |convolution_width 2 |2 |dense_depth 256 |64 |dense_width elu |relu |activation l1 |l1_l2 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |rmsprop |optimizer 0.01 |0.0001 |learning_rate exponential |none |learning_rate_schedule 256 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 211/211 [==============================] - 1s 4ms/step - loss: 1.7263 - accuracy: 0.7560 - val_loss: 1.0348 - val_accuracy: 0.8133 Epoch 2/3 211/211 [==============================] - 1s 4ms/step - loss: 0.8930 - accuracy: 0.8213 - val_loss: 0.8119 - val_accuracy: 0.8262 Epoch 3/3 211/211 [==============================] - 1s 3ms/step - loss: 0.7207 - accuracy: 0.8324 - val_loss: 0.6705 - val_accuracy: 0.8442 Trial 5 Complete [00h 00m 03s] val_accuracy: 0.8441666960716248 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 03m 07s Search: Running Trial #6 Value |Best Value So Far |Hyperparameter 2 |1 |convolution_depth 32 |128 |convolution_width 3 |2 |dense_depth 256 |64 |dense_width elu |relu |activation l1 |l1_l2 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0.2 |dropout rmsprop |rmsprop |optimizer 0.01 |0.0001 |learning_rate none |none |learning_rate_schedule 512 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/106 [>.............................] - ETA: 5s - loss: 6.4059 - accuracy: 0.2158WARNING:tensorflow:Callback method `on_train_batch_106/106 [==============================] - 8s 60ms/step - loss: 1.4986 - accuracy: 0.6571 - val_loss: 3.9438 - val_accuracy: 0.1488 Epoch 2/3 106/106 [==============================] - 6s 58ms/step - loss: 0.8206 - accuracy: 0.8090 - val_loss: 3.1781 - val_accuracy: 0.3085 Epoch 3/3 106/106 [==============================] - 6s 60ms/step - loss: 0.7204 - accuracy: 0.8412 - val_loss: 1.5654 - val_accuracy: 0.5640 Trial 6 Complete [00h 00m 21s] val_accuracy: 0.5640000104904175 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 03m 27s Search: Running Trial #7 Value |Best Value So Far |Hyperparameter 3 |1 |convolution_depth 16 |128 |convolution_width 3 |2 |dense_depth 512 |64 |dense_width leaky |relu |activation l1_l2 |l1_l2 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout rmsprop |rmsprop |optimizer 0.01 |0.0001 |learning_rate exponential |none |learning_rate_schedule 512 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 5/106 [>.............................] - ETA: 3s - loss: 13.9860 - accuracy: 0.1859WARNING:tensorflow:Callback method `on_train_batch106/106 [==============================] - 7s 44ms/step - loss: 2.6065 - accuracy: 0.6591 - val_loss: 3.5606 - val_accuracy: 0.0988 Epoch 2/3 106/106 [==============================] - 4s 40ms/step - loss: 0.7922 - accuracy: 0.8155 - val_loss: 3.6346 - val_accuracy: 0.1185 Epoch 3/3 106/106 [==============================] - 4s 41ms/step - loss: 0.6886 - accuracy: 0.8512 - val_loss: 3.1754 - val_accuracy: 0.2085 Trial 7 Complete [00h 00m 16s] val_accuracy: 0.2084999978542328 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 03m 43s Search: Running Trial #8 Value |Best Value So Far |Hyperparameter 3 |1 |convolution_depth 128 |128 |convolution_width 4 |2 |dense_depth 128 |64 |dense_width tanh |relu |activation l1 |l1_l2 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |rmsprop |optimizer 0.001 |0.0001 |learning_rate none |none |learning_rate_schedule 64 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 844/844 [==============================] - 41s 46ms/step - loss: 2.5266 - accuracy: 0.8018 - val_loss: 1.6900 - val_accuracy: 0.8602 Epoch 2/3 844/844 [==============================] - 38s 45ms/step - loss: 1.4442 - accuracy: 0.8619 - val_loss: 1.2465 - val_accuracy: 0.8782 Epoch 3/3 844/844 [==============================] - 38s 46ms/step - loss: 1.1805 - accuracy: 0.8733 - val_loss: 1.1530 - val_accuracy: 0.8628 Trial 8 Complete [00h 01m 57s] val_accuracy: 0.878166675567627 Best val_accuracy So Far: 0.9008333086967468 Total elapsed time: 00h 05m 40s Search: Running Trial #9 Value |Best Value So Far |Hyperparameter 2 |1 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |64 |dense_width swish |relu |activation l1 |l1_l2 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |rmsprop |optimizer 0.001 |0.0001 |learning_rate exponential |none |learning_rate_schedule 128 |32 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/422 [..............................] - ETA: 29s - loss: 4.5904 - accuracy: 0.3724WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 33s 75ms/step - loss: 1.1581 - accuracy: 0.8288 - val_loss: 2.6232 - val_accuracy: 0.4570 Epoch 2/3 422/422 [==============================] - 30s 71ms/step - loss: 0.7917 - accuracy: 0.8925 - val_loss: 0.7032 - val_accuracy: 0.9032 Epoch 3/3 422/422 [==============================] - 30s 71ms/step - loss: 0.6449 - accuracy: 0.9107 - val_loss: 0.6324 - val_accuracy: 0.8963 Trial 9 Complete [00h 01m 34s] val_accuracy: 0.903166651725769 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 07m 14s Search: Running Trial #10 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width relu |swish |activation l1_l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout sgd |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 22s - loss: 24.0179 - accuracy: 0.2142WARNING:tensorflow:Callback method `on_train_batch_53/53 [==============================] - 43s 723ms/step - loss: 10.9120 - accuracy: 0.6175 - val_loss: 20.4685 - val_accuracy: 0.0972 Epoch 2/3 53/53 [==============================] - 26s 499ms/step - loss: 6.1508 - accuracy: 0.7851 - val_loss: 11.7800 - val_accuracy: 0.0968 Epoch 3/3 53/53 [==============================] - 27s 503ms/step - loss: 4.0095 - accuracy: 0.8083 - val_loss: 10.0428 - val_accuracy: 0.1458 Trial 10 Complete [00h 01m 36s] val_accuracy: 0.1458333283662796 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 08m 51s Search: Running Trial #11 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 16 |128 |convolution_width 4 |2 |dense_depth 256 |512 |dense_width elu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 32 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 1688/1688 [==============================] - 15s 7ms/step - loss: 0.9756 - accuracy: 0.7174 - val_loss: 0.7044 - val_accuracy: 0.8165 Epoch 2/3 1688/1688 [==============================] - 12s 7ms/step - loss: 0.7435 - accuracy: 0.7990 - val_loss: 0.6144 - val_accuracy: 0.8502 Epoch 3/3 1688/1688 [==============================] - 12s 7ms/step - loss: 0.6520 - accuracy: 0.8317 - val_loss: 0.5792 - val_accuracy: 0.8607 Trial 11 Complete [00h 00m 39s] val_accuracy: 0.8606666922569275 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 09m 30s Search: Running Trial #12 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 64 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width leaky |swish |activation l1_l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 9s - loss: 70.2251 - accuracy: 0.2437WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 17s 275ms/step - loss: 21.2054 - accuracy: 0.5724 - val_loss: 73.5058 - val_accuracy: 0.1037 Epoch 2/3 53/53 [==============================] - 11s 201ms/step - loss: 9.8774 - accuracy: 0.6789 - val_loss: 19.6126 - val_accuracy: 0.0958 Epoch 3/3 53/53 [==============================] - 11s 202ms/step - loss: 6.6012 - accuracy: 0.8009 - val_loss: 15.6346 - val_accuracy: 0.0958 Trial 12 Complete [00h 00m 39s] val_accuracy: 0.10366666316986084 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 10m 09s Search: Running Trial #13 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 16 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 128 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 422/422 [==============================] - 7s 12ms/step - loss: 0.7738 - accuracy: 0.7884 - val_loss: 0.8081 - val_accuracy: 0.7595 Epoch 2/3 422/422 [==============================] - 5s 12ms/step - loss: 0.7268 - accuracy: 0.8376 - val_loss: 0.6379 - val_accuracy: 0.8695 Epoch 3/3 422/422 [==============================] - 5s 12ms/step - loss: 0.5945 - accuracy: 0.8728 - val_loss: 0.4641 - val_accuracy: 0.9013 Trial 13 Complete [00h 00m 17s] val_accuracy: 0.9013333320617676 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 10m 25s Search: Running Trial #14 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width elu |swish |activation l1_l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 32 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 1688/1688 [==============================] - 18s 10ms/step - loss: 1.5020 - accuracy: 0.7280 - val_loss: 1.1878 - val_accuracy: 0.8397 Epoch 2/3 1688/1688 [==============================] - 16s 9ms/step - loss: 1.1966 - accuracy: 0.8296 - val_loss: 1.0898 - val_accuracy: 0.8662 Epoch 3/3 1688/1688 [==============================] - 16s 9ms/step - loss: 1.0959 - accuracy: 0.8604 - val_loss: 1.0098 - val_accuracy: 0.8852 Trial 14 Complete [00h 00m 50s] val_accuracy: 0.8851666450500488 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 11m 15s Search: Running Trial #15 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 1 |2 |dense_depth 128 |512 |dense_width leaky |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout rmsprop |sgd |optimizer 0.001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 3s - loss: 4.3473 - accuracy: 0.1416WARNING:tensorflow:Callback method `on_train_batch_en53/53 [==============================] - 6s 88ms/step - loss: 2.3859 - accuracy: 0.3615 - val_loss: 2.4658 - val_accuracy: 0.1078 Epoch 2/3 53/53 [==============================] - 4s 70ms/step - loss: 1.4108 - accuracy: 0.5784 - val_loss: 2.7171 - val_accuracy: 0.1918 Epoch 3/3 53/53 [==============================] - 4s 70ms/step - loss: 1.1397 - accuracy: 0.6668 - val_loss: 2.7657 - val_accuracy: 0.1932 Trial 15 Complete [00h 00m 14s] val_accuracy: 0.19316667318344116 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 11m 30s Search: Running Trial #16 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 64 |128 |convolution_width 3 |2 |dense_depth 256 |512 |dense_width swish |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 1688/1688 [==============================] - 6s 3ms/step - loss: 2.0310 - accuracy: 0.7469 - val_loss: 1.6933 - val_accuracy: 0.8198 Epoch 2/3 1688/1688 [==============================] - 5s 3ms/step - loss: 1.5849 - accuracy: 0.8225 - val_loss: 1.4675 - val_accuracy: 0.8367 Epoch 3/3 1688/1688 [==============================] - 5s 3ms/step - loss: 1.3873 - accuracy: 0.8345 - val_loss: 1.3092 - val_accuracy: 0.8413 Trial 16 Complete [00h 00m 16s] val_accuracy: 0.8413333296775818 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 11m 46s Search: Running Trial #17 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width elu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.5 |0.2 |dropout adam |sgd |optimizer 0.001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 23s - loss: 5.2430 - accuracy: 0.3306WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 29s 517ms/step - loss: 2.1366 - accuracy: 0.6576 - val_loss: 3.4007 - val_accuracy: 0.1522 Epoch 2/3 53/53 [==============================] - 27s 506ms/step - loss: 1.3068 - accuracy: 0.7987 - val_loss: 3.8939 - val_accuracy: 0.1033 Epoch 3/3 53/53 [==============================] - 27s 507ms/step - loss: 1.1824 - accuracy: 0.8320 - val_loss: 4.9501 - val_accuracy: 0.1082 Trial 17 Complete [00h 01m 23s] val_accuracy: 0.15216666460037231 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 13m 08s Search: Running Trial #18 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 3 |2 |dense_depth 256 |512 |dense_width leaky |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/53 [==>...........................] - ETA: 10s - loss: 2.6355 - accuracy: 0.1571WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 14s 241ms/step - loss: 1.3564 - accuracy: 0.5398 - val_loss: 2.3091 - val_accuracy: 0.0997 Epoch 2/3 53/53 [==============================] - 12s 230ms/step - loss: 0.7632 - accuracy: 0.7233 - val_loss: 2.3956 - val_accuracy: 0.0997 Epoch 3/3 53/53 [==============================] - 12s 232ms/step - loss: 0.6046 - accuracy: 0.7756 - val_loss: 2.5040 - val_accuracy: 0.0998 Trial 18 Complete [00h 00m 39s] val_accuracy: 0.09983333200216293 Best val_accuracy So Far: 0.903166651725769 Total elapsed time: 00h 13m 48s Search: Running Trial #19 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 1 |2 |dense_depth 512 |512 |dense_width elu |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 128 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 422/422 [==============================] - 9s 19ms/step - loss: 0.6027 - accuracy: 0.8184 - val_loss: 2.1820 - val_accuracy: 0.4063 Epoch 2/3 422/422 [==============================] - 8s 18ms/step - loss: 0.3687 - accuracy: 0.8690 - val_loss: 0.3709 - val_accuracy: 0.8758 Epoch 3/3 422/422 [==============================] - 8s 18ms/step - loss: 0.2427 - accuracy: 0.9120 - val_loss: 0.2243 - val_accuracy: 0.9155 Trial 19 Complete [00h 00m 25s] val_accuracy: 0.9154999852180481 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 14m 13s Search: Running Trial #20 Value |Best Value So Far |Hyperparameter 2 |3 |convolution_depth 16 |32 |convolution_width 2 |1 |dense_depth 256 |512 |dense_width sigmoid |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0 |dropout adam |sgd |optimizer 0.0001 |0.01 |learning_rate exponential |cosine |learning_rate_schedule 128 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 422/422 [==============================] - 7s 13ms/step - loss: 1.7647 - accuracy: 0.4183 - val_loss: 1.5350 - val_accuracy: 0.5627 Epoch 2/3 422/422 [==============================] - 5s 12ms/step - loss: 0.9853 - accuracy: 0.7013 - val_loss: 0.7429 - val_accuracy: 0.7665 Epoch 3/3 422/422 [==============================] - 5s 12ms/step - loss: 0.7920 - accuracy: 0.7617 - val_loss: 0.6549 - val_accuracy: 0.7927 Trial 20 Complete [00h 00m 17s] val_accuracy: 0.7926666736602783 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 14m 30s Search: Running Trial #21 Value |Best Value So Far |Hyperparameter 0 |3 |convolution_depth 128 |32 |convolution_width 1 |1 |dense_depth 256 |512 |dense_width relu |elu |activation l1 |none |regularization_function 0.0001 |1e-05 |regularization_penalty 0.5 |0 |dropout adam |sgd |optimizer 0.001 |0.01 |learning_rate exponential |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 211/211 [==============================] - 1s 3ms/step - loss: 1.2582 - accuracy: 0.7578 - val_loss: 0.9292 - val_accuracy: 0.8228 Epoch 2/3 211/211 [==============================] - 1s 3ms/step - loss: 0.8700 - accuracy: 0.8246 - val_loss: 0.7627 - val_accuracy: 0.8432 Epoch 3/3 211/211 [==============================] - 1s 3ms/step - loss: 0.7488 - accuracy: 0.8378 - val_loss: 0.6913 - val_accuracy: 0.8482 Trial 21 Complete [00h 00m 03s] val_accuracy: 0.8481666445732117 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 14m 32s Search: Running Trial #22 Value |Best Value So Far |Hyperparameter 1 |3 |convolution_depth 16 |32 |convolution_width 4 |1 |dense_depth 128 |512 |dense_width sigmoid |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0 |dropout sgd |sgd |optimizer 0.001 |0.01 |learning_rate none |cosine |learning_rate_schedule 128 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 422/422 [==============================] - 6s 11ms/step - loss: 1.3713 - accuracy: 0.5089 - val_loss: 2.8534 - val_accuracy: 0.3073 Epoch 2/3 422/422 [==============================] - 4s 10ms/step - loss: 0.8132 - accuracy: 0.7433 - val_loss: 0.6968 - val_accuracy: 0.8052 Epoch 3/3 422/422 [==============================] - 4s 10ms/step - loss: 0.6935 - accuracy: 0.8153 - val_loss: 0.5721 - val_accuracy: 0.8623 Trial 22 Complete [00h 00m 15s] val_accuracy: 0.862333357334137 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 14m 47s Search: Running Trial #23 Value |Best Value So Far |Hyperparameter 4 |3 |convolution_depth 64 |32 |convolution_width 3 |1 |dense_depth 64 |512 |dense_width sigmoid |elu |activation none |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0 |dropout adam |sgd |optimizer 0.0001 |0.01 |learning_rate exponential |cosine |learning_rate_schedule 64 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 844/844 [==============================] - 20s 22ms/step - loss: 1.9903 - accuracy: 0.3271 - val_loss: 1.5590 - val_accuracy: 0.6750 Epoch 2/3 844/844 [==============================] - 18s 21ms/step - loss: 1.3445 - accuracy: 0.6360 - val_loss: 1.0838 - val_accuracy: 0.8342 Epoch 3/3 844/844 [==============================] - 18s 21ms/step - loss: 0.9699 - accuracy: 0.7923 - val_loss: 0.7686 - val_accuracy: 0.8705 Trial 23 Complete [00h 00m 57s] val_accuracy: 0.8705000281333923 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 15m 44s Search: Running Trial #24 Value |Best Value So Far |Hyperparameter 3 |3 |convolution_depth 32 |32 |convolution_width 2 |1 |dense_depth 128 |512 |dense_width leaky |elu |activation none |none |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0 |dropout sgd |sgd |optimizer 0.001 |0.01 |learning_rate none |cosine |learning_rate_schedule 32 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 1688/1688 [==============================] - 15s 8ms/step - loss: 0.5306 - accuracy: 0.8082 - val_loss: 0.3411 - val_accuracy: 0.8700 Epoch 2/3 1688/1688 [==============================] - 14s 8ms/step - loss: 0.3422 - accuracy: 0.8751 - val_loss: 0.2969 - val_accuracy: 0.8862 Epoch 3/3 1688/1688 [==============================] - 14s 8ms/step - loss: 0.3017 - accuracy: 0.8905 - val_loss: 0.2676 - val_accuracy: 0.9007 Trial 24 Complete [00h 00m 44s] val_accuracy: 0.9006666541099548 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 16m 28s Search: Running Trial #25 Value |Best Value So Far |Hyperparameter 0 |3 |convolution_depth 128 |32 |convolution_width 1 |1 |dense_depth 64 |512 |dense_width leaky |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.3 |0 |dropout adam |sgd |optimizer 0.01 |0.01 |learning_rate cosine |cosine |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 53/53 [==============================] - 1s 7ms/step - loss: 1.0268 - accuracy: 0.6668 - val_loss: 0.6239 - val_accuracy: 0.7917 Epoch 2/3 53/53 [==============================] - 0s 4ms/step - loss: 0.5967 - accuracy: 0.7990 - val_loss: 0.5174 - val_accuracy: 0.8267 Epoch 3/3 53/53 [==============================] - 0s 4ms/step - loss: 0.5120 - accuracy: 0.8321 - val_loss: 0.4860 - val_accuracy: 0.8412 Trial 25 Complete [00h 00m 02s] val_accuracy: 0.8411666750907898 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 16m 29s Search: Running Trial #26 Value |Best Value So Far |Hyperparameter 1 |3 |convolution_depth 64 |32 |convolution_width 1 |1 |dense_depth 512 |512 |dense_width swish |elu |activation l1 |none |regularization_function 0.0001 |1e-05 |regularization_penalty 0.3 |0 |dropout rmsprop |sgd |optimizer 0.01 |0.01 |learning_rate cosine |cosine |learning_rate_schedule 512 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 6/106 [>.............................] - ETA: 8s - loss: 53.6703 - accuracy: 0.3258WARNING:tensorflow:Callback method `on_train_batch106/106 [==============================] - 12s 104ms/step - loss: 23.5541 - accuracy: 0.7006 - val_loss: 166.4135 - val_accuracy: 0.0968 Epoch 2/3 106/106 [==============================] - 10s 99ms/step - loss: 9.8828 - accuracy: 0.7894 - val_loss: 35.7428 - val_accuracy: 0.1713 Epoch 3/3 106/106 [==============================] - 11s 102ms/step - loss: 3.4021 - accuracy: 0.8383 - val_loss: 5.6450 - val_accuracy: 0.4373 Trial 26 Complete [00h 00m 34s] val_accuracy: 0.437333345413208 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 17m 03s Search: Running Trial #27 Value |Best Value So Far |Hyperparameter 3 |3 |convolution_depth 128 |32 |convolution_width 2 |1 |dense_depth 256 |512 |dense_width sigmoid |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0 |dropout rmsprop |sgd |optimizer 0.0001 |0.01 |learning_rate none |cosine |learning_rate_schedule 64 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 5/844 [..............................] - ETA: 39s - loss: 2.8922 - accuracy: 0.1000WARNING:tensorflow:Callback method `on_train_batch844/844 [==============================] - 41s 47ms/step - loss: 1.1331 - accuracy: 0.7542 - val_loss: 0.7092 - val_accuracy: 0.8723 Epoch 2/3 844/844 [==============================] - 39s 47ms/step - loss: 0.6619 - accuracy: 0.8873 - val_loss: 0.5995 - val_accuracy: 0.9037 Epoch 3/3 844/844 [==============================] - 40s 47ms/step - loss: 0.5857 - accuracy: 0.9064 - val_loss: 0.5653 - val_accuracy: 0.9093 Trial 27 Complete [00h 02m 01s] val_accuracy: 0.909333348274231 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 04s Search: Running Trial #28 Value |Best Value So Far |Hyperparameter 1 |3 |convolution_depth 32 |32 |convolution_width 0 |1 |dense_depth 128 |512 |dense_width relu |elu |activation l1 |none |regularization_function 0.0001 |1e-05 |regularization_penalty 0.3 |0 |dropout rmsprop |sgd |optimizer 0.0001 |0.01 |learning_rate cosine |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 4/211 [..............................] - ETA: 4s - loss: 3.1791 - accuracy: 0.2031 WARNING:tensorflow:Callback method `on_train_batc211/211 [==============================] - 6s 22ms/step - loss: 0.9417 - accuracy: 0.7154 - val_loss: 1.8240 - val_accuracy: 0.5197 Epoch 2/3 211/211 [==============================] - 4s 21ms/step - loss: 0.6271 - accuracy: 0.8098 - val_loss: 0.8560 - val_accuracy: 0.7393 Epoch 3/3 211/211 [==============================] - 5s 21ms/step - loss: 0.5323 - accuracy: 0.8376 - val_loss: 0.4684 - val_accuracy: 0.8563 Trial 28 Complete [00h 00m 15s] val_accuracy: 0.856333315372467 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 19s Search: Running Trial #29 Value |Best Value So Far |Hyperparameter 0 |3 |convolution_depth 128 |32 |convolution_width 1 |1 |dense_depth 256 |512 |dense_width tanh |elu |activation none |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0 |dropout adam |sgd |optimizer 0.001 |0.01 |learning_rate cosine |cosine |learning_rate_schedule 1024 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 53/53 [==============================] - 1s 7ms/step - loss: 0.8201 - accuracy: 0.7148 - val_loss: 0.6057 - val_accuracy: 0.7878 Epoch 2/3 53/53 [==============================] - 0s 5ms/step - loss: 0.5507 - accuracy: 0.8109 - val_loss: 0.4965 - val_accuracy: 0.8247 Epoch 3/3 53/53 [==============================] - 0s 5ms/step - loss: 0.4805 - accuracy: 0.8321 - val_loss: 0.4760 - val_accuracy: 0.8315 Trial 29 Complete [00h 00m 02s] val_accuracy: 0.8314999938011169 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 21s Search: Running Trial #30 Value |Best Value So Far |Hyperparameter 0 |3 |convolution_depth 128 |32 |convolution_width 2 |1 |dense_depth 64 |512 |dense_width tanh |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0 |dropout rmsprop |sgd |optimizer 0.01 |0.01 |learning_rate exponential |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 211/211 [==============================] - 1s 4ms/step - loss: 0.6594 - accuracy: 0.7738 - val_loss: 0.4972 - val_accuracy: 0.8427 Epoch 2/3 211/211 [==============================] - 1s 3ms/step - loss: 0.4954 - accuracy: 0.8400 - val_loss: 0.4885 - val_accuracy: 0.8418 Epoch 3/3 211/211 [==============================] - 1s 3ms/step - loss: 0.4819 - accuracy: 0.8436 - val_loss: 0.5066 - val_accuracy: 0.8498 Trial 30 Complete [00h 00m 03s] val_accuracy: 0.8498333096504211 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 24s Search: Running Trial #31 Value |Best Value So Far |Hyperparameter 2 |3 |convolution_depth 32 |32 |convolution_width 4 |1 |dense_depth 256 |512 |dense_width relu |elu |activation l1 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.5 |0 |dropout adam |sgd |optimizer 0.0001 |0.01 |learning_rate none |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 5/211 [..............................] - ETA: 8s - loss: 5.6648 - accuracy: 0.0859WARNING:tensorflow:Callback method `on_train_batch_211/211 [==============================] - 8s 34ms/step - loss: 3.0049 - accuracy: 0.1154 - val_loss: 2.5181 - val_accuracy: 0.1440 Epoch 2/3 211/211 [==============================] - 7s 32ms/step - loss: 2.4064 - accuracy: 0.1836 - val_loss: 2.1859 - val_accuracy: 0.2973 Epoch 3/3 211/211 [==============================] - 7s 32ms/step - loss: 2.0008 - accuracy: 0.3131 - val_loss: 1.5853 - val_accuracy: 0.5038 Trial 31 Complete [00h 00m 22s] val_accuracy: 0.5038333535194397 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 46s Search: Running Trial #32 Value |Best Value So Far |Hyperparameter 0 |3 |convolution_depth 64 |32 |convolution_width 3 |1 |dense_depth 64 |512 |dense_width leaky |elu |activation l2 |none |regularization_function 0.0001 |1e-05 |regularization_penalty 0 |0 |dropout sgd |sgd |optimizer 0.0001 |0.01 |learning_rate none |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 211/211 [==============================] - 1s 4ms/step - loss: 1.3711 - accuracy: 0.5748 - val_loss: 0.8474 - val_accuracy: 0.7290 Epoch 2/3 211/211 [==============================] - 1s 3ms/step - loss: 0.7194 - accuracy: 0.7695 - val_loss: 0.6562 - val_accuracy: 0.7842 Epoch 3/3 211/211 [==============================] - 1s 3ms/step - loss: 0.5989 - accuracy: 0.8071 - val_loss: 0.5840 - val_accuracy: 0.8053 Trial 32 Complete [00h 00m 03s] val_accuracy: 0.8053333163261414 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 19m 49s Search: Running Trial #33 Value |Best Value So Far |Hyperparameter 1 |3 |convolution_depth 32 |32 |convolution_width 2 |1 |dense_depth 256 |512 |dense_width swish |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.5 |0 |dropout adam |sgd |optimizer 0.001 |0.01 |learning_rate none |cosine |learning_rate_schedule 256 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 4/211 [..............................] - ETA: 4s - loss: 3.8274 - accuracy: 0.2568 WARNING:tensorflow:Callback method `on_train_batc211/211 [==============================] - 7s 26ms/step - loss: 1.0762 - accuracy: 0.7523 - val_loss: 3.0680 - val_accuracy: 0.2788 Epoch 2/3 211/211 [==============================] - 5s 25ms/step - loss: 0.7370 - accuracy: 0.8454 - val_loss: 1.1080 - val_accuracy: 0.6797 Epoch 3/3 211/211 [==============================] - 5s 26ms/step - loss: 0.6395 - accuracy: 0.8688 - val_loss: 0.6152 - val_accuracy: 0.8705 Trial 33 Complete [00h 00m 18s] val_accuracy: 0.8705000281333923 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 20m 07s Search: Running Trial #34 Value |Best Value So Far |Hyperparameter 1 |3 |convolution_depth 128 |32 |convolution_width 1 |1 |dense_depth 64 |512 |dense_width tanh |elu |activation l1 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0 |dropout sgd |sgd |optimizer 0.01 |0.01 |learning_rate exponential |cosine |learning_rate_schedule 32 |128 |batch_size 3 |3 |tuner/epochs 0 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 0 |0 |tuner/round Epoch 1/3 1688/1688 [==============================] - 30s 17ms/step - loss: 2.3811 - accuracy: 0.6649 - val_loss: 2.5438 - val_accuracy: 0.7213 Epoch 2/3 1688/1688 [==============================] - 29s 17ms/step - loss: 2.7827 - accuracy: 0.6704 - val_loss: 3.1065 - val_accuracy: 0.6123 Epoch 3/3 1688/1688 [==============================] - 29s 17ms/step - loss: 2.6997 - accuracy: 0.6998 - val_loss: 2.4648 - val_accuracy: 0.7185 Trial 34 Complete [00h 01m 28s] val_accuracy: 0.7213333249092102 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 21m 35s Search: Running Trial #35 Value |Best Value So Far |Hyperparameter 3 |3 |convolution_depth 32 |32 |convolution_width 1 |1 |dense_depth 512 |512 |dense_width elu |elu |activation none |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0 |dropout sgd |sgd |optimizer 0.01 |0.01 |learning_rate cosine |cosine |learning_rate_schedule 128 |128 |batch_size 8 |3 |tuner/epochs 3 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |0 |tuner/round 0018 |None |tuner/trial_id Epoch 4/8 422/422 [==============================] - 9s 18ms/step - loss: 0.6016 - accuracy: 0.8115 - val_loss: 1.6274 - val_accuracy: 0.4882 Epoch 5/8 422/422 [==============================] - 8s 18ms/step - loss: 0.3853 - accuracy: 0.8619 - val_loss: 0.3027 - val_accuracy: 0.8838 Epoch 6/8 422/422 [==============================] - 7s 18ms/step - loss: 0.2526 - accuracy: 0.9080 - val_loss: 0.2286 - val_accuracy: 0.9143 Epoch 7/8 422/422 [==============================] - 7s 18ms/step - loss: 0.2969 - accuracy: 0.8957 - val_loss: 0.3804 - val_accuracy: 0.8597 Epoch 8/8 422/422 [==============================] - 7s 18ms/step - loss: 0.2553 - accuracy: 0.9059 - val_loss: 0.2520 - val_accuracy: 0.9058 Trial 35 Complete [00h 00m 39s] val_accuracy: 0.9143333435058594 Best val_accuracy So Far: 0.9154999852180481 Total elapsed time: 00h 22m 14s Search: Running Trial #36 Value |Best Value So Far |Hyperparameter 3 |3 |convolution_depth 128 |32 |convolution_width 2 |1 |dense_depth 256 |512 |dense_width sigmoid |elu |activation l1_l2 |none |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0 |dropout rmsprop |sgd |optimizer 0.0001 |0.01 |learning_rate none |cosine |learning_rate_schedule 64 |128 |batch_size 8 |3 |tuner/epochs 3 |0 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |0 |tuner/round 0026 |None |tuner/trial_id Epoch 4/8 6/844 [..............................] - ETA: 49s - loss: 2.8191 - accuracy: 0.1198WARNING:tensorflow:Callback method `on_train_batch844/844 [==============================] - 41s 47ms/step - loss: 1.1270 - accuracy: 0.7555 - val_loss: 0.6838 - val_accuracy: 0.8783 Epoch 5/8 844/844 [==============================] - 39s 46ms/step - loss: 0.6605 - accuracy: 0.8879 - val_loss: 0.6244 - val_accuracy: 0.8887 Epoch 6/8 844/844 [==============================] - 39s 46ms/step - loss: 0.5835 - accuracy: 0.9070 - val_loss: 0.5483 - val_accuracy: 0.9173 Epoch 7/8 844/844 [==============================] - 40s 47ms/step - loss: 0.5419 - accuracy: 0.9204 - val_loss: 0.5470 - val_accuracy: 0.9155 Epoch 8/8 844/844 [==============================] - 38s 46ms/step - loss: 0.5128 - accuracy: 0.9276 - val_loss: 0.5355 - val_accuracy: 0.9115 Trial 36 Complete [00h 03m 18s] val_accuracy: 0.9173333048820496 Best val_accuracy So Far: 0.9173333048820496 Total elapsed time: 00h 25m 31s Search: Running Trial #37 Value |Best Value So Far |Hyperparameter 2 |3 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |256 |dense_width swish |sigmoid |activation l1 |l1_l2 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |rmsprop |optimizer 0.001 |0.0001 |learning_rate exponential |none |learning_rate_schedule 128 |64 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0008 |0026 |tuner/trial_id Epoch 4/8 6/422 [..............................] - ETA: 28s - loss: 4.5954 - accuracy: 0.3320WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 31s 72ms/step - loss: 1.1608 - accuracy: 0.8241 - val_loss: 1.8090 - val_accuracy: 0.6087 Epoch 5/8 422/422 [==============================] - 30s 72ms/step - loss: 0.7821 - accuracy: 0.8925 - val_loss: 0.7334 - val_accuracy: 0.8902 Epoch 6/8 422/422 [==============================] - 30s 71ms/step - loss: 0.6337 - accuracy: 0.9110 - val_loss: 0.6483 - val_accuracy: 0.8917 Epoch 7/8 422/422 [==============================] - 30s 71ms/step - loss: 0.5561 - accuracy: 0.9200 - val_loss: 0.5585 - val_accuracy: 0.9112 Epoch 8/8 422/422 [==============================] - 31s 74ms/step - loss: 0.5091 - accuracy: 0.9290 - val_loss: 0.5094 - val_accuracy: 0.9230 Trial 37 Complete [00h 02m 33s] val_accuracy: 0.9229999780654907 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 28m 05s Search: Running Trial #38 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 16 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 128 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0012 |0008 |tuner/trial_id Epoch 4/8 422/422 [==============================] - 6s 13ms/step - loss: 0.7492 - accuracy: 0.8000 - val_loss: 0.7655 - val_accuracy: 0.7860 Epoch 5/8 422/422 [==============================] - 5s 12ms/step - loss: 0.7289 - accuracy: 0.8404 - val_loss: 0.7354 - val_accuracy: 0.8217 Epoch 6/8 422/422 [==============================] - 5s 12ms/step - loss: 0.5924 - accuracy: 0.8722 - val_loss: 0.4703 - val_accuracy: 0.8992 Epoch 7/8 422/422 [==============================] - 5s 12ms/step - loss: 0.6564 - accuracy: 0.8639 - val_loss: 0.7048 - val_accuracy: 0.8773 Epoch 8/8 422/422 [==============================] - 5s 12ms/step - loss: 0.7283 - accuracy: 0.8594 - val_loss: 0.5915 - val_accuracy: 0.8898 Trial 38 Complete [00h 00m 27s] val_accuracy: 0.8991666436195374 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 28m 31s Search: Running Trial #39 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0000 |0008 |tuner/trial_id Epoch 4/8 1688/1688 [==============================] - 32s 18ms/step - loss: 0.8028 - accuracy: 0.7885 - val_loss: 0.5297 - val_accuracy: 0.8745 Epoch 5/8 1688/1688 [==============================] - 31s 18ms/step - loss: 0.5833 - accuracy: 0.8584 - val_loss: 0.4611 - val_accuracy: 0.8898 Epoch 6/8 1688/1688 [==============================] - 31s 18ms/step - loss: 0.4936 - accuracy: 0.8824 - val_loss: 0.4465 - val_accuracy: 0.8983 Epoch 7/8 1688/1688 [==============================] - 31s 19ms/step - loss: 0.4456 - accuracy: 0.8947 - val_loss: 0.3994 - val_accuracy: 0.9123 Epoch 8/8 1688/1688 [==============================] - 31s 18ms/step - loss: 0.4020 - accuracy: 0.9088 - val_loss: 0.3987 - val_accuracy: 0.9163 Trial 39 Complete [00h 02m 36s] val_accuracy: 0.9163333177566528 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 31m 07s Search: Running Trial #40 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 2 |2 |dense_depth 128 |512 |dense_width leaky |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0023 |0008 |tuner/trial_id Epoch 4/8 1688/1688 [==============================] - 16s 8ms/step - loss: 0.5451 - accuracy: 0.8011 - val_loss: 0.3237 - val_accuracy: 0.8792 Epoch 5/8 1688/1688 [==============================] - 14s 8ms/step - loss: 0.3553 - accuracy: 0.8702 - val_loss: 0.3241 - val_accuracy: 0.8757 Epoch 6/8 1688/1688 [==============================] - 14s 8ms/step - loss: 0.3093 - accuracy: 0.8869 - val_loss: 0.2612 - val_accuracy: 0.9023 Epoch 7/8 1688/1688 [==============================] - 14s 8ms/step - loss: 0.2833 - accuracy: 0.8962 - val_loss: 0.2782 - val_accuracy: 0.9027 Epoch 8/8 1688/1688 [==============================] - 14s 8ms/step - loss: 0.2638 - accuracy: 0.9042 - val_loss: 0.2430 - val_accuracy: 0.9115 Trial 40 Complete [00h 01m 12s] val_accuracy: 0.9114999771118164 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 32m 19s Search: Running Trial #41 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width elu |swish |activation l1_l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 32 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0013 |0008 |tuner/trial_id Epoch 4/8 1688/1688 [==============================] - 18s 9ms/step - loss: 1.5005 - accuracy: 0.7295 - val_loss: 1.1842 - val_accuracy: 0.8378 Epoch 5/8 1688/1688 [==============================] - 16s 9ms/step - loss: 1.1825 - accuracy: 0.8366 - val_loss: 1.0658 - val_accuracy: 0.8788 Epoch 6/8 1688/1688 [==============================] - 16s 9ms/step - loss: 1.0847 - accuracy: 0.8642 - val_loss: 0.9983 - val_accuracy: 0.8887 Epoch 7/8 1688/1688 [==============================] - 16s 9ms/step - loss: 1.0192 - accuracy: 0.8789 - val_loss: 0.9667 - val_accuracy: 0.8888 Epoch 8/8 1688/1688 [==============================] - 16s 9ms/step - loss: 0.9665 - accuracy: 0.8900 - val_loss: 0.9250 - val_accuracy: 0.8995 Trial 41 Complete [00h 01m 20s] val_accuracy: 0.8995000123977661 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 33m 39s Search: Running Trial #42 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 4 |2 |dense_depth 128 |512 |dense_width tanh |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 64 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0007 |0008 |tuner/trial_id Epoch 4/8 5/844 [..............................] - ETA: 36s - loss: 5.0147 - accuracy: 0.1906WARNING:tensorflow:Callback method `on_train_batch844/844 [==============================] - 40s 45ms/step - loss: 2.5470 - accuracy: 0.8033 - val_loss: 1.7344 - val_accuracy: 0.8512 Epoch 5/8 844/844 [==============================] - 39s 46ms/step - loss: 1.4455 - accuracy: 0.8633 - val_loss: 1.2904 - val_accuracy: 0.8630 Epoch 6/8 844/844 [==============================] - 38s 44ms/step - loss: 1.1929 - accuracy: 0.8714 - val_loss: 1.0503 - val_accuracy: 0.8848 Epoch 7/8 844/844 [==============================] - 38s 45ms/step - loss: 1.0247 - accuracy: 0.8805 - val_loss: 0.9814 - val_accuracy: 0.8820 Epoch 8/8 844/844 [==============================] - 37s 44ms/step - loss: 0.9398 - accuracy: 0.8875 - val_loss: 0.9564 - val_accuracy: 0.8665 Trial 42 Complete [00h 03m 11s] val_accuracy: 0.8848333358764648 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 36m 51s Search: Running Trial #43 Value |Best Value So Far |Hyperparameter 4 |2 |convolution_depth 64 |128 |convolution_width 3 |2 |dense_depth 64 |512 |dense_width sigmoid |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 64 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0022 |0008 |tuner/trial_id Epoch 4/8 844/844 [==============================] - 20s 21ms/step - loss: 2.0219 - accuracy: 0.3853 - val_loss: 1.5787 - val_accuracy: 0.7628 Epoch 5/8 844/844 [==============================] - 18s 21ms/step - loss: 1.2973 - accuracy: 0.6953 - val_loss: 0.9753 - val_accuracy: 0.8293 Epoch 6/8 844/844 [==============================] - 18s 21ms/step - loss: 0.8595 - accuracy: 0.7989 - val_loss: 0.6739 - val_accuracy: 0.8368 Epoch 7/8 844/844 [==============================] - 18s 21ms/step - loss: 0.6172 - accuracy: 0.8458 - val_loss: 0.5076 - val_accuracy: 0.8567 Epoch 8/8 844/844 [==============================] - 18s 21ms/step - loss: 0.4848 - accuracy: 0.8708 - val_loss: 0.4274 - val_accuracy: 0.8758 Trial 43 Complete [00h 01m 31s] val_accuracy: 0.8758333325386047 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 38m 22s Search: Running Trial #44 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 32 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width swish |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.5 |0.2 |dropout adam |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 256 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0032 |0008 |tuner/trial_id Epoch 4/8 4/211 [..............................] - ETA: 4s - loss: 3.7311 - accuracy: 0.2686 WARNING:tensorflow:Callback method `on_train_batc211/211 [==============================] - 6s 26ms/step - loss: 1.0817 - accuracy: 0.7436 - val_loss: 2.7620 - val_accuracy: 0.4632 Epoch 5/8 211/211 [==============================] - 5s 25ms/step - loss: 0.7536 - accuracy: 0.8371 - val_loss: 1.2000 - val_accuracy: 0.7062 Epoch 6/8 211/211 [==============================] - 6s 26ms/step - loss: 0.6552 - accuracy: 0.8644 - val_loss: 0.5950 - val_accuracy: 0.8842 Epoch 7/8 211/211 [==============================] - 6s 27ms/step - loss: 0.6002 - accuracy: 0.8788 - val_loss: 0.5326 - val_accuracy: 0.9008 Epoch 8/8 211/211 [==============================] - 5s 25ms/step - loss: 0.5606 - accuracy: 0.8856 - val_loss: 0.5192 - val_accuracy: 0.8985 Trial 44 Complete [00h 00m 29s] val_accuracy: 0.9008333086967468 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 38m 51s Search: Running Trial #45 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 16 |128 |convolution_width 4 |2 |dense_depth 128 |512 |dense_width sigmoid |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 128 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0021 |0008 |tuner/trial_id Epoch 4/8 422/422 [==============================] - 6s 10ms/step - loss: 1.3908 - accuracy: 0.5088 - val_loss: 1.0062 - val_accuracy: 0.6645 Epoch 5/8 422/422 [==============================] - 4s 10ms/step - loss: 0.7251 - accuracy: 0.7932 - val_loss: 0.5924 - val_accuracy: 0.8508 Epoch 6/8 422/422 [==============================] - 4s 10ms/step - loss: 0.6442 - accuracy: 0.8413 - val_loss: 0.5550 - val_accuracy: 0.8708 Epoch 7/8 422/422 [==============================] - 4s 10ms/step - loss: 0.6058 - accuracy: 0.8619 - val_loss: 0.5201 - val_accuracy: 0.8862 Epoch 8/8 422/422 [==============================] - 4s 10ms/step - loss: 0.5776 - accuracy: 0.8740 - val_loss: 0.5010 - val_accuracy: 0.8922 Trial 45 Complete [00h 00m 23s] val_accuracy: 0.8921666741371155 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 39m 13s Search: Running Trial #46 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 16 |128 |convolution_width 4 |2 |dense_depth 256 |512 |dense_width elu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 32 |128 |batch_size 8 |8 |tuner/epochs 3 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 1 |1 |tuner/round 0010 |0008 |tuner/trial_id Epoch 4/8 1688/1688 [==============================] - 14s 7ms/step - loss: 0.9689 - accuracy: 0.7212 - val_loss: 0.6846 - val_accuracy: 0.8228 Epoch 5/8 1688/1688 [==============================] - 12s 7ms/step - loss: 0.7336 - accuracy: 0.8020 - val_loss: 0.6080 - val_accuracy: 0.8533 Epoch 6/8 1688/1688 [==============================] - 12s 7ms/step - loss: 0.6436 - accuracy: 0.8365 - val_loss: 0.5665 - val_accuracy: 0.8683 Epoch 7/8 1688/1688 [==============================] - 12s 7ms/step - loss: 0.6237 - accuracy: 0.8432 - val_loss: 0.5561 - val_accuracy: 0.8675 Epoch 8/8 1688/1688 [==============================] - 12s 7ms/step - loss: 0.5806 - accuracy: 0.8574 - val_loss: 0.5197 - val_accuracy: 0.8827 Trial 46 Complete [00h 01m 04s] val_accuracy: 0.8826666474342346 Best val_accuracy So Far: 0.9229999780654907 Total elapsed time: 00h 40m 17s Search: Running Trial #47 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width swish |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 128 |128 |batch_size 22 |8 |tuner/epochs 8 |3 |tuner/initial_epoch 3 |3 |tuner/bracket 2 |1 |tuner/round 0036 |0008 |tuner/trial_id Epoch 9/22 6/422 [..............................] - ETA: 38s - loss: 3.9413 - accuracy: 0.3750WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 32s 72ms/step - loss: 1.1456 - accuracy: 0.8293 - val_loss: 2.0873 - val_accuracy: 0.4137 Epoch 10/22 422/422 [==============================] - 31s 72ms/step - loss: 0.7896 - accuracy: 0.8941 - val_loss: 0.7113 - val_accuracy: 0.9003 Epoch 11/22 422/422 [==============================] - 30s 72ms/step - loss: 0.6442 - accuracy: 0.9104 - val_loss: 0.6267 - val_accuracy: 0.9067 Epoch 12/22 422/422 [==============================] - 30s 72ms/step - loss: 0.5673 - accuracy: 0.9196 - val_loss: 0.5606 - val_accuracy: 0.9120 Epoch 13/22 422/422 [==============================] - 31s 72ms/step - loss: 0.5070 - accuracy: 0.9295 - val_loss: 0.5021 - val_accuracy: 0.9280 Epoch 14/22 422/422 [==============================] - 30s 71ms/step - loss: 0.4865 - accuracy: 0.9324 - val_loss: 0.5278 - val_accuracy: 0.9117 Epoch 15/22 422/422 [==============================] - 30s 72ms/step - loss: 0.4619 - accuracy: 0.9384 - val_loss: 0.4793 - val_accuracy: 0.9325 Epoch 16/22 422/422 [==============================] - 30s 71ms/step - loss: 0.4304 - accuracy: 0.9458 - val_loss: 0.4868 - val_accuracy: 0.9222 Epoch 17/22 422/422 [==============================] - 30s 71ms/step - loss: 0.4094 - accuracy: 0.9501 - val_loss: 0.4536 - val_accuracy: 0.9348 Epoch 18/22 422/422 [==============================] - 30s 71ms/step - loss: 0.3977 - accuracy: 0.9524 - val_loss: 0.4499 - val_accuracy: 0.9320 Epoch 19/22 422/422 [==============================] - 30s 71ms/step - loss: 0.3845 - accuracy: 0.9564 - val_loss: 0.4568 - val_accuracy: 0.9328 Epoch 20/22 422/422 [==============================] - 31s 72ms/step - loss: 0.3640 - accuracy: 0.9615 - val_loss: 0.4432 - val_accuracy: 0.9358 Epoch 21/22 422/422 [==============================] - 31s 74ms/step - loss: 0.3413 - accuracy: 0.9650 - val_loss: 0.4251 - val_accuracy: 0.9385 Epoch 22/22 422/422 [==============================] - 30s 71ms/step - loss: 0.3262 - accuracy: 0.9686 - val_loss: 0.4303 - val_accuracy: 0.9378 Trial 47 Complete [00h 07m 06s] val_accuracy: 0.9384999871253967 Best val_accuracy So Far: 0.9384999871253967 Total elapsed time: 00h 47m 23s Search: Running Trial #48 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 64 |128 |batch_size 22 |22 |tuner/epochs 8 |8 |tuner/initial_epoch 3 |3 |tuner/bracket 2 |2 |tuner/round 0035 |0036 |tuner/trial_id Epoch 9/22 844/844 [==============================] - 41s 46ms/step - loss: 1.1347 - accuracy: 0.7558 - val_loss: 0.7994 - val_accuracy: 0.8317 Epoch 10/22 844/844 [==============================] - 40s 48ms/step - loss: 0.6636 - accuracy: 0.8867 - val_loss: 0.6189 - val_accuracy: 0.8953 Epoch 11/22 844/844 [==============================] - 39s 46ms/step - loss: 0.5854 - accuracy: 0.9074 - val_loss: 0.5518 - val_accuracy: 0.9147 Epoch 12/22 844/844 [==============================] - 43s 51ms/step - loss: 0.5451 - accuracy: 0.9194 - val_loss: 0.5243 - val_accuracy: 0.9223 Epoch 13/22 844/844 [==============================] - 40s 47ms/step - loss: 0.5151 - accuracy: 0.9254 - val_loss: 0.5229 - val_accuracy: 0.9170 Epoch 14/22 844/844 [==============================] - 39s 46ms/step - loss: 0.4892 - accuracy: 0.9336 - val_loss: 0.4905 - val_accuracy: 0.9288 Epoch 15/22 844/844 [==============================] - 39s 46ms/step - loss: 0.4685 - accuracy: 0.9382 - val_loss: 0.5056 - val_accuracy: 0.9238 Epoch 16/22 844/844 [==============================] - 38s 46ms/step - loss: 0.4509 - accuracy: 0.9416 - val_loss: 0.4802 - val_accuracy: 0.9287 Epoch 17/22 844/844 [==============================] - 39s 46ms/step - loss: 0.4310 - accuracy: 0.9469 - val_loss: 0.4547 - val_accuracy: 0.9357 Epoch 18/22 844/844 [==============================] - 39s 46ms/step - loss: 0.4125 - accuracy: 0.9520 - val_loss: 0.4534 - val_accuracy: 0.9362 Epoch 19/22 844/844 [==============================] - 38s 45ms/step - loss: 0.4005 - accuracy: 0.9542 - val_loss: 0.4491 - val_accuracy: 0.9342 Epoch 20/22 844/844 [==============================] - 39s 46ms/step - loss: 0.3888 - accuracy: 0.9563 - val_loss: 0.4452 - val_accuracy: 0.9375 Epoch 21/22 844/844 [==============================] - 39s 46ms/step - loss: 0.3740 - accuracy: 0.9602 - val_loss: 0.4385 - val_accuracy: 0.9382 Epoch 22/22 844/844 [==============================] - 40s 47ms/step - loss: 0.3609 - accuracy: 0.9638 - val_loss: 0.4581 - val_accuracy: 0.9363 Trial 48 Complete [00h 09m 13s] val_accuracy: 0.9381666779518127 Best val_accuracy So Far: 0.9384999871253967 Total elapsed time: 00h 56m 36s Search: Running Trial #49 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 22 |22 |tuner/epochs 8 |8 |tuner/initial_epoch 3 |3 |tuner/bracket 2 |2 |tuner/round 0038 |0036 |tuner/trial_id Epoch 9/22 1688/1688 [==============================] - 32s 18ms/step - loss: 0.8162 - accuracy: 0.7824 - val_loss: 0.5128 - val_accuracy: 0.8792 Epoch 10/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.5802 - accuracy: 0.8551 - val_loss: 0.4697 - val_accuracy: 0.8873 Epoch 11/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.4893 - accuracy: 0.8811 - val_loss: 0.4250 - val_accuracy: 0.9033 Epoch 12/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.4283 - accuracy: 0.8991 - val_loss: 0.3966 - val_accuracy: 0.9073 Epoch 13/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.3982 - accuracy: 0.9082 - val_loss: 0.3902 - val_accuracy: 0.9117 Epoch 14/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.3671 - accuracy: 0.9163 - val_loss: 0.3710 - val_accuracy: 0.9162 Epoch 15/22 1688/1688 [==============================] - 31s 19ms/step - loss: 0.3458 - accuracy: 0.9255 - val_loss: 0.3593 - val_accuracy: 0.9190 Epoch 16/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.3213 - accuracy: 0.9339 - val_loss: 0.3545 - val_accuracy: 0.9235 Epoch 17/22 1688/1688 [==============================] - 30s 18ms/step - loss: 0.3026 - accuracy: 0.9401 - val_loss: 0.3631 - val_accuracy: 0.9225 Epoch 18/22 1688/1688 [==============================] - 30s 18ms/step - loss: 0.2863 - accuracy: 0.9451 - val_loss: 0.3846 - val_accuracy: 0.9185 Epoch 19/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.2760 - accuracy: 0.9488 - val_loss: 0.3613 - val_accuracy: 0.9228 Epoch 20/22 1688/1688 [==============================] - 30s 18ms/step - loss: 0.2626 - accuracy: 0.9525 - val_loss: 0.3675 - val_accuracy: 0.9202 Epoch 21/22 1688/1688 [==============================] - 31s 18ms/step - loss: 0.2525 - accuracy: 0.9565 - val_loss: 0.3559 - val_accuracy: 0.9283 Epoch 22/22 1688/1688 [==============================] - 30s 18ms/step - loss: 0.2464 - accuracy: 0.9592 - val_loss: 0.3633 - val_accuracy: 0.9253 Trial 49 Complete [00h 07m 11s] val_accuracy: 0.9283333420753479 Best val_accuracy So Far: 0.9384999871253967 Total elapsed time: 01h 03m 46s Search: Running Trial #50 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 1 |2 |dense_depth 512 |512 |dense_width elu |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 128 |128 |batch_size 22 |22 |tuner/epochs 8 |8 |tuner/initial_epoch 3 |3 |tuner/bracket 2 |2 |tuner/round 0034 |0036 |tuner/trial_id Epoch 9/22 422/422 [==============================] - 9s 18ms/step - loss: 0.6404 - accuracy: 0.7986 - val_loss: 1.3922 - val_accuracy: 0.5525 Epoch 10/22 422/422 [==============================] - 8s 18ms/step - loss: 0.4000 - accuracy: 0.8589 - val_loss: 0.3272 - val_accuracy: 0.8818 Epoch 11/22 422/422 [==============================] - 8s 18ms/step - loss: 0.2541 - accuracy: 0.9058 - val_loss: 0.2329 - val_accuracy: 0.9120 Epoch 12/22 422/422 [==============================] - 7s 18ms/step - loss: 0.2863 - accuracy: 0.8976 - val_loss: 0.4420 - val_accuracy: 0.8488 Epoch 13/22 422/422 [==============================] - 7s 18ms/step - loss: 0.2605 - accuracy: 0.9061 - val_loss: 0.3360 - val_accuracy: 0.8805 Epoch 14/22 422/422 [==============================] - 8s 18ms/step - loss: 0.2086 - accuracy: 0.9232 - val_loss: 0.2128 - val_accuracy: 0.9223 Epoch 15/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1616 - accuracy: 0.9393 - val_loss: 0.1990 - val_accuracy: 0.9288 Epoch 16/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1609 - accuracy: 0.9425 - val_loss: 0.4420 - val_accuracy: 0.8600 Epoch 17/22 422/422 [==============================] - 7s 18ms/step - loss: 0.2473 - accuracy: 0.9116 - val_loss: 0.2828 - val_accuracy: 0.8963 Epoch 18/22 422/422 [==============================] - 7s 18ms/step - loss: 0.2137 - accuracy: 0.9218 - val_loss: 0.2455 - val_accuracy: 0.9152 Epoch 19/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1847 - accuracy: 0.9318 - val_loss: 0.2357 - val_accuracy: 0.9160 Epoch 20/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1602 - accuracy: 0.9414 - val_loss: 0.2363 - val_accuracy: 0.9165 Epoch 21/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1343 - accuracy: 0.9504 - val_loss: 0.2091 - val_accuracy: 0.9262 Epoch 22/22 422/422 [==============================] - 7s 18ms/step - loss: 0.1027 - accuracy: 0.9610 - val_loss: 0.2398 - val_accuracy: 0.9220 Trial 50 Complete [00h 01m 46s] val_accuracy: 0.9288333058357239 Best val_accuracy So Far: 0.9384999871253967 Total elapsed time: 01h 05m 33s Search: Running Trial #51 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width swish |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 128 |128 |batch_size 64 |22 |tuner/epochs 22 |8 |tuner/initial_epoch 3 |3 |tuner/bracket 3 |2 |tuner/round 0046 |0036 |tuner/trial_id Epoch 23/64 6/422 [..............................] - ETA: 38s - loss: 4.4903 - accuracy: 0.3320WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 31s 72ms/step - loss: 1.1551 - accuracy: 0.8275 - val_loss: 4.0759 - val_accuracy: 0.3712 Epoch 24/64 422/422 [==============================] - 30s 72ms/step - loss: 0.7894 - accuracy: 0.8952 - val_loss: 0.6844 - val_accuracy: 0.9080 Epoch 25/64 422/422 [==============================] - 30s 71ms/step - loss: 0.6485 - accuracy: 0.9097 - val_loss: 0.6159 - val_accuracy: 0.9030 Epoch 26/64 422/422 [==============================] - 30s 72ms/step - loss: 0.5595 - accuracy: 0.9186 - val_loss: 0.5427 - val_accuracy: 0.9208 Epoch 27/64 422/422 [==============================] - 30s 71ms/step - loss: 0.5120 - accuracy: 0.9276 - val_loss: 0.5083 - val_accuracy: 0.9272 Epoch 28/64 422/422 [==============================] - 30s 71ms/step - loss: 0.4769 - accuracy: 0.9350 - val_loss: 0.4982 - val_accuracy: 0.9232 Epoch 29/64 422/422 [==============================] - 30s 71ms/step - loss: 0.4573 - accuracy: 0.9392 - val_loss: 0.4861 - val_accuracy: 0.9235 Epoch 30/64 422/422 [==============================] - 30s 72ms/step - loss: 0.4299 - accuracy: 0.9443 - val_loss: 0.4627 - val_accuracy: 0.9318 Epoch 31/64 422/422 [==============================] - 30s 71ms/step - loss: 0.4136 - accuracy: 0.9492 - val_loss: 0.4897 - val_accuracy: 0.9248 Epoch 32/64 422/422 [==============================] - 30s 71ms/step - loss: 0.3953 - accuracy: 0.9531 - val_loss: 0.4625 - val_accuracy: 0.9297 Epoch 33/64 422/422 [==============================] - 30s 72ms/step - loss: 0.3772 - accuracy: 0.9576 - val_loss: 0.4544 - val_accuracy: 0.9363 Epoch 34/64 422/422 [==============================] - 30s 70ms/step - loss: 0.3557 - accuracy: 0.9629 - val_loss: 0.4400 - val_accuracy: 0.9358 Epoch 35/64 422/422 [==============================] - 31s 73ms/step - loss: 0.3355 - accuracy: 0.9663 - val_loss: 0.4330 - val_accuracy: 0.9370 Epoch 36/64 422/422 [==============================] - 30s 72ms/step - loss: 0.3239 - accuracy: 0.9694 - val_loss: 0.4256 - val_accuracy: 0.9375 Epoch 37/64 422/422 [==============================] - 30s 71ms/step - loss: 0.3121 - accuracy: 0.9718 - val_loss: 0.4226 - val_accuracy: 0.9355 Epoch 38/64 422/422 [==============================] - 30s 71ms/step - loss: 0.2979 - accuracy: 0.9742 - val_loss: 0.4155 - val_accuracy: 0.9408 Epoch 39/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2858 - accuracy: 0.9771 - val_loss: 0.4285 - val_accuracy: 0.9387 Epoch 40/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2750 - accuracy: 0.9796 - val_loss: 0.4111 - val_accuracy: 0.9382 Epoch 41/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2659 - accuracy: 0.9814 - val_loss: 0.4406 - val_accuracy: 0.9377 Epoch 42/64 422/422 [==============================] - 30s 72ms/step - loss: 0.2567 - accuracy: 0.9836 - val_loss: 0.4402 - val_accuracy: 0.9415 Epoch 43/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2515 - accuracy: 0.9842 - val_loss: 0.4463 - val_accuracy: 0.9358 Epoch 44/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2515 - accuracy: 0.9862 - val_loss: 0.4694 - val_accuracy: 0.9380 Epoch 45/64 422/422 [==============================] - 30s 71ms/step - loss: 0.2504 - accuracy: 0.9869 - val_loss: 0.4664 - val_accuracy: 0.9390 Epoch 46/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2460 - accuracy: 0.9884 - val_loss: 0.4376 - val_accuracy: 0.9393 Epoch 47/64 422/422 [==============================] - 30s 71ms/step - loss: 0.2308 - accuracy: 0.9889 - val_loss: 0.4361 - val_accuracy: 0.9427 Epoch 48/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2164 - accuracy: 0.9905 - val_loss: 0.4214 - val_accuracy: 0.9398 Epoch 49/64 422/422 [==============================] - 30s 71ms/step - loss: 0.2148 - accuracy: 0.9905 - val_loss: 0.4567 - val_accuracy: 0.9438 Epoch 50/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2162 - accuracy: 0.9909 - val_loss: 0.4451 - val_accuracy: 0.9392 Epoch 51/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2099 - accuracy: 0.9912 - val_loss: 0.4800 - val_accuracy: 0.9398 Epoch 52/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2091 - accuracy: 0.9918 - val_loss: 0.4581 - val_accuracy: 0.9377 Epoch 53/64 422/422 [==============================] - 30s 70ms/step - loss: 0.2002 - accuracy: 0.9924 - val_loss: 0.4365 - val_accuracy: 0.9423 Epoch 54/64 422/422 [==============================] - 30s 70ms/step - loss: 0.1893 - accuracy: 0.9936 - val_loss: 0.4517 - val_accuracy: 0.9422 Epoch 55/64 422/422 [==============================] - 30s 70ms/step - loss: 0.1839 - accuracy: 0.9936 - val_loss: 0.4386 - val_accuracy: 0.9418 Epoch 56/64 422/422 [==============================] - 30s 70ms/step - loss: 0.1791 - accuracy: 0.9941 - val_loss: 0.4397 - val_accuracy: 0.9427 Epoch 57/64 422/422 [==============================] - 30s 70ms/step - loss: 0.1779 - accuracy: 0.9939 - val_loss: 0.4319 - val_accuracy: 0.9422 Trial 51 Complete [00h 17m 28s] val_accuracy: 0.9438333511352539 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 23m 00s Search: Running Trial #52 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 64 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 3 |3 |tuner/bracket 3 |3 |tuner/round 0047 |0046 |tuner/trial_id Epoch 23/64 844/844 [==============================] - 41s 46ms/step - loss: 1.1386 - accuracy: 0.7506 - val_loss: 0.7074 - val_accuracy: 0.8713 Epoch 24/64 844/844 [==============================] - 38s 45ms/step - loss: 0.6608 - accuracy: 0.8868 - val_loss: 0.6136 - val_accuracy: 0.8987 Epoch 25/64 844/844 [==============================] - 38s 46ms/step - loss: 0.5825 - accuracy: 0.9083 - val_loss: 0.5784 - val_accuracy: 0.9043 Epoch 26/64 844/844 [==============================] - 38s 45ms/step - loss: 0.5436 - accuracy: 0.9185 - val_loss: 0.5388 - val_accuracy: 0.9145 Epoch 27/64 844/844 [==============================] - 38s 45ms/step - loss: 0.5119 - accuracy: 0.9261 - val_loss: 0.5121 - val_accuracy: 0.9268 Epoch 28/64 844/844 [==============================] - 38s 45ms/step - loss: 0.4880 - accuracy: 0.9326 - val_loss: 0.5088 - val_accuracy: 0.9220 Epoch 29/64 844/844 [==============================] - 39s 46ms/step - loss: 0.4683 - accuracy: 0.9372 - val_loss: 0.4920 - val_accuracy: 0.9277 Epoch 30/64 844/844 [==============================] - 39s 46ms/step - loss: 0.4466 - accuracy: 0.9428 - val_loss: 0.5307 - val_accuracy: 0.9082 Epoch 31/64 844/844 [==============================] - 39s 47ms/step - loss: 0.4294 - accuracy: 0.9469 - val_loss: 0.4500 - val_accuracy: 0.9370 Epoch 32/64 844/844 [==============================] - 38s 46ms/step - loss: 0.4168 - accuracy: 0.9496 - val_loss: 0.4615 - val_accuracy: 0.9348 Epoch 33/64 844/844 [==============================] - 38s 46ms/step - loss: 0.3988 - accuracy: 0.9539 - val_loss: 0.4416 - val_accuracy: 0.9385 Epoch 34/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3853 - accuracy: 0.9565 - val_loss: 0.4454 - val_accuracy: 0.9333 Epoch 35/64 844/844 [==============================] - 38s 45ms/step - loss: 0.3727 - accuracy: 0.9597 - val_loss: 0.4384 - val_accuracy: 0.9362 Epoch 36/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3603 - accuracy: 0.9626 - val_loss: 0.4285 - val_accuracy: 0.9407 Epoch 37/64 844/844 [==============================] - 38s 45ms/step - loss: 0.3486 - accuracy: 0.9650 - val_loss: 0.4270 - val_accuracy: 0.9385 Epoch 38/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3411 - accuracy: 0.9668 - val_loss: 0.4406 - val_accuracy: 0.9352 Epoch 39/64 844/844 [==============================] - 38s 46ms/step - loss: 0.3289 - accuracy: 0.9697 - val_loss: 0.4218 - val_accuracy: 0.9387 Epoch 40/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3196 - accuracy: 0.9716 - val_loss: 0.4202 - val_accuracy: 0.9412 Epoch 41/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3114 - accuracy: 0.9738 - val_loss: 0.4124 - val_accuracy: 0.9433 Epoch 42/64 844/844 [==============================] - 39s 46ms/step - loss: 0.3021 - accuracy: 0.9752 - val_loss: 0.4158 - val_accuracy: 0.9407 Epoch 43/64 844/844 [==============================] - 38s 45ms/step - loss: 0.2948 - accuracy: 0.9771 - val_loss: 0.4174 - val_accuracy: 0.9403 Epoch 44/64 844/844 [==============================] - 39s 46ms/step - loss: 0.2880 - accuracy: 0.9785 - val_loss: 0.4249 - val_accuracy: 0.9393 Epoch 45/64 844/844 [==============================] - 39s 46ms/step - loss: 0.2806 - accuracy: 0.9799 - val_loss: 0.4258 - val_accuracy: 0.9408 Epoch 46/64 844/844 [==============================] - 39s 46ms/step - loss: 0.2741 - accuracy: 0.9811 - val_loss: 0.4226 - val_accuracy: 0.9412 Epoch 47/64 844/844 [==============================] - 38s 45ms/step - loss: 0.2713 - accuracy: 0.9816 - val_loss: 0.4159 - val_accuracy: 0.9425 Epoch 48/64 844/844 [==============================] - 38s 46ms/step - loss: 0.2645 - accuracy: 0.9837 - val_loss: 0.4172 - val_accuracy: 0.9427 Epoch 49/64 844/844 [==============================] - 38s 45ms/step - loss: 0.2597 - accuracy: 0.9838 - val_loss: 0.4195 - val_accuracy: 0.9422 Trial 52 Complete [00h 17m 23s] val_accuracy: 0.9433333277702332 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 40m 23s Search: Running Trial #53 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width swish |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 1688/1688 [==============================] - 49s 28ms/step - loss: 0.4215 - accuracy: 0.8478 - val_loss: 0.2937 - val_accuracy: 0.8952 Epoch 2/8 1688/1688 [==============================] - 48s 28ms/step - loss: 0.2815 - accuracy: 0.8990 - val_loss: 0.2705 - val_accuracy: 0.9043 Epoch 3/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.2436 - accuracy: 0.9138 - val_loss: 0.2293 - val_accuracy: 0.9153 Epoch 4/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.2144 - accuracy: 0.9221 - val_loss: 0.2217 - val_accuracy: 0.9167 Epoch 5/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1974 - accuracy: 0.9285 - val_loss: 0.2544 - val_accuracy: 0.9190 Epoch 6/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1718 - accuracy: 0.9382 - val_loss: 0.2124 - val_accuracy: 0.9248 Epoch 7/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1558 - accuracy: 0.9434 - val_loss: 0.2234 - val_accuracy: 0.9247 Epoch 8/8 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1383 - accuracy: 0.9495 - val_loss: 0.2302 - val_accuracy: 0.9223 Trial 53 Complete [00h 06m 20s] val_accuracy: 0.924833357334137 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 46m 43s Search: Running Trial #54 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 0 |2 |dense_depth 512 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 64 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 4/844 [..............................] - ETA: 19s - loss: 2.3240 - accuracy: 0.2891 WARNING:tensorflow:Callback method `on_train_batc844/844 [==============================] - 22s 25ms/step - loss: 0.4598 - accuracy: 0.8565 - val_loss: 0.3988 - val_accuracy: 0.8787 Epoch 2/8 844/844 [==============================] - 21s 25ms/step - loss: 0.3322 - accuracy: 0.8991 - val_loss: 0.3545 - val_accuracy: 0.8967 Epoch 3/8 844/844 [==============================] - 21s 25ms/step - loss: 0.2705 - accuracy: 0.9183 - val_loss: 0.3349 - val_accuracy: 0.9032 Epoch 4/8 844/844 [==============================] - 21s 25ms/step - loss: 0.2440 - accuracy: 0.9269 - val_loss: 0.3029 - val_accuracy: 0.9115 Epoch 5/8 844/844 [==============================] - 21s 25ms/step - loss: 0.2083 - accuracy: 0.9389 - val_loss: 0.3418 - val_accuracy: 0.9007 Epoch 6/8 844/844 [==============================] - 21s 25ms/step - loss: 0.1843 - accuracy: 0.9474 - val_loss: 0.3460 - val_accuracy: 0.9043 Epoch 7/8 844/844 [==============================] - 21s 25ms/step - loss: 0.1651 - accuracy: 0.9539 - val_loss: 0.3420 - val_accuracy: 0.9060 Epoch 8/8 844/844 [==============================] - 21s 25ms/step - loss: 0.1445 - accuracy: 0.9615 - val_loss: 0.3449 - val_accuracy: 0.9148 Trial 54 Complete [00h 02m 48s] val_accuracy: 0.9148333072662354 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 49m 31s Search: Running Trial #55 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 1 |2 |dense_depth 512 |512 |dense_width elu |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 512 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/106 [>.............................] - ETA: 20s - loss: 13.0518 - accuracy: 0.5127WARNING:tensorflow:Callback method `on_train_batc106/106 [==============================] - 28s 250ms/step - loss: 10.5772 - accuracy: 0.8282 - val_loss: 12.4232 - val_accuracy: 0.1902 Epoch 2/8 106/106 [==============================] - 22s 209ms/step - loss: 9.3283 - accuracy: 0.8979 - val_loss: 13.1229 - val_accuracy: 0.1240 Epoch 3/8 106/106 [==============================] - 25s 240ms/step - loss: 8.1522 - accuracy: 0.9155 - val_loss: 11.4370 - val_accuracy: 0.3627 Epoch 4/8 106/106 [==============================] - 27s 254ms/step - loss: 6.9699 - accuracy: 0.9282 - val_loss: 8.6205 - val_accuracy: 0.4087 Epoch 5/8 106/106 [==============================] - 24s 226ms/step - loss: 5.8535 - accuracy: 0.9386 - val_loss: 5.9903 - val_accuracy: 0.7113 Epoch 6/8 106/106 [==============================] - 25s 240ms/step - loss: 4.8491 - accuracy: 0.9479 - val_loss: 4.6635 - val_accuracy: 0.8533 Epoch 7/8 106/106 [==============================] - 25s 236ms/step - loss: 3.9955 - accuracy: 0.9525 - val_loss: 3.7427 - val_accuracy: 0.9075 Epoch 8/8 106/106 [==============================] - 26s 245ms/step - loss: 3.2748 - accuracy: 0.9564 - val_loss: 3.0847 - val_accuracy: 0.9125 Trial 55 Complete [00h 03m 24s] val_accuracy: 0.9125000238418579 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 52m 55s Search: Running Trial #56 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/1688 [..............................] - ETA: 40s - loss: 5.3321 - accuracy: 0.2396WARNING:tensorflow:Callback method `on_train_bat1688/1688 [==============================] - 33s 19ms/step - loss: 2.9864 - accuracy: 0.7980 - val_loss: 2.0794 - val_accuracy: 0.8790 Epoch 2/8 1688/1688 [==============================] - 33s 19ms/step - loss: 1.7706 - accuracy: 0.8692 - val_loss: 1.4290 - val_accuracy: 0.8977 Epoch 3/8 1688/1688 [==============================] - 32s 19ms/step - loss: 1.3125 - accuracy: 0.8891 - val_loss: 1.1515 - val_accuracy: 0.9015 Epoch 4/8 1688/1688 [==============================] - 32s 19ms/step - loss: 1.1081 - accuracy: 0.9015 - val_loss: 1.0274 - val_accuracy: 0.9147 Epoch 5/8 1688/1688 [==============================] - 32s 19ms/step - loss: 1.0002 - accuracy: 0.9102 - val_loss: 0.9650 - val_accuracy: 0.9067 Epoch 6/8 1688/1688 [==============================] - 32s 19ms/step - loss: 0.9057 - accuracy: 0.9204 - val_loss: 0.9112 - val_accuracy: 0.9055 Epoch 7/8 1688/1688 [==============================] - 32s 19ms/step - loss: 0.8405 - accuracy: 0.9266 - val_loss: 0.8240 - val_accuracy: 0.9178 Epoch 8/8 1688/1688 [==============================] - 32s 19ms/step - loss: 0.7814 - accuracy: 0.9328 - val_loss: 0.8007 - val_accuracy: 0.9115 Trial 56 Complete [00h 04m 19s] val_accuracy: 0.9178333282470703 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 57m 14s Search: Running Trial #57 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 1 |2 |dense_depth 128 |512 |dense_width sigmoid |swish |activation l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.3 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 1024 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/53 [==>...........................] - ETA: 17s - loss: 1.7164 - accuracy: 0.4419WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 21s 378ms/step - loss: 0.8063 - accuracy: 0.7463 - val_loss: 2.3766 - val_accuracy: 0.1970 Epoch 2/8 53/53 [==============================] - 20s 380ms/step - loss: 0.4953 - accuracy: 0.8547 - val_loss: 2.3787 - val_accuracy: 0.2338 Epoch 3/8 53/53 [==============================] - 20s 380ms/step - loss: 0.4276 - accuracy: 0.8762 - val_loss: 2.3119 - val_accuracy: 0.2982 Epoch 4/8 53/53 [==============================] - 20s 378ms/step - loss: 0.3849 - accuracy: 0.8902 - val_loss: 2.2088 - val_accuracy: 0.3773 Epoch 5/8 53/53 [==============================] - 20s 379ms/step - loss: 0.3582 - accuracy: 0.8995 - val_loss: 2.0401 - val_accuracy: 0.4300 Epoch 6/8 53/53 [==============================] - 20s 376ms/step - loss: 0.3356 - accuracy: 0.9055 - val_loss: 1.7836 - val_accuracy: 0.4803 Epoch 7/8 53/53 [==============================] - 20s 377ms/step - loss: 0.3166 - accuracy: 0.9109 - val_loss: 1.4784 - val_accuracy: 0.5262 Epoch 8/8 53/53 [==============================] - 20s 380ms/step - loss: 0.3033 - accuracy: 0.9163 - val_loss: 1.1194 - val_accuracy: 0.6390 Trial 57 Complete [00h 02m 42s] val_accuracy: 0.6389999985694885 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 01h 59m 55s Search: Running Trial #58 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 1 |2 |dense_depth 256 |512 |dense_width swish |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.3 |0.2 |dropout adam |sgd |optimizer 0.001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/53 [==>...........................] - ETA: 10s - loss: 3.9599 - accuracy: 0.3029WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 14s 235ms/step - loss: 2.2847 - accuracy: 0.6692 - val_loss: 3.6799 - val_accuracy: 0.1072 Epoch 2/8 53/53 [==============================] - 12s 228ms/step - loss: 1.8116 - accuracy: 0.7938 - val_loss: 3.7468 - val_accuracy: 0.1070 Epoch 3/8 53/53 [==============================] - 12s 229ms/step - loss: 1.6493 - accuracy: 0.8370 - val_loss: 3.9334 - val_accuracy: 0.1072 Epoch 4/8 53/53 [==============================] - 12s 229ms/step - loss: 1.5910 - accuracy: 0.8474 - val_loss: 4.3660 - val_accuracy: 0.1072 Epoch 5/8 53/53 [==============================] - 12s 232ms/step - loss: 1.4640 - accuracy: 0.8683 - val_loss: 4.3039 - val_accuracy: 0.1110 Epoch 6/8 53/53 [==============================] - 12s 230ms/step - loss: 1.3632 - accuracy: 0.8853 - val_loss: 4.0555 - val_accuracy: 0.2222 Epoch 7/8 53/53 [==============================] - 12s 230ms/step - loss: 1.3070 - accuracy: 0.8946 - val_loss: 3.8302 - val_accuracy: 0.3868 Epoch 8/8 53/53 [==============================] - 12s 230ms/step - loss: 1.2908 - accuracy: 0.8966 - val_loss: 3.7181 - val_accuracy: 0.4237 Trial 58 Complete [00h 01m 40s] val_accuracy: 0.42366665601730347 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 01m 35s Search: Running Trial #59 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 2 |2 |dense_depth 128 |512 |dense_width tanh |swish |activation l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 1024 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/53 [==>...........................] - ETA: 10s - loss: 1.7893 - accuracy: 0.3831WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 14s 235ms/step - loss: 0.7816 - accuracy: 0.7205 - val_loss: 2.6921 - val_accuracy: 0.1267 Epoch 2/8 53/53 [==============================] - 12s 229ms/step - loss: 0.4249 - accuracy: 0.8472 - val_loss: 3.2728 - val_accuracy: 0.1132 Epoch 3/8 53/53 [==============================] - 12s 228ms/step - loss: 0.3466 - accuracy: 0.8765 - val_loss: 4.2192 - val_accuracy: 0.0972 Epoch 4/8 53/53 [==============================] - 12s 229ms/step - loss: 0.3149 - accuracy: 0.8896 - val_loss: 3.9943 - val_accuracy: 0.0968 Epoch 5/8 53/53 [==============================] - 12s 229ms/step - loss: 0.2890 - accuracy: 0.8983 - val_loss: 4.0341 - val_accuracy: 0.1638 Epoch 6/8 53/53 [==============================] - 12s 231ms/step - loss: 0.2634 - accuracy: 0.9069 - val_loss: 3.6372 - val_accuracy: 0.1933 Epoch 7/8 53/53 [==============================] - 12s 230ms/step - loss: 0.2470 - accuracy: 0.9129 - val_loss: 3.1523 - val_accuracy: 0.2972 Epoch 8/8 53/53 [==============================] - 12s 230ms/step - loss: 0.2376 - accuracy: 0.9174 - val_loss: 2.7744 - val_accuracy: 0.3232 Trial 59 Complete [00h 01m 39s] val_accuracy: 0.3231666684150696 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 03m 14s Search: Running Trial #60 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 2 |2 |dense_depth 64 |512 |dense_width elu |swish |activation l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 512 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 5/106 [>.............................] - ETA: 3s - loss: 4.9276 - accuracy: 0.0844WARNING:tensorflow:Callback method `on_train_batch_106/106 [==============================] - 6s 41ms/step - loss: 4.0099 - accuracy: 0.1135 - val_loss: 2.4001 - val_accuracy: 0.1005 Epoch 2/8 106/106 [==============================] - 4s 38ms/step - loss: 3.2630 - accuracy: 0.1387 - val_loss: 2.3240 - val_accuracy: 0.1672 Epoch 3/8 106/106 [==============================] - 4s 37ms/step - loss: 2.7830 - accuracy: 0.1714 - val_loss: 2.2120 - val_accuracy: 0.1913 Epoch 4/8 106/106 [==============================] - 4s 38ms/step - loss: 2.6099 - accuracy: 0.1943 - val_loss: 1.8810 - val_accuracy: 0.2973 Epoch 5/8 106/106 [==============================] - 4s 38ms/step - loss: 2.2238 - accuracy: 0.2631 - val_loss: 1.4519 - val_accuracy: 0.5033 Epoch 6/8 106/106 [==============================] - 4s 38ms/step - loss: 2.0102 - accuracy: 0.3114 - val_loss: 1.2502 - val_accuracy: 0.5707 Epoch 7/8 106/106 [==============================] - 4s 38ms/step - loss: 1.9174 - accuracy: 0.3357 - val_loss: 1.1871 - val_accuracy: 0.5905 Epoch 8/8 106/106 [==============================] - 4s 38ms/step - loss: 1.8836 - accuracy: 0.3459 - val_loss: 1.1368 - val_accuracy: 0.6055 Trial 60 Complete [00h 00m 34s] val_accuracy: 0.6054999828338623 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 03m 49s Search: Running Trial #61 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 1 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 512 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/106 [>.............................] - ETA: 11s - loss: 2.4537 - accuracy: 0.3063WARNING:tensorflow:Callback method `on_train_batch106/106 [==============================] - 14s 123ms/step - loss: 0.8628 - accuracy: 0.7596 - val_loss: 3.8411 - val_accuracy: 0.1790 Epoch 2/8 106/106 [==============================] - 12s 116ms/step - loss: 0.5716 - accuracy: 0.8588 - val_loss: 4.2382 - val_accuracy: 0.2345 Epoch 3/8 106/106 [==============================] - 12s 116ms/step - loss: 0.5232 - accuracy: 0.8820 - val_loss: 2.2637 - val_accuracy: 0.4640 Epoch 4/8 106/106 [==============================] - 12s 116ms/step - loss: 0.4977 - accuracy: 0.8946 - val_loss: 1.4446 - val_accuracy: 0.6300 Epoch 5/8 106/106 [==============================] - 12s 116ms/step - loss: 0.4883 - accuracy: 0.8991 - val_loss: 0.5427 - val_accuracy: 0.8823 Epoch 6/8 106/106 [==============================] - 12s 115ms/step - loss: 0.4808 - accuracy: 0.9016 - val_loss: 0.6296 - val_accuracy: 0.8497 Epoch 7/8 106/106 [==============================] - 12s 116ms/step - loss: 0.4651 - accuracy: 0.9078 - val_loss: 0.4434 - val_accuracy: 0.9143 Epoch 8/8 106/106 [==============================] - 12s 115ms/step - loss: 0.4568 - accuracy: 0.9109 - val_loss: 0.4395 - val_accuracy: 0.9142 Trial 61 Complete [00h 01m 41s] val_accuracy: 0.9143333435058594 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 05m 29s Search: Running Trial #62 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 32 |128 |convolution_width 1 |2 |dense_depth 128 |512 |dense_width tanh |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 256 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 4/211 [..............................] - ETA: 4s - loss: 2.6918 - accuracy: 0.3057 WARNING:tensorflow:Callback method `on_train_batc211/211 [==============================] - 6s 23ms/step - loss: 0.5941 - accuracy: 0.7832 - val_loss: 3.2465 - val_accuracy: 0.3212 Epoch 2/8 211/211 [==============================] - 5s 22ms/step - loss: 0.4904 - accuracy: 0.8196 - val_loss: 0.9103 - val_accuracy: 0.7223 Epoch 3/8 211/211 [==============================] - 5s 22ms/step - loss: 0.4226 - accuracy: 0.8446 - val_loss: 0.4021 - val_accuracy: 0.8583 Epoch 4/8 211/211 [==============================] - 5s 22ms/step - loss: 0.4260 - accuracy: 0.8445 - val_loss: 0.4365 - val_accuracy: 0.8475 Epoch 5/8 211/211 [==============================] - 5s 22ms/step - loss: 0.4346 - accuracy: 0.8405 - val_loss: 0.3858 - val_accuracy: 0.8565 Epoch 6/8 211/211 [==============================] - 5s 22ms/step - loss: 0.3999 - accuracy: 0.8525 - val_loss: 0.3675 - val_accuracy: 0.8670 Epoch 7/8 211/211 [==============================] - 5s 22ms/step - loss: 0.3614 - accuracy: 0.8654 - val_loss: 0.3473 - val_accuracy: 0.8723 Epoch 8/8 211/211 [==============================] - 5s 22ms/step - loss: 0.3462 - accuracy: 0.8727 - val_loss: 0.4120 - val_accuracy: 0.8507 Trial 62 Complete [00h 00m 39s] val_accuracy: 0.8723333477973938 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 06m 08s Search: Running Trial #63 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 3 |2 |dense_depth 512 |512 |dense_width tanh |swish |activation l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.3 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate none |exponential |learning_rate_schedule 1024 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/53 [==>...........................] - ETA: 3s - loss: 5.8995 - accuracy: 0.2225WARNING:tensorflow:Callback method `on_train_batch_en53/53 [==============================] - 6s 81ms/step - loss: 1.9987 - accuracy: 0.5104 - val_loss: 3.7645 - val_accuracy: 0.1543 Epoch 2/8 53/53 [==============================] - 4s 73ms/step - loss: 0.7737 - accuracy: 0.7241 - val_loss: 3.4415 - val_accuracy: 0.1002 Epoch 3/8 53/53 [==============================] - 4s 76ms/step - loss: 0.6568 - accuracy: 0.7701 - val_loss: 2.8794 - val_accuracy: 0.2393 Epoch 4/8 53/53 [==============================] - 4s 78ms/step - loss: 0.5766 - accuracy: 0.7989 - val_loss: 1.7100 - val_accuracy: 0.5262 Epoch 5/8 53/53 [==============================] - 4s 73ms/step - loss: 0.5365 - accuracy: 0.8180 - val_loss: 2.0507 - val_accuracy: 0.4822 Epoch 6/8 53/53 [==============================] - 4s 78ms/step - loss: 0.4990 - accuracy: 0.8360 - val_loss: 1.5775 - val_accuracy: 0.5668 Epoch 7/8 53/53 [==============================] - 4s 78ms/step - loss: 0.4740 - accuracy: 0.8439 - val_loss: 0.7544 - val_accuracy: 0.7667 Epoch 8/8 53/53 [==============================] - 4s 77ms/step - loss: 0.4439 - accuracy: 0.8559 - val_loss: 0.6229 - val_accuracy: 0.7920 Trial 63 Complete [00h 00m 34s] val_accuracy: 0.7919999957084656 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 06m 42s Search: Running Trial #64 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 128 |128 |convolution_width 0 |2 |dense_depth 512 |512 |dense_width swish |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout adam |sgd |optimizer 0.001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 512 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 106/106 [==============================] - 1s 4ms/step - loss: 1.0513 - accuracy: 0.6661 - val_loss: 0.7377 - val_accuracy: 0.7542 Epoch 2/8 106/106 [==============================] - 0s 3ms/step - loss: 0.6624 - accuracy: 0.7856 - val_loss: 0.6256 - val_accuracy: 0.7935 Epoch 3/8 106/106 [==============================] - 0s 3ms/step - loss: 0.5840 - accuracy: 0.8093 - val_loss: 0.5781 - val_accuracy: 0.8000 Epoch 4/8 106/106 [==============================] - 0s 3ms/step - loss: 0.5447 - accuracy: 0.8205 - val_loss: 0.5451 - val_accuracy: 0.8152 Epoch 5/8 106/106 [==============================] - 0s 3ms/step - loss: 0.5195 - accuracy: 0.8291 - val_loss: 0.5253 - val_accuracy: 0.8245 Epoch 6/8 106/106 [==============================] - 0s 3ms/step - loss: 0.5020 - accuracy: 0.8335 - val_loss: 0.5130 - val_accuracy: 0.8272 Epoch 7/8 106/106 [==============================] - 0s 3ms/step - loss: 0.4889 - accuracy: 0.8380 - val_loss: 0.5014 - val_accuracy: 0.8328 Epoch 8/8 106/106 [==============================] - 0s 3ms/step - loss: 0.4786 - accuracy: 0.8406 - val_loss: 0.4930 - val_accuracy: 0.8373 Trial 64 Complete [00h 00m 03s] val_accuracy: 0.8373333215713501 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 06m 46s Search: Running Trial #65 Value |Best Value So Far |Hyperparameter 4 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.3 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 1024 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/53 [==>...........................] - ETA: 25s - loss: 4.1845 - accuracy: 0.1108WARNING:tensorflow:Callback method `on_train_batch_e53/53 [==============================] - 34s 602ms/step - loss: 2.8581 - accuracy: 0.2034 - val_loss: 2.5913 - val_accuracy: 0.1072 Epoch 2/8 53/53 [==============================] - 30s 569ms/step - loss: 1.9694 - accuracy: 0.4097 - val_loss: 2.6499 - val_accuracy: 0.1072 Epoch 3/8 53/53 [==============================] - 30s 567ms/step - loss: 1.6036 - accuracy: 0.5483 - val_loss: 2.8954 - val_accuracy: 0.1072 Epoch 4/8 53/53 [==============================] - 30s 568ms/step - loss: 1.3919 - accuracy: 0.6244 - val_loss: 3.1899 - val_accuracy: 0.0878 Epoch 5/8 53/53 [==============================] - 30s 568ms/step - loss: 1.2599 - accuracy: 0.6674 - val_loss: 3.4072 - val_accuracy: 0.0992 Epoch 6/8 53/53 [==============================] - 31s 576ms/step - loss: 1.1727 - accuracy: 0.6958 - val_loss: 3.4438 - val_accuracy: 0.1385 Epoch 7/8 53/53 [==============================] - 30s 571ms/step - loss: 1.1038 - accuracy: 0.7190 - val_loss: 3.3325 - val_accuracy: 0.1492 Epoch 8/8 53/53 [==============================] - 30s 571ms/step - loss: 1.0314 - accuracy: 0.7435 - val_loss: 2.9548 - val_accuracy: 0.1883 Trial 65 Complete [00h 04m 06s] val_accuracy: 0.18833333253860474 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 10m 52s Search: Running Trial #66 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 3 |2 |dense_depth 256 |512 |dense_width leaky |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 128 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 5/422 [..............................] - ETA: 21s - loss: 1.3666 - accuracy: 0.5250WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 23s 52ms/step - loss: 0.3764 - accuracy: 0.8670 - val_loss: 1.7391 - val_accuracy: 0.4435 Epoch 2/8 422/422 [==============================] - 24s 56ms/step - loss: 0.2250 - accuracy: 0.9179 - val_loss: 0.2660 - val_accuracy: 0.9062 Epoch 3/8 422/422 [==============================] - 24s 56ms/step - loss: 0.1672 - accuracy: 0.9394 - val_loss: 0.2392 - val_accuracy: 0.9118 Epoch 4/8 422/422 [==============================] - 24s 56ms/step - loss: 0.1250 - accuracy: 0.9541 - val_loss: 0.2252 - val_accuracy: 0.9205 Epoch 5/8 422/422 [==============================] - 22s 52ms/step - loss: 0.0887 - accuracy: 0.9670 - val_loss: 0.2410 - val_accuracy: 0.9200 Epoch 6/8 422/422 [==============================] - 22s 52ms/step - loss: 0.0620 - accuracy: 0.9784 - val_loss: 0.2498 - val_accuracy: 0.9183 Epoch 7/8 422/422 [==============================] - 22s 53ms/step - loss: 0.0449 - accuracy: 0.9836 - val_loss: 0.2853 - val_accuracy: 0.9170 Epoch 8/8 422/422 [==============================] - 22s 52ms/step - loss: 0.0279 - accuracy: 0.9909 - val_loss: 0.2962 - val_accuracy: 0.9185 Trial 66 Complete [00h 03m 03s] val_accuracy: 0.9204999804496765 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 13m 55s Search: Running Trial #67 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 256 |512 |dense_width leaky |swish |activation l2 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.4 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 512 |128 |batch_size 8 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/8 6/106 [>.............................] - ETA: 24s - loss: 5.0203 - accuracy: 0.3161WARNING:tensorflow:Callback method `on_train_batch106/106 [==============================] - 30s 265ms/step - loss: 1.1548 - accuracy: 0.7236 - val_loss: 3.0218 - val_accuracy: 0.1072 Epoch 2/8 106/106 [==============================] - 27s 254ms/step - loss: 0.5993 - accuracy: 0.8343 - val_loss: 4.6398 - val_accuracy: 0.1473 Epoch 3/8 106/106 [==============================] - 27s 253ms/step - loss: 0.5094 - accuracy: 0.8648 - val_loss: 4.4955 - val_accuracy: 0.1847 Epoch 4/8 106/106 [==============================] - 27s 256ms/step - loss: 0.4549 - accuracy: 0.8823 - val_loss: 3.6236 - val_accuracy: 0.3512 Epoch 5/8 106/106 [==============================] - 27s 254ms/step - loss: 0.4220 - accuracy: 0.8936 - val_loss: 1.6122 - val_accuracy: 0.6120 Epoch 6/8 106/106 [==============================] - 27s 253ms/step - loss: 0.3954 - accuracy: 0.9013 - val_loss: 0.8405 - val_accuracy: 0.7765 Epoch 7/8 106/106 [==============================] - 27s 254ms/step - loss: 0.3752 - accuracy: 0.9066 - val_loss: 0.4121 - val_accuracy: 0.8925 Epoch 8/8 106/106 [==============================] - 27s 252ms/step - loss: 0.3528 - accuracy: 0.9157 - val_loss: 0.3890 - val_accuracy: 0.8995 Trial 67 Complete [00h 03m 38s] val_accuracy: 0.8995000123977661 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 17m 33s Search: Running Trial #68 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width swish |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 22 |64 |tuner/epochs 8 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 1 |3 |tuner/round 0052 |0046 |tuner/trial_id Epoch 9/22 1688/1688 [==============================] - 49s 28ms/step - loss: 0.4145 - accuracy: 0.8492 - val_loss: 0.3445 - val_accuracy: 0.8795 Epoch 10/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.2797 - accuracy: 0.8986 - val_loss: 0.2644 - val_accuracy: 0.8980 Epoch 11/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.2446 - accuracy: 0.9109 - val_loss: 0.2746 - val_accuracy: 0.8980 Epoch 12/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.2170 - accuracy: 0.9212 - val_loss: 0.2207 - val_accuracy: 0.9187 Epoch 13/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1940 - accuracy: 0.9299 - val_loss: 0.2175 - val_accuracy: 0.9237 Epoch 14/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1721 - accuracy: 0.9389 - val_loss: 0.2099 - val_accuracy: 0.9253 Epoch 15/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1577 - accuracy: 0.9425 - val_loss: 0.2180 - val_accuracy: 0.9328 Epoch 16/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1414 - accuracy: 0.9484 - val_loss: 0.2063 - val_accuracy: 0.9292 Epoch 17/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1288 - accuracy: 0.9525 - val_loss: 0.2100 - val_accuracy: 0.9273 Epoch 18/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1130 - accuracy: 0.9592 - val_loss: 0.2616 - val_accuracy: 0.9203 Epoch 19/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1075 - accuracy: 0.9615 - val_loss: 0.2177 - val_accuracy: 0.9380 Epoch 20/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0974 - accuracy: 0.9651 - val_loss: 0.2247 - val_accuracy: 0.9323 Epoch 21/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0884 - accuracy: 0.9682 - val_loss: 0.2654 - val_accuracy: 0.9342 Epoch 22/22 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0799 - accuracy: 0.9709 - val_loss: 0.2817 - val_accuracy: 0.9272 Trial 68 Complete [00h 11m 02s] val_accuracy: 0.9380000233650208 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 28m 35s Search: Running Trial #69 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 3 |2 |dense_depth 256 |512 |dense_width leaky |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 128 |128 |batch_size 22 |64 |tuner/epochs 8 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 1 |3 |tuner/round 0065 |0046 |tuner/trial_id Epoch 9/22 6/422 [..............................] - ETA: 20s - loss: 1.4124 - accuracy: 0.5430WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 23s 53ms/step - loss: 0.3691 - accuracy: 0.8674 - val_loss: 1.4129 - val_accuracy: 0.5045 Epoch 10/22 422/422 [==============================] - 23s 53ms/step - loss: 0.2287 - accuracy: 0.9170 - val_loss: 0.2508 - val_accuracy: 0.9065 Epoch 11/22 422/422 [==============================] - 23s 53ms/step - loss: 0.1677 - accuracy: 0.9383 - val_loss: 0.2494 - val_accuracy: 0.9117 Epoch 12/22 422/422 [==============================] - 23s 53ms/step - loss: 0.1248 - accuracy: 0.9539 - val_loss: 0.2206 - val_accuracy: 0.9235 Epoch 13/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0865 - accuracy: 0.9685 - val_loss: 0.2403 - val_accuracy: 0.9212 Epoch 14/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0596 - accuracy: 0.9784 - val_loss: 0.2661 - val_accuracy: 0.9192 Epoch 15/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0433 - accuracy: 0.9852 - val_loss: 0.2648 - val_accuracy: 0.9228 Epoch 16/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0287 - accuracy: 0.9904 - val_loss: 0.3225 - val_accuracy: 0.9192 Epoch 17/22 422/422 [==============================] - 23s 53ms/step - loss: 0.0199 - accuracy: 0.9934 - val_loss: 0.2909 - val_accuracy: 0.9272 Epoch 18/22 422/422 [==============================] - 22s 53ms/step - loss: 0.0114 - accuracy: 0.9968 - val_loss: 0.3234 - val_accuracy: 0.9285 Epoch 19/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0078 - accuracy: 0.9981 - val_loss: 0.3303 - val_accuracy: 0.9272 Epoch 20/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0072 - accuracy: 0.9981 - val_loss: 0.3239 - val_accuracy: 0.9277 Epoch 21/22 422/422 [==============================] - 22s 53ms/step - loss: 0.0053 - accuracy: 0.9984 - val_loss: 0.3487 - val_accuracy: 0.9305 Epoch 22/22 422/422 [==============================] - 22s 52ms/step - loss: 0.0050 - accuracy: 0.9987 - val_loss: 0.3914 - val_accuracy: 0.9117 Trial 69 Complete [00h 05m 12s] val_accuracy: 0.9304999709129333 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 33m 47s Search: Running Trial #70 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 22 |64 |tuner/epochs 8 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 1 |3 |tuner/round 0055 |0046 |tuner/trial_id Epoch 9/22 1688/1688 [==============================] - 33s 19ms/step - loss: 2.9156 - accuracy: 0.7963 - val_loss: 1.9993 - val_accuracy: 0.8738 Epoch 10/22 1688/1688 [==============================] - 32s 19ms/step - loss: 1.7135 - accuracy: 0.8680 - val_loss: 1.4265 - val_accuracy: 0.8805 Epoch 11/22 1688/1688 [==============================] - 32s 19ms/step - loss: 1.3021 - accuracy: 0.8871 - val_loss: 1.1962 - val_accuracy: 0.8923 Epoch 12/22 1688/1688 [==============================] - 33s 19ms/step - loss: 1.1032 - accuracy: 0.9021 - val_loss: 1.0201 - val_accuracy: 0.9117 Epoch 13/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.9940 - accuracy: 0.9129 - val_loss: 0.9541 - val_accuracy: 0.9143 Epoch 14/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.9075 - accuracy: 0.9198 - val_loss: 0.8880 - val_accuracy: 0.9165 Epoch 15/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.8362 - accuracy: 0.9281 - val_loss: 0.8045 - val_accuracy: 0.9232 Epoch 16/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.7810 - accuracy: 0.9311 - val_loss: 0.8079 - val_accuracy: 0.9222 Epoch 17/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.7365 - accuracy: 0.9362 - val_loss: 0.7779 - val_accuracy: 0.9172 Epoch 18/22 1688/1688 [==============================] - 33s 19ms/step - loss: 0.6937 - accuracy: 0.9399 - val_loss: 0.7122 - val_accuracy: 0.9268 Epoch 19/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.6605 - accuracy: 0.9434 - val_loss: 0.7105 - val_accuracy: 0.9275 Epoch 20/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.6284 - accuracy: 0.9464 - val_loss: 0.6915 - val_accuracy: 0.9287 Epoch 21/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.6082 - accuracy: 0.9489 - val_loss: 0.6701 - val_accuracy: 0.9262 Epoch 22/22 1688/1688 [==============================] - 32s 19ms/step - loss: 0.5862 - accuracy: 0.9497 - val_loss: 0.6559 - val_accuracy: 0.9260 Trial 70 Complete [00h 07m 33s] val_accuracy: 0.9286666512489319 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 41m 20s Search: Running Trial #71 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 0 |2 |dense_depth 512 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 64 |128 |batch_size 22 |64 |tuner/epochs 8 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 1 |3 |tuner/round 0053 |0046 |tuner/trial_id Epoch 9/22 5/844 [..............................] - ETA: 27s - loss: 2.4698 - accuracy: 0.3281WARNING:tensorflow:Callback method `on_train_batch844/844 [==============================] - 23s 26ms/step - loss: 0.4716 - accuracy: 0.8537 - val_loss: 0.4072 - val_accuracy: 0.8667 Epoch 10/22 844/844 [==============================] - 21s 25ms/step - loss: 0.3300 - accuracy: 0.9002 - val_loss: 0.3720 - val_accuracy: 0.8898 Epoch 11/22 844/844 [==============================] - 21s 25ms/step - loss: 0.2873 - accuracy: 0.9142 - val_loss: 0.3728 - val_accuracy: 0.8933 Epoch 12/22 844/844 [==============================] - 21s 25ms/step - loss: 0.2425 - accuracy: 0.9269 - val_loss: 0.3775 - val_accuracy: 0.8917 Epoch 13/22 844/844 [==============================] - 21s 25ms/step - loss: 0.2151 - accuracy: 0.9377 - val_loss: 0.3128 - val_accuracy: 0.9078 Epoch 14/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1900 - accuracy: 0.9461 - val_loss: 0.3301 - val_accuracy: 0.9067 Epoch 15/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1720 - accuracy: 0.9518 - val_loss: 0.3703 - val_accuracy: 0.9043 Epoch 16/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1543 - accuracy: 0.9587 - val_loss: 0.3644 - val_accuracy: 0.9042 Epoch 17/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1366 - accuracy: 0.9640 - val_loss: 0.3474 - val_accuracy: 0.9103 Epoch 18/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1311 - accuracy: 0.9655 - val_loss: 0.3708 - val_accuracy: 0.9105 Epoch 19/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1133 - accuracy: 0.9723 - val_loss: 0.3778 - val_accuracy: 0.9102 Epoch 20/22 844/844 [==============================] - 21s 25ms/step - loss: 0.1044 - accuracy: 0.9758 - val_loss: 0.3804 - val_accuracy: 0.9110 Epoch 21/22 844/844 [==============================] - 21s 25ms/step - loss: 0.0944 - accuracy: 0.9795 - val_loss: 0.4694 - val_accuracy: 0.8970 Epoch 22/22 844/844 [==============================] - 21s 25ms/step - loss: 0.0856 - accuracy: 0.9812 - val_loss: 0.4294 - val_accuracy: 0.9075 Trial 71 Complete [00h 04m 55s] val_accuracy: 0.9110000133514404 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 46m 15s Search: Running Trial #72 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 1 |2 |dense_depth 256 |512 |dense_width sigmoid |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 512 |128 |batch_size 22 |64 |tuner/epochs 8 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 1 |3 |tuner/round 0060 |0046 |tuner/trial_id Epoch 9/22 6/106 [>.............................] - ETA: 11s - loss: 3.0125 - accuracy: 0.1976WARNING:tensorflow:Callback method `on_train_batch106/106 [==============================] - 14s 119ms/step - loss: 0.9598 - accuracy: 0.7332 - val_loss: 5.1191 - val_accuracy: 0.1137 Epoch 10/22 106/106 [==============================] - 12s 116ms/step - loss: 0.6090 - accuracy: 0.8470 - val_loss: 2.8007 - val_accuracy: 0.3622 Epoch 11/22 106/106 [==============================] - 12s 116ms/step - loss: 0.5443 - accuracy: 0.8729 - val_loss: 3.6001 - val_accuracy: 0.2082 Epoch 12/22 106/106 [==============================] - 12s 116ms/step - loss: 0.5134 - accuracy: 0.8846 - val_loss: 1.8794 - val_accuracy: 0.5208 Epoch 13/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4947 - accuracy: 0.8932 - val_loss: 0.6477 - val_accuracy: 0.8400 Epoch 14/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4915 - accuracy: 0.8974 - val_loss: 0.4765 - val_accuracy: 0.9050 Epoch 15/22 106/106 [==============================] - 12s 115ms/step - loss: 0.4828 - accuracy: 0.9017 - val_loss: 0.4732 - val_accuracy: 0.9012 Epoch 16/22 106/106 [==============================] - 12s 115ms/step - loss: 0.4703 - accuracy: 0.9063 - val_loss: 0.4787 - val_accuracy: 0.8938 Epoch 17/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4631 - accuracy: 0.9086 - val_loss: 0.4359 - val_accuracy: 0.9155 Epoch 18/22 106/106 [==============================] - 12s 115ms/step - loss: 0.4542 - accuracy: 0.9128 - val_loss: 0.4521 - val_accuracy: 0.9090 Epoch 19/22 106/106 [==============================] - 12s 115ms/step - loss: 0.4474 - accuracy: 0.9145 - val_loss: 0.4613 - val_accuracy: 0.9012 Epoch 20/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4413 - accuracy: 0.9163 - val_loss: 0.4350 - val_accuracy: 0.9177 Epoch 21/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4375 - accuracy: 0.9161 - val_loss: 0.4186 - val_accuracy: 0.9252 Epoch 22/22 106/106 [==============================] - 12s 116ms/step - loss: 0.4265 - accuracy: 0.9186 - val_loss: 0.4023 - val_accuracy: 0.9278 Trial 72 Complete [00h 02m 54s] val_accuracy: 0.9278333187103271 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 02h 49m 09s Search: Running Trial #73 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width swish |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 2 |3 |tuner/round 0067 |0046 |tuner/trial_id Epoch 23/64 1688/1688 [==============================] - 49s 28ms/step - loss: 0.4134 - accuracy: 0.8500 - val_loss: 0.3508 - val_accuracy: 0.8717 Epoch 24/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.2783 - accuracy: 0.8989 - val_loss: 0.2934 - val_accuracy: 0.8965 Epoch 25/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.2382 - accuracy: 0.9150 - val_loss: 0.2421 - val_accuracy: 0.9080 Epoch 26/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.2134 - accuracy: 0.9233 - val_loss: 0.2299 - val_accuracy: 0.9185 Epoch 27/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1905 - accuracy: 0.9296 - val_loss: 0.2484 - val_accuracy: 0.9170 Epoch 28/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1719 - accuracy: 0.9378 - val_loss: 0.2676 - val_accuracy: 0.9017 Epoch 29/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.1544 - accuracy: 0.9437 - val_loss: 0.2352 - val_accuracy: 0.9233 Epoch 30/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1377 - accuracy: 0.9494 - val_loss: 0.2147 - val_accuracy: 0.9253 Epoch 31/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.1259 - accuracy: 0.9543 - val_loss: 0.2146 - val_accuracy: 0.9290 Epoch 32/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.1102 - accuracy: 0.9592 - val_loss: 0.2043 - val_accuracy: 0.9298 Epoch 33/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0975 - accuracy: 0.9649 - val_loss: 0.2088 - val_accuracy: 0.9325 Epoch 34/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0924 - accuracy: 0.9676 - val_loss: 0.2273 - val_accuracy: 0.9317 Epoch 35/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0843 - accuracy: 0.9703 - val_loss: 0.2488 - val_accuracy: 0.9337 Epoch 36/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0755 - accuracy: 0.9728 - val_loss: 0.2533 - val_accuracy: 0.9285 Epoch 37/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0690 - accuracy: 0.9755 - val_loss: 0.2648 - val_accuracy: 0.9327 Epoch 38/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0605 - accuracy: 0.9787 - val_loss: 0.2982 - val_accuracy: 0.9273 Epoch 39/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0612 - accuracy: 0.9779 - val_loss: 0.2619 - val_accuracy: 0.9325 Epoch 40/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0513 - accuracy: 0.9817 - val_loss: 0.2692 - val_accuracy: 0.9352 Epoch 41/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0539 - accuracy: 0.9810 - val_loss: 0.2964 - val_accuracy: 0.9332 Epoch 42/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0457 - accuracy: 0.9845 - val_loss: 0.3122 - val_accuracy: 0.9323 Epoch 43/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0443 - accuracy: 0.9846 - val_loss: 0.3516 - val_accuracy: 0.9232 Epoch 44/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.0439 - accuracy: 0.9855 - val_loss: 0.2951 - val_accuracy: 0.9348 Epoch 45/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0387 - accuracy: 0.9867 - val_loss: 0.3037 - val_accuracy: 0.9365 Epoch 46/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0379 - accuracy: 0.9869 - val_loss: 0.3293 - val_accuracy: 0.9327 Epoch 47/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0350 - accuracy: 0.9885 - val_loss: 0.3187 - val_accuracy: 0.9318 Epoch 48/64 1688/1688 [==============================] - 48s 28ms/step - loss: 0.0378 - accuracy: 0.9877 - val_loss: 0.3152 - val_accuracy: 0.9305 Epoch 49/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0351 - accuracy: 0.9882 - val_loss: 0.3307 - val_accuracy: 0.9322 Epoch 50/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0321 - accuracy: 0.9894 - val_loss: 0.3251 - val_accuracy: 0.9340 Epoch 51/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0298 - accuracy: 0.9901 - val_loss: 0.3299 - val_accuracy: 0.9335 Epoch 52/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0341 - accuracy: 0.9889 - val_loss: 0.3500 - val_accuracy: 0.9350 Epoch 53/64 1688/1688 [==============================] - 47s 28ms/step - loss: 0.0268 - accuracy: 0.9907 - val_loss: 0.3514 - val_accuracy: 0.9333 Trial 73 Complete [00h 24m 29s] val_accuracy: 0.9365000128746033 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 13m 38s Search: Running Trial #74 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 128 |128 |convolution_width 3 |2 |dense_depth 256 |512 |dense_width leaky |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 128 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 2 |3 |tuner/bracket 2 |3 |tuner/round 0068 |0046 |tuner/trial_id Epoch 23/64 6/422 [..............................] - ETA: 21s - loss: 1.3478 - accuracy: 0.5391WARNING:tensorflow:Callback method `on_train_batch422/422 [==============================] - 23s 53ms/step - loss: 0.3718 - accuracy: 0.8662 - val_loss: 1.2494 - val_accuracy: 0.5472 Epoch 24/64 422/422 [==============================] - 22s 53ms/step - loss: 0.2307 - accuracy: 0.9148 - val_loss: 0.2575 - val_accuracy: 0.9078 Epoch 25/64 422/422 [==============================] - 22s 53ms/step - loss: 0.1738 - accuracy: 0.9357 - val_loss: 0.2417 - val_accuracy: 0.9138 Epoch 26/64 422/422 [==============================] - 23s 54ms/step - loss: 0.1328 - accuracy: 0.9517 - val_loss: 0.2272 - val_accuracy: 0.9205 Epoch 27/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0930 - accuracy: 0.9667 - val_loss: 0.2506 - val_accuracy: 0.9187 Epoch 28/64 422/422 [==============================] - 23s 53ms/step - loss: 0.0689 - accuracy: 0.9753 - val_loss: 0.2341 - val_accuracy: 0.9262 Epoch 29/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0503 - accuracy: 0.9826 - val_loss: 0.2741 - val_accuracy: 0.9187 Epoch 30/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0333 - accuracy: 0.9889 - val_loss: 0.2732 - val_accuracy: 0.9248 Epoch 31/64 422/422 [==============================] - 22s 53ms/step - loss: 0.0206 - accuracy: 0.9940 - val_loss: 0.2867 - val_accuracy: 0.9298 Epoch 32/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0128 - accuracy: 0.9966 - val_loss: 0.3138 - val_accuracy: 0.9262 Epoch 33/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0113 - accuracy: 0.9967 - val_loss: 0.3317 - val_accuracy: 0.9235 Epoch 34/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0138 - accuracy: 0.9958 - val_loss: 0.3187 - val_accuracy: 0.9263 Epoch 35/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0064 - accuracy: 0.9984 - val_loss: 0.3557 - val_accuracy: 0.9282 Epoch 36/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0065 - accuracy: 0.9981 - val_loss: 0.3617 - val_accuracy: 0.9260 Epoch 37/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0034 - accuracy: 0.9994 - val_loss: 0.3595 - val_accuracy: 0.9307 Epoch 38/64 422/422 [==============================] - 22s 52ms/step - loss: 0.0011 - accuracy: 0.9999 - val_loss: 0.3765 - val_accuracy: 0.9302 Epoch 39/64 422/422 [==============================] - 23s 54ms/step - loss: 3.7316e-04 - accuracy: 1.0000 - val_loss: 0.3686 - val_accuracy: 0.9312 Epoch 40/64 422/422 [==============================] - 22s 53ms/step - loss: 2.0692e-04 - accuracy: 1.0000 - val_loss: 0.3799 - val_accuracy: 0.9325 Epoch 41/64 422/422 [==============================] - 22s 52ms/step - loss: 1.6133e-04 - accuracy: 1.0000 - val_loss: 0.3857 - val_accuracy: 0.9320 Epoch 42/64 422/422 [==============================] - 22s 52ms/step - loss: 1.3288e-04 - accuracy: 1.0000 - val_loss: 0.3933 - val_accuracy: 0.9312 Epoch 43/64 422/422 [==============================] - 22s 52ms/step - loss: 1.1046e-04 - accuracy: 1.0000 - val_loss: 0.3985 - val_accuracy: 0.9315 Epoch 44/64 422/422 [==============================] - 22s 52ms/step - loss: 9.3246e-05 - accuracy: 1.0000 - val_loss: 0.4071 - val_accuracy: 0.9317 Epoch 45/64 422/422 [==============================] - 22s 52ms/step - loss: 7.7394e-05 - accuracy: 1.0000 - val_loss: 0.4096 - val_accuracy: 0.9323 Epoch 46/64 422/422 [==============================] - 22s 52ms/step - loss: 6.4711e-05 - accuracy: 1.0000 - val_loss: 0.4172 - val_accuracy: 0.9307 Epoch 47/64 422/422 [==============================] - 22s 52ms/step - loss: 5.6115e-05 - accuracy: 1.0000 - val_loss: 0.4272 - val_accuracy: 0.9308 Epoch 48/64 422/422 [==============================] - 22s 52ms/step - loss: 4.6750e-05 - accuracy: 1.0000 - val_loss: 0.4316 - val_accuracy: 0.9310 Trial 74 Complete [00h 09m 36s] val_accuracy: 0.9325000047683716 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 23m 14s Search: Running Trial #75 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 128 |128 |convolution_width 4 |2 |dense_depth 512 |512 |dense_width tanh |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.5 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 64 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 5/844 [..............................] - ETA: 36s - loss: 5.5593 - accuracy: 0.0812WARNING:tensorflow:Callback method `on_train_batch844/844 [==============================] - 39s 45ms/step - loss: 2.8983 - accuracy: 0.1000 - val_loss: 2.7131 - val_accuracy: 0.1072 Epoch 2/22 844/844 [==============================] - 38s 44ms/step - loss: 2.7960 - accuracy: 0.0996 - val_loss: 2.5708 - val_accuracy: 0.1015 Epoch 3/22 844/844 [==============================] - 37s 44ms/step - loss: 2.7739 - accuracy: 0.0997 - val_loss: 2.6356 - val_accuracy: 0.1015 Epoch 4/22 844/844 [==============================] - 38s 45ms/step - loss: 2.7515 - accuracy: 0.1019 - val_loss: 2.5461 - val_accuracy: 0.1015 Epoch 5/22 844/844 [==============================] - 38s 45ms/step - loss: 2.7387 - accuracy: 0.0984 - val_loss: 2.4546 - val_accuracy: 0.0997 Epoch 6/22 844/844 [==============================] - 38s 45ms/step - loss: 2.7168 - accuracy: 0.1009 - val_loss: 2.6122 - val_accuracy: 0.0968 Epoch 7/22 844/844 [==============================] - 38s 45ms/step - loss: 2.6972 - accuracy: 0.1028 - val_loss: 2.4755 - val_accuracy: 0.0997 Epoch 8/22 844/844 [==============================] - 37s 44ms/step - loss: 2.6844 - accuracy: 0.1003 - val_loss: 2.5447 - val_accuracy: 0.1033 Epoch 9/22 844/844 [==============================] - 37s 44ms/step - loss: 2.6638 - accuracy: 0.0974 - val_loss: 2.5464 - val_accuracy: 0.1007 Trial 75 Complete [00h 05m 40s] val_accuracy: 0.10716667026281357 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 28m 54s Search: Running Trial #76 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 64 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width swish |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 256 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 211/211 [==============================] - 2s 4ms/step - loss: 0.6908 - accuracy: 0.7571 - val_loss: 0.5042 - val_accuracy: 0.8208 Epoch 2/22 211/211 [==============================] - 1s 3ms/step - loss: 0.4739 - accuracy: 0.8274 - val_loss: 0.4205 - val_accuracy: 0.8475 Epoch 3/22 211/211 [==============================] - 1s 4ms/step - loss: 0.3970 - accuracy: 0.8554 - val_loss: 0.3859 - val_accuracy: 0.8613 Epoch 4/22 211/211 [==============================] - 1s 3ms/step - loss: 0.3889 - accuracy: 0.8570 - val_loss: 0.3808 - val_accuracy: 0.8625 Epoch 5/22 211/211 [==============================] - 1s 3ms/step - loss: 0.3582 - accuracy: 0.8698 - val_loss: 0.3576 - val_accuracy: 0.8705 Epoch 6/22 211/211 [==============================] - 1s 4ms/step - loss: 0.3308 - accuracy: 0.8772 - val_loss: 0.3346 - val_accuracy: 0.8803 Epoch 7/22 211/211 [==============================] - 1s 4ms/step - loss: 0.3117 - accuracy: 0.8855 - val_loss: 0.3308 - val_accuracy: 0.8818 Epoch 8/22 211/211 [==============================] - 1s 3ms/step - loss: 0.3075 - accuracy: 0.8859 - val_loss: 0.3423 - val_accuracy: 0.8802 Epoch 9/22 211/211 [==============================] - 1s 3ms/step - loss: 0.3264 - accuracy: 0.8789 - val_loss: 0.3366 - val_accuracy: 0.8767 Epoch 10/22 211/211 [==============================] - 1s 4ms/step - loss: 0.3070 - accuracy: 0.8855 - val_loss: 0.3215 - val_accuracy: 0.8822 Epoch 11/22 211/211 [==============================] - 1s 4ms/step - loss: 0.2921 - accuracy: 0.8912 - val_loss: 0.3266 - val_accuracy: 0.8835 Epoch 12/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2777 - accuracy: 0.8952 - val_loss: 0.3106 - val_accuracy: 0.8927 Epoch 13/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2665 - accuracy: 0.9005 - val_loss: 0.3081 - val_accuracy: 0.8922 Epoch 14/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2555 - accuracy: 0.9051 - val_loss: 0.3039 - val_accuracy: 0.8915 Epoch 15/22 211/211 [==============================] - 1s 4ms/step - loss: 0.2464 - accuracy: 0.9064 - val_loss: 0.2998 - val_accuracy: 0.8938 Epoch 16/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2437 - accuracy: 0.9088 - val_loss: 0.2982 - val_accuracy: 0.8957 Epoch 17/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2475 - accuracy: 0.9061 - val_loss: 0.3483 - val_accuracy: 0.8808 Epoch 18/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2716 - accuracy: 0.8983 - val_loss: 0.3073 - val_accuracy: 0.8910 Epoch 19/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2601 - accuracy: 0.9010 - val_loss: 0.3169 - val_accuracy: 0.8875 Epoch 20/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2540 - accuracy: 0.9047 - val_loss: 0.3022 - val_accuracy: 0.8935 Epoch 21/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2424 - accuracy: 0.9076 - val_loss: 0.3057 - val_accuracy: 0.8918 Epoch 22/22 211/211 [==============================] - 1s 3ms/step - loss: 0.2364 - accuracy: 0.9115 - val_loss: 0.3118 - val_accuracy: 0.8910 Trial 76 Complete [00h 00m 17s] val_accuracy: 0.8956666588783264 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 29m 11s Search: Running Trial #77 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 128 |128 |convolution_width 1 |2 |dense_depth 512 |512 |dense_width sigmoid |swish |activation none |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.4 |0.2 |dropout sgd |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 512 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 106/106 [==============================] - 1s 6ms/step - loss: 0.8632 - accuracy: 0.6992 - val_loss: 0.5769 - val_accuracy: 0.7960 Epoch 2/22 106/106 [==============================] - 0s 4ms/step - loss: 0.5515 - accuracy: 0.8043 - val_loss: 0.4982 - val_accuracy: 0.8250 Epoch 3/22 106/106 [==============================] - 0s 4ms/step - loss: 0.4926 - accuracy: 0.8225 - val_loss: 0.4632 - val_accuracy: 0.8372 Epoch 4/22 106/106 [==============================] - 0s 4ms/step - loss: 0.4606 - accuracy: 0.8357 - val_loss: 0.4479 - val_accuracy: 0.8427 Epoch 5/22 106/106 [==============================] - 0s 4ms/step - loss: 0.4379 - accuracy: 0.8429 - val_loss: 0.4268 - val_accuracy: 0.8508 Epoch 6/22 106/106 [==============================] - 0s 4ms/step - loss: 0.4231 - accuracy: 0.8463 - val_loss: 0.4188 - val_accuracy: 0.8535 Epoch 7/22 106/106 [==============================] - 0s 4ms/step - loss: 0.4099 - accuracy: 0.8517 - val_loss: 0.4060 - val_accuracy: 0.8547 Epoch 8/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3976 - accuracy: 0.8550 - val_loss: 0.3942 - val_accuracy: 0.8592 Epoch 9/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3874 - accuracy: 0.8601 - val_loss: 0.3864 - val_accuracy: 0.8605 Epoch 10/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3803 - accuracy: 0.8638 - val_loss: 0.3860 - val_accuracy: 0.8637 Epoch 11/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3712 - accuracy: 0.8664 - val_loss: 0.3799 - val_accuracy: 0.8663 Epoch 12/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3658 - accuracy: 0.8679 - val_loss: 0.3723 - val_accuracy: 0.8672 Epoch 13/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3595 - accuracy: 0.8707 - val_loss: 0.3647 - val_accuracy: 0.8677 Epoch 14/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3524 - accuracy: 0.8722 - val_loss: 0.3621 - val_accuracy: 0.8710 Epoch 15/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3477 - accuracy: 0.8739 - val_loss: 0.3573 - val_accuracy: 0.8705 Epoch 16/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3404 - accuracy: 0.8755 - val_loss: 0.3542 - val_accuracy: 0.8733 Epoch 17/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3354 - accuracy: 0.8785 - val_loss: 0.3470 - val_accuracy: 0.8772 Epoch 18/22 106/106 [==============================] - 0s 5ms/step - loss: 0.3312 - accuracy: 0.8797 - val_loss: 0.3432 - val_accuracy: 0.8787 Epoch 19/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3259 - accuracy: 0.8825 - val_loss: 0.3416 - val_accuracy: 0.8802 Epoch 20/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3220 - accuracy: 0.8818 - val_loss: 0.3366 - val_accuracy: 0.8813 Epoch 21/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3169 - accuracy: 0.8840 - val_loss: 0.3331 - val_accuracy: 0.8827 Epoch 22/22 106/106 [==============================] - 0s 4ms/step - loss: 0.3136 - accuracy: 0.8854 - val_loss: 0.3408 - val_accuracy: 0.8773 Trial 77 Complete [00h 00m 11s] val_accuracy: 0.8826666474342346 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 29m 23s Search: Running Trial #78 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 3 |2 |dense_depth 64 |512 |dense_width leaky |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 512 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 6/106 [>.............................] - ETA: 4s - loss: 2.4375 - accuracy: 0.2041WARNING:tensorflow:Callback method `on_train_batch_106/106 [==============================] - 6s 43ms/step - loss: 0.9522 - accuracy: 0.6632 - val_loss: 2.2612 - val_accuracy: 0.1005 Epoch 2/22 106/106 [==============================] - 4s 38ms/step - loss: 0.5334 - accuracy: 0.8139 - val_loss: 1.7158 - val_accuracy: 0.4870 Epoch 3/22 106/106 [==============================] - 4s 38ms/step - loss: 0.4461 - accuracy: 0.8486 - val_loss: 1.5500 - val_accuracy: 0.4487 Epoch 4/22 106/106 [==============================] - 4s 38ms/step - loss: 0.4010 - accuracy: 0.8650 - val_loss: 1.2452 - val_accuracy: 0.5890 Epoch 5/22 106/106 [==============================] - 4s 38ms/step - loss: 0.3796 - accuracy: 0.8710 - val_loss: 0.8289 - val_accuracy: 0.7100 Epoch 6/22 106/106 [==============================] - 4s 38ms/step - loss: 0.3547 - accuracy: 0.8806 - val_loss: 0.4209 - val_accuracy: 0.8558 Epoch 7/22 106/106 [==============================] - 4s 39ms/step - loss: 0.3336 - accuracy: 0.8891 - val_loss: 0.3211 - val_accuracy: 0.8917 Epoch 8/22 106/106 [==============================] - 4s 38ms/step - loss: 0.3255 - accuracy: 0.8923 - val_loss: 0.3126 - val_accuracy: 0.8962 Epoch 9/22 106/106 [==============================] - 4s 38ms/step - loss: 0.3110 - accuracy: 0.8956 - val_loss: 0.2864 - val_accuracy: 0.9032 Epoch 10/22 106/106 [==============================] - 4s 37ms/step - loss: 0.3019 - accuracy: 0.8992 - val_loss: 0.2881 - val_accuracy: 0.8993 Epoch 11/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2941 - accuracy: 0.9027 - val_loss: 0.3030 - val_accuracy: 0.8927 Epoch 12/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2897 - accuracy: 0.9048 - val_loss: 0.2721 - val_accuracy: 0.9108 Epoch 13/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2846 - accuracy: 0.9052 - val_loss: 0.2861 - val_accuracy: 0.9018 Epoch 14/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2763 - accuracy: 0.9084 - val_loss: 0.2610 - val_accuracy: 0.9148 Epoch 15/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2703 - accuracy: 0.9120 - val_loss: 0.2655 - val_accuracy: 0.9095 Epoch 16/22 106/106 [==============================] - 4s 39ms/step - loss: 0.2674 - accuracy: 0.9118 - val_loss: 0.2696 - val_accuracy: 0.9092 Epoch 17/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2638 - accuracy: 0.9131 - val_loss: 0.2527 - val_accuracy: 0.9140 Epoch 18/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2580 - accuracy: 0.9176 - val_loss: 0.2520 - val_accuracy: 0.9150 Epoch 19/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2563 - accuracy: 0.9160 - val_loss: 0.2545 - val_accuracy: 0.9138 Epoch 20/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2536 - accuracy: 0.9166 - val_loss: 0.2540 - val_accuracy: 0.9153 Epoch 21/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2485 - accuracy: 0.9179 - val_loss: 0.2532 - val_accuracy: 0.9140 Epoch 22/22 106/106 [==============================] - 4s 38ms/step - loss: 0.2481 - accuracy: 0.9198 - val_loss: 0.2495 - val_accuracy: 0.9138 Trial 78 Complete [00h 01m 32s] val_accuracy: 0.9153333306312561 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 30m 54s Search: Running Trial #79 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 64 |128 |convolution_width 1 |2 |dense_depth 64 |512 |dense_width elu |swish |activation l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 1688/1688 [==============================] - 16s 9ms/step - loss: 1.1549 - accuracy: 0.6231 - val_loss: 0.5485 - val_accuracy: 0.8235 Epoch 2/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5691 - accuracy: 0.8197 - val_loss: 0.5036 - val_accuracy: 0.8605 Epoch 3/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6086 - accuracy: 0.8364 - val_loss: 0.5548 - val_accuracy: 0.8688 Epoch 4/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6245 - accuracy: 0.8478 - val_loss: 0.6162 - val_accuracy: 0.8590 Epoch 5/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6485 - accuracy: 0.8519 - val_loss: 0.6657 - val_accuracy: 0.8637 Epoch 6/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6572 - accuracy: 0.8549 - val_loss: 0.5750 - val_accuracy: 0.8675 Epoch 7/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6115 - accuracy: 0.8618 - val_loss: 0.5574 - val_accuracy: 0.8790 Epoch 8/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6635 - accuracy: 0.8566 - val_loss: 0.6580 - val_accuracy: 0.8357 Epoch 9/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6253 - accuracy: 0.8630 - val_loss: 0.5677 - val_accuracy: 0.8798 Epoch 10/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6309 - accuracy: 0.8651 - val_loss: 0.5827 - val_accuracy: 0.8667 Epoch 11/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6050 - accuracy: 0.8681 - val_loss: 0.7054 - val_accuracy: 0.8575 Epoch 12/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6001 - accuracy: 0.8675 - val_loss: 0.5526 - val_accuracy: 0.8928 Epoch 13/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6091 - accuracy: 0.8668 - val_loss: 0.5349 - val_accuracy: 0.8822 Epoch 14/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6277 - accuracy: 0.8672 - val_loss: 0.5604 - val_accuracy: 0.8828 Epoch 15/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5895 - accuracy: 0.8722 - val_loss: 0.5125 - val_accuracy: 0.8997 Epoch 16/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6249 - accuracy: 0.8687 - val_loss: 0.5928 - val_accuracy: 0.8528 Epoch 17/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5813 - accuracy: 0.8750 - val_loss: 0.6313 - val_accuracy: 0.8377 Epoch 18/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6014 - accuracy: 0.8710 - val_loss: 0.5081 - val_accuracy: 0.8933 Epoch 19/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5984 - accuracy: 0.8730 - val_loss: 0.6622 - val_accuracy: 0.8832 Epoch 20/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5757 - accuracy: 0.8772 - val_loss: 0.5009 - val_accuracy: 0.8912 Epoch 21/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6133 - accuracy: 0.8723 - val_loss: 0.5002 - val_accuracy: 0.8912 Epoch 22/22 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5937 - accuracy: 0.8736 - val_loss: 0.5068 - val_accuracy: 0.8982 Trial 79 Complete [00h 05m 37s] val_accuracy: 0.8996666669845581 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 36m 31s Search: Running Trial #80 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 0 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 32 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 1688/1688 [==============================] - 12s 6ms/step - loss: 0.4143 - accuracy: 0.8524 - val_loss: 0.2861 - val_accuracy: 0.8990 Epoch 2/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.3396 - accuracy: 0.8827 - val_loss: 0.3199 - val_accuracy: 0.8898 Epoch 3/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2681 - accuracy: 0.9105 - val_loss: 0.2491 - val_accuracy: 0.9157 Epoch 4/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2843 - accuracy: 0.9049 - val_loss: 0.3420 - val_accuracy: 0.8913 Epoch 5/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2906 - accuracy: 0.9075 - val_loss: 0.3081 - val_accuracy: 0.8977 Epoch 6/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2566 - accuracy: 0.9212 - val_loss: 0.2609 - val_accuracy: 0.9177 Epoch 7/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2189 - accuracy: 0.9340 - val_loss: 0.2455 - val_accuracy: 0.9245 Epoch 8/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2114 - accuracy: 0.9355 - val_loss: 0.3086 - val_accuracy: 0.9042 Epoch 9/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2797 - accuracy: 0.9144 - val_loss: 0.3161 - val_accuracy: 0.8998 Epoch 10/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2688 - accuracy: 0.9186 - val_loss: 0.3093 - val_accuracy: 0.9123 Epoch 11/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2575 - accuracy: 0.9237 - val_loss: 0.2754 - val_accuracy: 0.9152 Epoch 12/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2410 - accuracy: 0.9311 - val_loss: 0.2640 - val_accuracy: 0.9230 Epoch 13/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2216 - accuracy: 0.9368 - val_loss: 0.2536 - val_accuracy: 0.9283 Epoch 14/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1987 - accuracy: 0.9456 - val_loss: 0.2506 - val_accuracy: 0.9282 Epoch 15/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1767 - accuracy: 0.9537 - val_loss: 0.2556 - val_accuracy: 0.9295 Epoch 16/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1601 - accuracy: 0.9605 - val_loss: 0.2621 - val_accuracy: 0.9290 Epoch 17/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1864 - accuracy: 0.9510 - val_loss: 0.3491 - val_accuracy: 0.8982 Epoch 18/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2556 - accuracy: 0.9254 - val_loss: 0.2828 - val_accuracy: 0.9197 Epoch 19/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2540 - accuracy: 0.9270 - val_loss: 0.3181 - val_accuracy: 0.9113 Epoch 20/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2506 - accuracy: 0.9303 - val_loss: 0.3059 - val_accuracy: 0.9157 Epoch 21/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2469 - accuracy: 0.9316 - val_loss: 0.3049 - val_accuracy: 0.9123 Epoch 22/22 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2407 - accuracy: 0.9342 - val_loss: 0.3026 - val_accuracy: 0.9142 Trial 80 Complete [00h 03m 56s] val_accuracy: 0.9294999837875366 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 40m 26s Search: Running Trial #81 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 64 |128 |convolution_width 4 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.3 |0.2 |dropout adam |sgd |optimizer 0.0001 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 1688/1688 [==============================] - 6s 3ms/step - loss: 1.8535 - accuracy: 0.4258 - val_loss: 1.1019 - val_accuracy: 0.6825 Epoch 2/22 1688/1688 [==============================] - 5s 3ms/step - loss: 1.2337 - accuracy: 0.6434 - val_loss: 0.9487 - val_accuracy: 0.7478 Epoch 3/22 1688/1688 [==============================] - 5s 3ms/step - loss: 1.0528 - accuracy: 0.7137 - val_loss: 0.8380 - val_accuracy: 0.7827 Epoch 4/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.9477 - accuracy: 0.7571 - val_loss: 0.7800 - val_accuracy: 0.8170 Epoch 5/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8820 - accuracy: 0.7812 - val_loss: 0.7430 - val_accuracy: 0.8257 Epoch 6/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8367 - accuracy: 0.7995 - val_loss: 0.7287 - val_accuracy: 0.8338 Epoch 7/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8013 - accuracy: 0.8112 - val_loss: 0.7031 - val_accuracy: 0.8392 Epoch 8/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7817 - accuracy: 0.8176 - val_loss: 0.6799 - val_accuracy: 0.8452 Epoch 9/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7597 - accuracy: 0.8238 - val_loss: 0.6602 - val_accuracy: 0.8550 Epoch 10/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7384 - accuracy: 0.8300 - val_loss: 0.6614 - val_accuracy: 0.8527 Epoch 11/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7247 - accuracy: 0.8337 - val_loss: 0.6455 - val_accuracy: 0.8570 Epoch 12/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7079 - accuracy: 0.8378 - val_loss: 0.6330 - val_accuracy: 0.8585 Epoch 13/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6949 - accuracy: 0.8416 - val_loss: 0.6300 - val_accuracy: 0.8597 Epoch 14/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6838 - accuracy: 0.8434 - val_loss: 0.6209 - val_accuracy: 0.8603 Epoch 15/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6782 - accuracy: 0.8430 - val_loss: 0.6097 - val_accuracy: 0.8655 Epoch 16/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6614 - accuracy: 0.8481 - val_loss: 0.6005 - val_accuracy: 0.8673 Epoch 17/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6585 - accuracy: 0.8492 - val_loss: 0.6133 - val_accuracy: 0.8613 Epoch 18/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6513 - accuracy: 0.8495 - val_loss: 0.5928 - val_accuracy: 0.8678 Epoch 19/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6425 - accuracy: 0.8528 - val_loss: 0.5875 - val_accuracy: 0.8688 Epoch 20/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6359 - accuracy: 0.8549 - val_loss: 0.5900 - val_accuracy: 0.8663 Epoch 21/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6294 - accuracy: 0.8545 - val_loss: 0.5824 - val_accuracy: 0.8693 Epoch 22/22 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6273 - accuracy: 0.8550 - val_loss: 0.5852 - val_accuracy: 0.8657 Trial 81 Complete [00h 01m 56s] val_accuracy: 0.8693333268165588 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 42m 22s Search: Running Trial #82 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 32 |128 |convolution_width 1 |2 |dense_depth 128 |512 |dense_width sigmoid |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 22 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/22 6/53 [==>...........................] - ETA: 5s - loss: 3.0168 - accuracy: 0.1185WARNING:tensorflow:Callback method `on_train_batch_en53/53 [==============================] - 9s 132ms/step - loss: 2.5548 - accuracy: 0.2824 - val_loss: 2.8553 - val_accuracy: 0.1033 Epoch 2/22 53/53 [==============================] - 6s 119ms/step - loss: 2.0493 - accuracy: 0.5430 - val_loss: 2.7612 - val_accuracy: 0.1038 Epoch 3/22 53/53 [==============================] - 6s 119ms/step - loss: 1.6674 - accuracy: 0.6746 - val_loss: 2.6481 - val_accuracy: 0.2035 Epoch 4/22 53/53 [==============================] - 6s 119ms/step - loss: 1.5474 - accuracy: 0.7013 - val_loss: 2.4585 - val_accuracy: 0.4585 Epoch 5/22 53/53 [==============================] - 6s 120ms/step - loss: 1.3344 - accuracy: 0.7427 - val_loss: 2.2351 - val_accuracy: 0.5147 Epoch 6/22 53/53 [==============================] - 6s 120ms/step - loss: 1.2330 - accuracy: 0.7628 - val_loss: 2.0209 - val_accuracy: 0.5538 Epoch 7/22 53/53 [==============================] - 6s 120ms/step - loss: 1.1930 - accuracy: 0.7712 - val_loss: 1.8163 - val_accuracy: 0.5962 Epoch 8/22 53/53 [==============================] - 6s 119ms/step - loss: 1.1816 - accuracy: 0.7745 - val_loss: 1.6144 - val_accuracy: 0.6577 Epoch 9/22 53/53 [==============================] - 6s 119ms/step - loss: 1.1226 - accuracy: 0.7874 - val_loss: 1.3413 - val_accuracy: 0.7333 Epoch 10/22 53/53 [==============================] - 6s 120ms/step - loss: 1.0606 - accuracy: 0.8027 - val_loss: 1.1715 - val_accuracy: 0.7792 Epoch 11/22 53/53 [==============================] - 6s 120ms/step - loss: 1.0132 - accuracy: 0.8149 - val_loss: 1.0638 - val_accuracy: 0.8087 Epoch 12/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9847 - accuracy: 0.8233 - val_loss: 0.9851 - val_accuracy: 0.8250 Epoch 13/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9612 - accuracy: 0.8296 - val_loss: 0.9436 - val_accuracy: 0.8350 Epoch 14/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9481 - accuracy: 0.8344 - val_loss: 0.9220 - val_accuracy: 0.8388 Epoch 15/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9404 - accuracy: 0.8358 - val_loss: 0.9096 - val_accuracy: 0.8408 Epoch 16/22 53/53 [==============================] - 6s 121ms/step - loss: 0.9383 - accuracy: 0.8371 - val_loss: 0.9039 - val_accuracy: 0.8422 Epoch 17/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9344 - accuracy: 0.8380 - val_loss: 0.8986 - val_accuracy: 0.8427 Epoch 18/22 53/53 [==============================] - 6s 120ms/step - loss: 0.9132 - accuracy: 0.8435 - val_loss: 0.8662 - val_accuracy: 0.8522 Epoch 19/22 53/53 [==============================] - 6s 120ms/step - loss: 0.8844 - accuracy: 0.8505 - val_loss: 0.8415 - val_accuracy: 0.8592 Epoch 20/22 53/53 [==============================] - 6s 120ms/step - loss: 0.8612 - accuracy: 0.8574 - val_loss: 0.8293 - val_accuracy: 0.8653 Epoch 21/22 53/53 [==============================] - 6s 119ms/step - loss: 0.8424 - accuracy: 0.8638 - val_loss: 0.8270 - val_accuracy: 0.8645 Epoch 22/22 53/53 [==============================] - 6s 120ms/step - loss: 0.8244 - accuracy: 0.8683 - val_loss: 0.7936 - val_accuracy: 0.8775 Trial 82 Complete [00h 02m 22s] val_accuracy: 0.8774999976158142 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 44m 44s Search: Running Trial #83 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 0 |2 |dense_depth 64 |512 |dense_width relu |swish |activation l1 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 32 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 1 |3 |tuner/round 0079 |0046 |tuner/trial_id Epoch 23/64 1688/1688 [==============================] - 13s 7ms/step - loss: 0.4184 - accuracy: 0.8545 - val_loss: 0.2876 - val_accuracy: 0.8977 Epoch 24/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.3431 - accuracy: 0.8818 - val_loss: 0.3363 - val_accuracy: 0.8837 Epoch 25/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2676 - accuracy: 0.9097 - val_loss: 0.2521 - val_accuracy: 0.9153 Epoch 26/64 1688/1688 [==============================] - 11s 7ms/step - loss: 0.2894 - accuracy: 0.9031 - val_loss: 0.3658 - val_accuracy: 0.8790 Epoch 27/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2924 - accuracy: 0.9048 - val_loss: 0.2953 - val_accuracy: 0.9085 Epoch 28/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2592 - accuracy: 0.9177 - val_loss: 0.2803 - val_accuracy: 0.9112 Epoch 29/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2173 - accuracy: 0.9352 - val_loss: 0.2465 - val_accuracy: 0.9240 Epoch 30/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2108 - accuracy: 0.9380 - val_loss: 0.3221 - val_accuracy: 0.8970 Epoch 31/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2834 - accuracy: 0.9117 - val_loss: 0.3382 - val_accuracy: 0.8947 Epoch 32/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2751 - accuracy: 0.9160 - val_loss: 0.2968 - val_accuracy: 0.9098 Epoch 33/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2598 - accuracy: 0.9224 - val_loss: 0.2847 - val_accuracy: 0.9153 Epoch 34/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2426 - accuracy: 0.9299 - val_loss: 0.2691 - val_accuracy: 0.9208 Epoch 35/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2211 - accuracy: 0.9377 - val_loss: 0.2663 - val_accuracy: 0.9210 Epoch 36/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1990 - accuracy: 0.9466 - val_loss: 0.2692 - val_accuracy: 0.9227 Epoch 37/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1779 - accuracy: 0.9539 - val_loss: 0.2622 - val_accuracy: 0.9277 Epoch 38/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1613 - accuracy: 0.9606 - val_loss: 0.2638 - val_accuracy: 0.9267 Epoch 39/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.1900 - accuracy: 0.9499 - val_loss: 0.3051 - val_accuracy: 0.9093 Epoch 40/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2586 - accuracy: 0.9247 - val_loss: 0.3035 - val_accuracy: 0.9100 Epoch 41/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2559 - accuracy: 0.9273 - val_loss: 0.3004 - val_accuracy: 0.9117 Epoch 42/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2519 - accuracy: 0.9291 - val_loss: 0.3199 - val_accuracy: 0.9067 Epoch 43/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2445 - accuracy: 0.9331 - val_loss: 0.3042 - val_accuracy: 0.9162 Epoch 44/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2403 - accuracy: 0.9352 - val_loss: 0.3080 - val_accuracy: 0.9125 Epoch 45/64 1688/1688 [==============================] - 11s 6ms/step - loss: 0.2312 - accuracy: 0.9384 - val_loss: 0.3002 - val_accuracy: 0.9180 Trial 83 Complete [00h 04m 13s] val_accuracy: 0.9276666641235352 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 48m 58s Search: Running Trial #84 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 16 |128 |convolution_width 3 |2 |dense_depth 64 |512 |dense_width leaky |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |sgd |optimizer 0.001 |0.001 |learning_rate none |exponential |learning_rate_schedule 512 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 1 |3 |tuner/round 0077 |0046 |tuner/trial_id Epoch 23/64 5/106 [>.............................] - ETA: 4s - loss: 2.6855 - accuracy: 0.1398WARNING:tensorflow:Callback method `on_train_batch_106/106 [==============================] - 6s 43ms/step - loss: 1.0333 - accuracy: 0.6359 - val_loss: 2.3720 - val_accuracy: 0.1102 Epoch 24/64 106/106 [==============================] - 4s 38ms/step - loss: 0.5712 - accuracy: 0.8015 - val_loss: 2.2762 - val_accuracy: 0.1985 Epoch 25/64 106/106 [==============================] - 4s 38ms/step - loss: 0.4877 - accuracy: 0.8317 - val_loss: 2.3402 - val_accuracy: 0.2178 Epoch 26/64 106/106 [==============================] - 4s 38ms/step - loss: 0.4373 - accuracy: 0.8495 - val_loss: 2.2031 - val_accuracy: 0.3070 Epoch 27/64 106/106 [==============================] - 4s 38ms/step - loss: 0.4057 - accuracy: 0.8609 - val_loss: 0.8701 - val_accuracy: 0.6837 Epoch 28/64 106/106 [==============================] - 4s 38ms/step - loss: 0.3802 - accuracy: 0.8692 - val_loss: 0.4046 - val_accuracy: 0.8550 Epoch 29/64 106/106 [==============================] - 4s 39ms/step - loss: 0.3590 - accuracy: 0.8802 - val_loss: 0.3590 - val_accuracy: 0.8825 Epoch 30/64 106/106 [==============================] - 4s 38ms/step - loss: 0.3434 - accuracy: 0.8849 - val_loss: 0.3035 - val_accuracy: 0.8957 Epoch 31/64 106/106 [==============================] - 4s 39ms/step - loss: 0.3273 - accuracy: 0.8911 - val_loss: 0.2950 - val_accuracy: 0.9002 Epoch 32/64 106/106 [==============================] - 4s 38ms/step - loss: 0.3177 - accuracy: 0.8937 - val_loss: 0.2942 - val_accuracy: 0.8977 Epoch 33/64 106/106 [==============================] - 4s 38ms/step - loss: 0.3095 - accuracy: 0.8957 - val_loss: 0.2872 - val_accuracy: 0.9052 Epoch 34/64 106/106 [==============================] - 4s 38ms/step - loss: 0.3017 - accuracy: 0.9000 - val_loss: 0.2936 - val_accuracy: 0.8988 Epoch 35/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2909 - accuracy: 0.9034 - val_loss: 0.2917 - val_accuracy: 0.9040 Epoch 36/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2843 - accuracy: 0.9054 - val_loss: 0.2870 - val_accuracy: 0.9055 Epoch 37/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2769 - accuracy: 0.9088 - val_loss: 0.3207 - val_accuracy: 0.8877 Epoch 38/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2757 - accuracy: 0.9100 - val_loss: 0.2879 - val_accuracy: 0.9077 Epoch 39/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2703 - accuracy: 0.9112 - val_loss: 0.2802 - val_accuracy: 0.9093 Epoch 40/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2641 - accuracy: 0.9135 - val_loss: 0.2738 - val_accuracy: 0.9117 Epoch 41/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2615 - accuracy: 0.9151 - val_loss: 0.2551 - val_accuracy: 0.9165 Epoch 42/64 106/106 [==============================] - 4s 39ms/step - loss: 0.2559 - accuracy: 0.9164 - val_loss: 0.2522 - val_accuracy: 0.9167 Epoch 43/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2559 - accuracy: 0.9153 - val_loss: 0.2535 - val_accuracy: 0.9175 Epoch 44/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2477 - accuracy: 0.9186 - val_loss: 0.2578 - val_accuracy: 0.9152 Epoch 45/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2491 - accuracy: 0.9188 - val_loss: 0.2564 - val_accuracy: 0.9155 Epoch 46/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2453 - accuracy: 0.9217 - val_loss: 0.2677 - val_accuracy: 0.9147 Epoch 47/64 106/106 [==============================] - 4s 39ms/step - loss: 0.2436 - accuracy: 0.9207 - val_loss: 0.2464 - val_accuracy: 0.9183 Epoch 48/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2399 - accuracy: 0.9227 - val_loss: 0.2756 - val_accuracy: 0.9093 Epoch 49/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2350 - accuracy: 0.9238 - val_loss: 0.2420 - val_accuracy: 0.9233 Epoch 50/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2349 - accuracy: 0.9242 - val_loss: 0.2656 - val_accuracy: 0.9112 Epoch 51/64 106/106 [==============================] - 4s 37ms/step - loss: 0.2320 - accuracy: 0.9249 - val_loss: 0.2664 - val_accuracy: 0.9152 Epoch 52/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2295 - accuracy: 0.9255 - val_loss: 0.2591 - val_accuracy: 0.9167 Epoch 53/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2247 - accuracy: 0.9276 - val_loss: 0.2672 - val_accuracy: 0.9088 Epoch 54/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2241 - accuracy: 0.9270 - val_loss: 0.2410 - val_accuracy: 0.9222 Epoch 55/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2249 - accuracy: 0.9264 - val_loss: 0.2586 - val_accuracy: 0.9180 Epoch 56/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2216 - accuracy: 0.9278 - val_loss: 0.2389 - val_accuracy: 0.9248 Epoch 57/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2218 - accuracy: 0.9296 - val_loss: 0.2350 - val_accuracy: 0.9260 Epoch 58/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2199 - accuracy: 0.9284 - val_loss: 0.2406 - val_accuracy: 0.9223 Epoch 59/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2137 - accuracy: 0.9311 - val_loss: 0.2472 - val_accuracy: 0.9208 Epoch 60/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2167 - accuracy: 0.9301 - val_loss: 0.2517 - val_accuracy: 0.9213 Epoch 61/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2127 - accuracy: 0.9316 - val_loss: 0.2294 - val_accuracy: 0.9290 Epoch 62/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2125 - accuracy: 0.9308 - val_loss: 0.2433 - val_accuracy: 0.9230 Epoch 63/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2109 - accuracy: 0.9323 - val_loss: 0.2617 - val_accuracy: 0.9187 Epoch 64/64 106/106 [==============================] - 4s 38ms/step - loss: 0.2097 - accuracy: 0.9322 - val_loss: 0.2382 - val_accuracy: 0.9230 Trial 84 Complete [00h 02m 52s] val_accuracy: 0.9290000200271606 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 51m 50s Search: Running Trial #85 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 64 |128 |convolution_width 1 |2 |dense_depth 64 |512 |dense_width elu |swish |activation l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.2 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate none |exponential |learning_rate_schedule 32 |128 |batch_size 64 |64 |tuner/epochs 22 |22 |tuner/initial_epoch 1 |3 |tuner/bracket 1 |3 |tuner/round 0078 |0046 |tuner/trial_id Epoch 23/64 1688/1688 [==============================] - 16s 9ms/step - loss: 1.0327 - accuracy: 0.6764 - val_loss: 0.5289 - val_accuracy: 0.8138 Epoch 24/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6026 - accuracy: 0.8102 - val_loss: 0.5218 - val_accuracy: 0.8518 Epoch 25/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6223 - accuracy: 0.8346 - val_loss: 0.5909 - val_accuracy: 0.8633 Epoch 26/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6664 - accuracy: 0.8435 - val_loss: 0.6121 - val_accuracy: 0.8710 Epoch 27/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6309 - accuracy: 0.8493 - val_loss: 0.5764 - val_accuracy: 0.8760 Epoch 28/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6534 - accuracy: 0.8491 - val_loss: 0.6608 - val_accuracy: 0.8487 Epoch 29/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6623 - accuracy: 0.8500 - val_loss: 0.5830 - val_accuracy: 0.8787 Epoch 30/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6204 - accuracy: 0.8601 - val_loss: 0.5172 - val_accuracy: 0.8807 Epoch 31/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6410 - accuracy: 0.8561 - val_loss: 0.5574 - val_accuracy: 0.8865 Epoch 32/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6400 - accuracy: 0.8567 - val_loss: 0.5736 - val_accuracy: 0.8822 Epoch 33/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6220 - accuracy: 0.8612 - val_loss: 0.5331 - val_accuracy: 0.8760 Epoch 34/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6062 - accuracy: 0.8629 - val_loss: 0.6104 - val_accuracy: 0.8697 Epoch 35/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6328 - accuracy: 0.8599 - val_loss: 0.5329 - val_accuracy: 0.8825 Epoch 36/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5776 - accuracy: 0.8693 - val_loss: 0.5047 - val_accuracy: 0.8963 Epoch 37/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6315 - accuracy: 0.8615 - val_loss: 0.5055 - val_accuracy: 0.9025 Epoch 38/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5775 - accuracy: 0.8698 - val_loss: 0.5189 - val_accuracy: 0.8920 Epoch 39/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6037 - accuracy: 0.8648 - val_loss: 0.5747 - val_accuracy: 0.8910 Epoch 40/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5944 - accuracy: 0.8664 - val_loss: 0.5302 - val_accuracy: 0.8892 Epoch 41/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5908 - accuracy: 0.8681 - val_loss: 0.4840 - val_accuracy: 0.8945 Epoch 42/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5822 - accuracy: 0.8715 - val_loss: 0.5744 - val_accuracy: 0.8693 Epoch 43/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.6191 - accuracy: 0.8662 - val_loss: 0.6354 - val_accuracy: 0.8677 Epoch 44/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5701 - accuracy: 0.8713 - val_loss: 0.5720 - val_accuracy: 0.8830 Epoch 45/64 1688/1688 [==============================] - 15s 9ms/step - loss: 0.5909 - accuracy: 0.8698 - val_loss: 0.5741 - val_accuracy: 0.8887 Trial 85 Complete [00h 05m 49s] val_accuracy: 0.9024999737739563 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 03h 57m 38s Search: Running Trial #86 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 32 |128 |convolution_width 0 |2 |dense_depth 128 |512 |dense_width swish |swish |activation l1_l2 |l1 |regularization_function 1e-05 |1e-05 |regularization_penalty 0.1 |0.2 |dropout rmsprop |sgd |optimizer 0.0001 |0.001 |learning_rate cosine |exponential |learning_rate_schedule 1024 |128 |batch_size 64 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 0 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/64 6/53 [==>...........................] - ETA: 5s - loss: 4.0241 - accuracy: 0.0973WARNING:tensorflow:Callback method `on_train_batch_en53/53 [==============================] - 7s 112ms/step - loss: 2.0980 - accuracy: 0.3768 - val_loss: 2.3111 - val_accuracy: 0.1515 Epoch 2/64 53/53 [==============================] - 6s 105ms/step - loss: 1.1153 - accuracy: 0.6179 - val_loss: 2.2911 - val_accuracy: 0.1072 Epoch 3/64 53/53 [==============================] - 6s 105ms/step - loss: 0.8316 - accuracy: 0.7144 - val_loss: 2.2817 - val_accuracy: 0.1077 Epoch 4/64 53/53 [==============================] - 6s 106ms/step - loss: 0.7623 - accuracy: 0.7371 - val_loss: 2.2076 - val_accuracy: 0.1340 Epoch 5/64 53/53 [==============================] - 6s 106ms/step - loss: 0.6511 - accuracy: 0.7735 - val_loss: 2.0595 - val_accuracy: 0.2217 Epoch 6/64 53/53 [==============================] - 6s 106ms/step - loss: 0.5970 - accuracy: 0.7934 - val_loss: 1.8162 - val_accuracy: 0.3478 Epoch 7/64 53/53 [==============================] - 6s 106ms/step - loss: 0.5751 - accuracy: 0.8015 - val_loss: 1.5272 - val_accuracy: 0.4707 Epoch 8/64 53/53 [==============================] - 6s 106ms/step - loss: 0.5642 - accuracy: 0.8052 - val_loss: 1.2010 - val_accuracy: 0.5988 Epoch 9/64 53/53 [==============================] - 6s 106ms/step - loss: 0.5368 - accuracy: 0.8145 - val_loss: 0.8965 - val_accuracy: 0.6923 Epoch 10/64 53/53 [==============================] - 6s 106ms/step - loss: 0.4988 - accuracy: 0.8278 - val_loss: 0.6766 - val_accuracy: 0.7615 Epoch 11/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4767 - accuracy: 0.8352 - val_loss: 0.5662 - val_accuracy: 0.8012 Epoch 12/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4588 - accuracy: 0.8409 - val_loss: 0.4845 - val_accuracy: 0.8322 Epoch 13/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4456 - accuracy: 0.8469 - val_loss: 0.4437 - val_accuracy: 0.8462 Epoch 14/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4353 - accuracy: 0.8491 - val_loss: 0.4231 - val_accuracy: 0.8523 Epoch 15/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4339 - accuracy: 0.8495 - val_loss: 0.4153 - val_accuracy: 0.8567 Epoch 16/64 53/53 [==============================] - 6s 106ms/step - loss: 0.4307 - accuracy: 0.8491 - val_loss: 0.4123 - val_accuracy: 0.8572 Epoch 17/64 53/53 [==============================] - 6s 106ms/step - loss: 0.4299 - accuracy: 0.8514 - val_loss: 0.4100 - val_accuracy: 0.8597 Epoch 18/64 53/53 [==============================] - 6s 107ms/step - loss: 0.4161 - accuracy: 0.8575 - val_loss: 0.3938 - val_accuracy: 0.8648 Epoch 19/64 53/53 [==============================] - 6s 106ms/step - loss: 0.4044 - accuracy: 0.8610 - val_loss: 0.3807 - val_accuracy: 0.8725 Epoch 20/64 53/53 [==============================] - 6s 105ms/step - loss: 0.3915 - accuracy: 0.8663 - val_loss: 0.3769 - val_accuracy: 0.8710 Epoch 21/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3799 - accuracy: 0.8704 - val_loss: 0.3618 - val_accuracy: 0.8767 Epoch 22/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3686 - accuracy: 0.8726 - val_loss: 0.3580 - val_accuracy: 0.8798 Epoch 23/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3633 - accuracy: 0.8757 - val_loss: 0.3533 - val_accuracy: 0.8805 Epoch 24/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3572 - accuracy: 0.8769 - val_loss: 0.3467 - val_accuracy: 0.8830 Epoch 25/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3520 - accuracy: 0.8785 - val_loss: 0.3432 - val_accuracy: 0.8812 Epoch 26/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3459 - accuracy: 0.8815 - val_loss: 0.3405 - val_accuracy: 0.8828 Epoch 27/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3441 - accuracy: 0.8824 - val_loss: 0.3327 - val_accuracy: 0.8868 Epoch 28/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3394 - accuracy: 0.8843 - val_loss: 0.3325 - val_accuracy: 0.8862 Epoch 29/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3346 - accuracy: 0.8855 - val_loss: 0.3304 - val_accuracy: 0.8892 Epoch 30/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3341 - accuracy: 0.8846 - val_loss: 0.3286 - val_accuracy: 0.8892 Epoch 31/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3331 - accuracy: 0.8855 - val_loss: 0.3278 - val_accuracy: 0.8897 Epoch 32/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3335 - accuracy: 0.8864 - val_loss: 0.3277 - val_accuracy: 0.8895 Epoch 33/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3324 - accuracy: 0.8866 - val_loss: 0.3277 - val_accuracy: 0.8892 Epoch 34/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3328 - accuracy: 0.8869 - val_loss: 0.3276 - val_accuracy: 0.8895 Epoch 35/64 53/53 [==============================] - 6s 105ms/step - loss: 0.3327 - accuracy: 0.8863 - val_loss: 0.3279 - val_accuracy: 0.8885 Epoch 36/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3275 - accuracy: 0.8877 - val_loss: 0.3214 - val_accuracy: 0.8898 Epoch 37/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3210 - accuracy: 0.8909 - val_loss: 0.3208 - val_accuracy: 0.8905 Epoch 38/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3158 - accuracy: 0.8930 - val_loss: 0.3074 - val_accuracy: 0.8945 Epoch 39/64 53/53 [==============================] - 6s 107ms/step - loss: 0.3080 - accuracy: 0.8945 - val_loss: 0.3039 - val_accuracy: 0.8965 Epoch 40/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3024 - accuracy: 0.8962 - val_loss: 0.3031 - val_accuracy: 0.8970 Epoch 41/64 53/53 [==============================] - 6s 106ms/step - loss: 0.3004 - accuracy: 0.8975 - val_loss: 0.2964 - val_accuracy: 0.8995 Epoch 42/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2973 - accuracy: 0.8993 - val_loss: 0.2965 - val_accuracy: 0.9000 Epoch 43/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2921 - accuracy: 0.9009 - val_loss: 0.2908 - val_accuracy: 0.9013 Epoch 44/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2879 - accuracy: 0.9013 - val_loss: 0.2954 - val_accuracy: 0.8978 Epoch 45/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2837 - accuracy: 0.9033 - val_loss: 0.2889 - val_accuracy: 0.9018 Epoch 46/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2815 - accuracy: 0.9045 - val_loss: 0.2835 - val_accuracy: 0.9022 Epoch 47/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2779 - accuracy: 0.9048 - val_loss: 0.2798 - val_accuracy: 0.9043 Epoch 48/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2764 - accuracy: 0.9055 - val_loss: 0.2838 - val_accuracy: 0.9012 Epoch 49/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2698 - accuracy: 0.9082 - val_loss: 0.2795 - val_accuracy: 0.9033 Epoch 50/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2663 - accuracy: 0.9090 - val_loss: 0.2794 - val_accuracy: 0.9008 Epoch 51/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2674 - accuracy: 0.9083 - val_loss: 0.2723 - val_accuracy: 0.9075 Epoch 52/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2637 - accuracy: 0.9099 - val_loss: 0.2732 - val_accuracy: 0.9047 Epoch 53/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2626 - accuracy: 0.9117 - val_loss: 0.2713 - val_accuracy: 0.9072 Epoch 54/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2598 - accuracy: 0.9126 - val_loss: 0.2703 - val_accuracy: 0.9067 Epoch 55/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2610 - accuracy: 0.9113 - val_loss: 0.2678 - val_accuracy: 0.9073 Epoch 56/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2565 - accuracy: 0.9138 - val_loss: 0.2673 - val_accuracy: 0.9082 Epoch 57/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2566 - accuracy: 0.9136 - val_loss: 0.2685 - val_accuracy: 0.9068 Epoch 58/64 53/53 [==============================] - 6s 107ms/step - loss: 0.2564 - accuracy: 0.9131 - val_loss: 0.2662 - val_accuracy: 0.9095 Epoch 59/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2519 - accuracy: 0.9144 - val_loss: 0.2672 - val_accuracy: 0.9070 Epoch 60/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2542 - accuracy: 0.9140 - val_loss: 0.2662 - val_accuracy: 0.9088 Epoch 61/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2510 - accuracy: 0.9154 - val_loss: 0.2651 - val_accuracy: 0.9072 Epoch 62/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2506 - accuracy: 0.9140 - val_loss: 0.2646 - val_accuracy: 0.9075 Epoch 63/64 53/53 [==============================] - 6s 105ms/step - loss: 0.2505 - accuracy: 0.9161 - val_loss: 0.2652 - val_accuracy: 0.9072 Epoch 64/64 53/53 [==============================] - 6s 106ms/step - loss: 0.2511 - accuracy: 0.9146 - val_loss: 0.2652 - val_accuracy: 0.9075 Trial 86 Complete [00h 06m 36s] val_accuracy: 0.909500002861023 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 04h 04m 15s Search: Running Trial #87 Value |Best Value So Far |Hyperparameter 1 |2 |convolution_depth 16 |128 |convolution_width 1 |2 |dense_depth 128 |512 |dense_width leaky |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.5 |0.2 |dropout rmsprop |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 64 |128 |batch_size 64 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 0 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/64 844/844 [==============================] - 6s 6ms/step - loss: 1.8755 - accuracy: 0.7979 - val_loss: 1.0988 - val_accuracy: 0.8628 Epoch 2/64 844/844 [==============================] - 5s 6ms/step - loss: 1.1658 - accuracy: 0.8322 - val_loss: 1.1253 - val_accuracy: 0.8620 Epoch 3/64 844/844 [==============================] - 5s 6ms/step - loss: 1.2179 - accuracy: 0.8372 - val_loss: 1.1771 - val_accuracy: 0.8675 Epoch 4/64 844/844 [==============================] - 5s 6ms/step - loss: 1.2438 - accuracy: 0.8382 - val_loss: 1.1144 - val_accuracy: 0.8697 Epoch 5/64 844/844 [==============================] - 5s 6ms/step - loss: 1.2423 - accuracy: 0.8410 - val_loss: 1.0942 - val_accuracy: 0.8748 Epoch 6/64 844/844 [==============================] - 5s 6ms/step - loss: 1.2200 - accuracy: 0.8442 - val_loss: 1.2094 - val_accuracy: 0.8602 Epoch 7/64 844/844 [==============================] - 5s 6ms/step - loss: 1.2572 - accuracy: 0.8442 - val_loss: 1.1029 - val_accuracy: 0.8715 Epoch 8/64 844/844 [==============================] - 5s 6ms/step - loss: 1.1951 - accuracy: 0.8463 - val_loss: 1.0732 - val_accuracy: 0.8858 Epoch 9/64 844/844 [==============================] - 5s 6ms/step - loss: 1.1862 - accuracy: 0.8496 - val_loss: 1.1240 - val_accuracy: 0.8835 Epoch 10/64 844/844 [==============================] - 5s 6ms/step - loss: 1.1719 - accuracy: 0.8505 - val_loss: 1.0106 - val_accuracy: 0.8845 Epoch 11/64 844/844 [==============================] - 5s 6ms/step - loss: 1.1323 - accuracy: 0.8533 - val_loss: 0.9725 - val_accuracy: 0.8805 Epoch 12/64 844/844 [==============================] - 5s 6ms/step - loss: 1.0899 - accuracy: 0.8561 - val_loss: 0.9826 - val_accuracy: 0.8857 Epoch 13/64 844/844 [==============================] - 5s 6ms/step - loss: 1.0872 - accuracy: 0.8571 - val_loss: 1.0014 - val_accuracy: 0.8870 Epoch 14/64 844/844 [==============================] - 5s 6ms/step - loss: 1.0671 - accuracy: 0.8596 - val_loss: 0.9754 - val_accuracy: 0.8822 Epoch 15/64 844/844 [==============================] - 5s 6ms/step - loss: 1.0182 - accuracy: 0.8613 - val_loss: 0.9501 - val_accuracy: 0.8692 Epoch 16/64 844/844 [==============================] - 5s 6ms/step - loss: 1.0047 - accuracy: 0.8633 - val_loss: 0.9416 - val_accuracy: 0.8798 Epoch 17/64 844/844 [==============================] - 5s 6ms/step - loss: 0.9980 - accuracy: 0.8655 - val_loss: 0.8755 - val_accuracy: 0.8942 Epoch 18/64 844/844 [==============================] - 5s 6ms/step - loss: 0.9599 - accuracy: 0.8666 - val_loss: 0.8756 - val_accuracy: 0.8920 Epoch 19/64 844/844 [==============================] - 5s 6ms/step - loss: 0.9627 - accuracy: 0.8667 - val_loss: 0.8712 - val_accuracy: 0.8797 Epoch 20/64 844/844 [==============================] - 5s 6ms/step - loss: 0.9359 - accuracy: 0.8691 - val_loss: 0.8102 - val_accuracy: 0.8947 Epoch 21/64 844/844 [==============================] - 5s 6ms/step - loss: 0.9143 - accuracy: 0.8702 - val_loss: 0.7908 - val_accuracy: 0.8965 Epoch 22/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8887 - accuracy: 0.8725 - val_loss: 0.7947 - val_accuracy: 0.8943 Epoch 23/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8690 - accuracy: 0.8726 - val_loss: 0.7971 - val_accuracy: 0.8935 Epoch 24/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8721 - accuracy: 0.8736 - val_loss: 0.7834 - val_accuracy: 0.8860 Epoch 25/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8257 - accuracy: 0.8769 - val_loss: 0.7412 - val_accuracy: 0.8982 Epoch 26/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8228 - accuracy: 0.8755 - val_loss: 0.7695 - val_accuracy: 0.8910 Epoch 27/64 844/844 [==============================] - 5s 6ms/step - loss: 0.8020 - accuracy: 0.8784 - val_loss: 0.7290 - val_accuracy: 0.8960 Epoch 28/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7857 - accuracy: 0.8785 - val_loss: 0.7177 - val_accuracy: 0.8982 Epoch 29/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7682 - accuracy: 0.8796 - val_loss: 0.7040 - val_accuracy: 0.8998 Epoch 30/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7740 - accuracy: 0.8796 - val_loss: 0.6622 - val_accuracy: 0.9008 Epoch 31/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7439 - accuracy: 0.8798 - val_loss: 0.6664 - val_accuracy: 0.8925 Epoch 32/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7320 - accuracy: 0.8817 - val_loss: 0.6788 - val_accuracy: 0.8985 Epoch 33/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7258 - accuracy: 0.8818 - val_loss: 0.6449 - val_accuracy: 0.8992 Epoch 34/64 844/844 [==============================] - 5s 6ms/step - loss: 0.7039 - accuracy: 0.8839 - val_loss: 0.6705 - val_accuracy: 0.8852 Epoch 35/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6960 - accuracy: 0.8832 - val_loss: 0.6511 - val_accuracy: 0.8938 Epoch 36/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6923 - accuracy: 0.8845 - val_loss: 0.6392 - val_accuracy: 0.8993 Epoch 37/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6742 - accuracy: 0.8866 - val_loss: 0.6168 - val_accuracy: 0.9058 Epoch 38/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6611 - accuracy: 0.8867 - val_loss: 0.5855 - val_accuracy: 0.9038 Epoch 39/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6424 - accuracy: 0.8891 - val_loss: 0.5847 - val_accuracy: 0.9057 Epoch 40/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6533 - accuracy: 0.8867 - val_loss: 0.5794 - val_accuracy: 0.9055 Epoch 41/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6292 - accuracy: 0.8893 - val_loss: 0.5513 - val_accuracy: 0.9048 Epoch 42/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6250 - accuracy: 0.8888 - val_loss: 0.5544 - val_accuracy: 0.9078 Epoch 43/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6112 - accuracy: 0.8906 - val_loss: 0.5712 - val_accuracy: 0.8988 Epoch 44/64 844/844 [==============================] - 5s 6ms/step - loss: 0.6032 - accuracy: 0.8923 - val_loss: 0.5304 - val_accuracy: 0.9077 Epoch 45/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5995 - accuracy: 0.8907 - val_loss: 0.5436 - val_accuracy: 0.9068 Epoch 46/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5913 - accuracy: 0.8923 - val_loss: 0.5358 - val_accuracy: 0.9032 Epoch 47/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5790 - accuracy: 0.8927 - val_loss: 0.5197 - val_accuracy: 0.9105 Epoch 48/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5722 - accuracy: 0.8934 - val_loss: 0.5196 - val_accuracy: 0.9030 Epoch 49/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5541 - accuracy: 0.8968 - val_loss: 0.5021 - val_accuracy: 0.9115 Epoch 50/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5469 - accuracy: 0.8972 - val_loss: 0.4916 - val_accuracy: 0.9118 Epoch 51/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5452 - accuracy: 0.8966 - val_loss: 0.4944 - val_accuracy: 0.9088 Epoch 52/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5420 - accuracy: 0.8954 - val_loss: 0.4919 - val_accuracy: 0.9112 Epoch 53/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5329 - accuracy: 0.8976 - val_loss: 0.4706 - val_accuracy: 0.9150 Epoch 54/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5266 - accuracy: 0.8967 - val_loss: 0.4736 - val_accuracy: 0.9133 Epoch 55/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5144 - accuracy: 0.8975 - val_loss: 0.4608 - val_accuracy: 0.9152 Epoch 56/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5070 - accuracy: 0.8992 - val_loss: 0.4660 - val_accuracy: 0.9088 Epoch 57/64 844/844 [==============================] - 5s 6ms/step - loss: 0.5053 - accuracy: 0.8989 - val_loss: 0.4589 - val_accuracy: 0.9077 Epoch 58/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4980 - accuracy: 0.8993 - val_loss: 0.4404 - val_accuracy: 0.9148 Epoch 59/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4855 - accuracy: 0.9021 - val_loss: 0.4414 - val_accuracy: 0.9148 Epoch 60/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4815 - accuracy: 0.9005 - val_loss: 0.4395 - val_accuracy: 0.9132 Epoch 61/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4776 - accuracy: 0.9015 - val_loss: 0.4324 - val_accuracy: 0.9165 Epoch 62/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4726 - accuracy: 0.9023 - val_loss: 0.4277 - val_accuracy: 0.9128 Epoch 63/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4691 - accuracy: 0.9028 - val_loss: 0.4237 - val_accuracy: 0.9142 Epoch 64/64 844/844 [==============================] - 5s 6ms/step - loss: 0.4610 - accuracy: 0.9027 - val_loss: 0.4195 - val_accuracy: 0.9132 Trial 87 Complete [00h 05m 19s] val_accuracy: 0.9164999723434448 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 04h 09m 34s Search: Running Trial #88 Value |Best Value So Far |Hyperparameter 0 |2 |convolution_depth 128 |128 |convolution_width 2 |2 |dense_depth 512 |512 |dense_width elu |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.1 |0.2 |dropout adam |sgd |optimizer 0.01 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 32 |128 |batch_size 64 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 0 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/64 1688/1688 [==============================] - 5s 3ms/step - loss: 1.1207 - accuracy: 0.7076 - val_loss: 1.1195 - val_accuracy: 0.7557 Epoch 2/64 1688/1688 [==============================] - 5s 3ms/step - loss: 1.0584 - accuracy: 0.7423 - val_loss: 1.0023 - val_accuracy: 0.7240 Epoch 3/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.9602 - accuracy: 0.7596 - val_loss: 0.7970 - val_accuracy: 0.7718 Epoch 4/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8918 - accuracy: 0.7754 - val_loss: 0.9977 - val_accuracy: 0.7627 Epoch 5/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8418 - accuracy: 0.7856 - val_loss: 0.6562 - val_accuracy: 0.8380 Epoch 6/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.8529 - accuracy: 0.7920 - val_loss: 0.7417 - val_accuracy: 0.8047 Epoch 7/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7955 - accuracy: 0.7994 - val_loss: 0.7317 - val_accuracy: 0.8388 Epoch 8/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7604 - accuracy: 0.8041 - val_loss: 0.7174 - val_accuracy: 0.8185 Epoch 9/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7258 - accuracy: 0.8091 - val_loss: 0.6711 - val_accuracy: 0.8260 Epoch 10/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.7402 - accuracy: 0.8124 - val_loss: 0.5859 - val_accuracy: 0.8542 Epoch 11/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6632 - accuracy: 0.8174 - val_loss: 0.8722 - val_accuracy: 0.8203 Epoch 12/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6516 - accuracy: 0.8225 - val_loss: 0.7950 - val_accuracy: 0.8395 Epoch 13/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.6270 - accuracy: 0.8288 - val_loss: 0.7338 - val_accuracy: 0.8467 Epoch 14/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.5820 - accuracy: 0.8338 - val_loss: 0.6335 - val_accuracy: 0.8382 Epoch 15/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.5929 - accuracy: 0.8348 - val_loss: 0.5654 - val_accuracy: 0.8718 Epoch 16/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.5588 - accuracy: 0.8398 - val_loss: 0.5726 - val_accuracy: 0.8727 Epoch 17/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.5342 - accuracy: 0.8443 - val_loss: 0.5106 - val_accuracy: 0.8478 Epoch 18/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.5124 - accuracy: 0.8467 - val_loss: 0.6833 - val_accuracy: 0.8490 Epoch 19/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4966 - accuracy: 0.8522 - val_loss: 0.6048 - val_accuracy: 0.8630 Epoch 20/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4858 - accuracy: 0.8523 - val_loss: 0.5770 - val_accuracy: 0.8745 Epoch 21/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4626 - accuracy: 0.8566 - val_loss: 0.5589 - val_accuracy: 0.8682 Epoch 22/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4699 - accuracy: 0.8579 - val_loss: 0.5957 - val_accuracy: 0.8607 Epoch 23/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4339 - accuracy: 0.8618 - val_loss: 0.5230 - val_accuracy: 0.8807 Epoch 24/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4122 - accuracy: 0.8665 - val_loss: 0.6005 - val_accuracy: 0.8333 Epoch 25/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4085 - accuracy: 0.8688 - val_loss: 0.5637 - val_accuracy: 0.8535 Epoch 26/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4047 - accuracy: 0.8691 - val_loss: 0.5280 - val_accuracy: 0.8682 Epoch 27/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.4055 - accuracy: 0.8689 - val_loss: 0.6344 - val_accuracy: 0.8587 Epoch 28/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.3855 - accuracy: 0.8747 - val_loss: 0.5126 - val_accuracy: 0.8667 Epoch 29/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.3749 - accuracy: 0.8754 - val_loss: 0.7128 - val_accuracy: 0.8608 Epoch 30/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.3668 - accuracy: 0.8784 - val_loss: 0.5730 - val_accuracy: 0.8713 Epoch 31/64 1688/1688 [==============================] - 5s 3ms/step - loss: 0.3559 - accuracy: 0.8814 - val_loss: 0.5657 - val_accuracy: 0.8730 Trial 88 Complete [00h 02m 35s] val_accuracy: 0.8806666731834412 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 04h 12m 09s Search: Running Trial #89 Value |Best Value So Far |Hyperparameter 2 |2 |convolution_depth 128 |128 |convolution_width 1 |2 |dense_depth 256 |512 |dense_width swish |swish |activation l1 |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.01 |0.001 |learning_rate none |exponential |learning_rate_schedule 128 |128 |batch_size 64 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 0 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/64 6/422 [..............................] - ETA: 31s - loss: 34.4018 - accuracy: 0.2695WARNING:tensorflow:Callback method `on_train_batc422/422 [==============================] - 30s 68ms/step - loss: 5.8752 - accuracy: 0.7009 - val_loss: 12.5939 - val_accuracy: 0.1867 Epoch 2/64 422/422 [==============================] - 29s 68ms/step - loss: 2.4945 - accuracy: 0.7833 - val_loss: 1.9525 - val_accuracy: 0.8292 Epoch 3/64 422/422 [==============================] - 29s 68ms/step - loss: 1.4492 - accuracy: 0.8386 - val_loss: 1.0888 - val_accuracy: 0.8738 Epoch 4/64 422/422 [==============================] - 29s 68ms/step - loss: 1.0147 - accuracy: 0.8655 - val_loss: 0.8708 - val_accuracy: 0.8587 Epoch 5/64 422/422 [==============================] - 29s 68ms/step - loss: 0.8563 - accuracy: 0.8741 - val_loss: 0.8178 - val_accuracy: 0.8758 Epoch 6/64 422/422 [==============================] - 29s 68ms/step - loss: 0.7757 - accuracy: 0.8818 - val_loss: 0.7294 - val_accuracy: 0.8972 Epoch 7/64 422/422 [==============================] - 29s 68ms/step - loss: 0.7589 - accuracy: 0.8823 - val_loss: 0.7171 - val_accuracy: 0.8965 Epoch 8/64 422/422 [==============================] - 29s 68ms/step - loss: 0.7413 - accuracy: 0.8828 - val_loss: 0.7390 - val_accuracy: 0.8822 Epoch 9/64 422/422 [==============================] - 28s 67ms/step - loss: 0.7482 - accuracy: 0.8866 - val_loss: 0.7748 - val_accuracy: 0.8857 Epoch 10/64 422/422 [==============================] - 28s 68ms/step - loss: 0.7924 - accuracy: 0.8878 - val_loss: 0.8403 - val_accuracy: 0.8785 Epoch 11/64 422/422 [==============================] - 29s 68ms/step - loss: 0.8203 - accuracy: 0.8871 - val_loss: 0.8023 - val_accuracy: 0.9025 Epoch 12/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8559 - accuracy: 0.8872 - val_loss: 0.8620 - val_accuracy: 0.8867 Epoch 13/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8499 - accuracy: 0.8853 - val_loss: 0.8023 - val_accuracy: 0.8950 Epoch 14/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8611 - accuracy: 0.8855 - val_loss: 0.8775 - val_accuracy: 0.8812 Epoch 15/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8478 - accuracy: 0.8908 - val_loss: 0.7887 - val_accuracy: 0.8958 Epoch 16/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8341 - accuracy: 0.8879 - val_loss: 0.8705 - val_accuracy: 0.8898 Epoch 17/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8679 - accuracy: 0.8872 - val_loss: 0.8895 - val_accuracy: 0.8973 Epoch 18/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8606 - accuracy: 0.8899 - val_loss: 0.7892 - val_accuracy: 0.8960 Epoch 19/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8775 - accuracy: 0.8900 - val_loss: 0.8478 - val_accuracy: 0.9037 Epoch 20/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8615 - accuracy: 0.8911 - val_loss: 0.8412 - val_accuracy: 0.8843 Epoch 21/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8614 - accuracy: 0.8876 - val_loss: 0.8575 - val_accuracy: 0.8952 Epoch 22/64 422/422 [==============================] - 28s 67ms/step - loss: 0.9013 - accuracy: 0.8892 - val_loss: 0.9216 - val_accuracy: 0.8935 Epoch 23/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8616 - accuracy: 0.8907 - val_loss: 0.8167 - val_accuracy: 0.8995 Epoch 24/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8231 - accuracy: 0.8923 - val_loss: 0.8077 - val_accuracy: 0.9017 Epoch 25/64 422/422 [==============================] - 28s 67ms/step - loss: 0.8711 - accuracy: 0.8897 - val_loss: 0.9029 - val_accuracy: 0.8920 Epoch 26/64 422/422 [==============================] - 28s 66ms/step - loss: 0.9012 - accuracy: 0.8889 - val_loss: 0.8457 - val_accuracy: 0.8917 Epoch 27/64 422/422 [==============================] - 28s 66ms/step - loss: 0.8575 - accuracy: 0.8919 - val_loss: 0.8444 - val_accuracy: 0.9025 Trial 89 Complete [00h 12m 49s] val_accuracy: 0.9036666750907898 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 04h 24m 58s Search: Running Trial #90 Value |Best Value So Far |Hyperparameter 3 |2 |convolution_depth 64 |128 |convolution_width 3 |2 |dense_depth 128 |512 |dense_width elu |swish |activation none |l1 |regularization_function 0.0001 |1e-05 |regularization_penalty 0.2 |0.2 |dropout sgd |sgd |optimizer 0.0001 |0.001 |learning_rate exponential |exponential |learning_rate_schedule 256 |128 |batch_size 64 |64 |tuner/epochs 0 |22 |tuner/initial_epoch 0 |3 |tuner/bracket 0 |3 |tuner/round Epoch 1/64 6/211 [..............................] - ETA: 12s - loss: 3.1239 - accuracy: 0.1445WARNING:tensorflow:Callback method `on_train_batch211/211 [==============================] - 16s 65ms/step - loss: 1.2537 - accuracy: 0.5692 - val_loss: 2.7640 - val_accuracy: 0.1242 Epoch 2/64 211/211 [==============================] - 13s 61ms/step - loss: 0.7184 - accuracy: 0.7396 - val_loss: 1.8183 - val_accuracy: 0.4008 Epoch 3/64 211/211 [==============================] - 13s 62ms/step - loss: 0.5969 - accuracy: 0.7840 - val_loss: 0.5657 - val_accuracy: 0.8013 Epoch 4/64 211/211 [==============================] - 13s 62ms/step - loss: 0.5296 - accuracy: 0.8093 - val_loss: 0.4240 - val_accuracy: 0.8442 Epoch 5/64 211/211 [==============================] - 13s 61ms/step - loss: 0.4792 - accuracy: 0.8282 - val_loss: 0.3846 - val_accuracy: 0.8608 Epoch 6/64 211/211 [==============================] - 13s 61ms/step - loss: 0.4419 - accuracy: 0.8417 - val_loss: 0.3693 - val_accuracy: 0.8698 Epoch 7/64 211/211 [==============================] - 13s 61ms/step - loss: 0.4161 - accuracy: 0.8524 - val_loss: 0.3545 - val_accuracy: 0.8753 Epoch 8/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3930 - accuracy: 0.8596 - val_loss: 0.3234 - val_accuracy: 0.8835 Epoch 9/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3762 - accuracy: 0.8656 - val_loss: 0.3424 - val_accuracy: 0.8742 Epoch 10/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3621 - accuracy: 0.8708 - val_loss: 0.3325 - val_accuracy: 0.8823 Epoch 11/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3492 - accuracy: 0.8760 - val_loss: 0.3217 - val_accuracy: 0.8867 Epoch 12/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3357 - accuracy: 0.8798 - val_loss: 0.2847 - val_accuracy: 0.9002 Epoch 13/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3259 - accuracy: 0.8842 - val_loss: 0.2843 - val_accuracy: 0.8993 Epoch 14/64 211/211 [==============================] - 13s 62ms/step - loss: 0.3178 - accuracy: 0.8861 - val_loss: 0.2747 - val_accuracy: 0.9008 Epoch 15/64 211/211 [==============================] - 13s 61ms/step - loss: 0.3093 - accuracy: 0.8885 - val_loss: 0.2800 - val_accuracy: 0.9008 Epoch 16/64 211/211 [==============================] - 13s 62ms/step - loss: 0.3040 - accuracy: 0.8924 - val_loss: 0.2638 - val_accuracy: 0.9053 Epoch 17/64 211/211 [==============================] - 13s 62ms/step - loss: 0.2982 - accuracy: 0.8927 - val_loss: 0.2694 - val_accuracy: 0.9058 Epoch 18/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2948 - accuracy: 0.8945 - val_loss: 0.2790 - val_accuracy: 0.9010 Epoch 19/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2872 - accuracy: 0.8956 - val_loss: 0.2581 - val_accuracy: 0.9095 Epoch 20/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2811 - accuracy: 0.8985 - val_loss: 0.2611 - val_accuracy: 0.9067 Epoch 21/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2779 - accuracy: 0.8994 - val_loss: 0.2561 - val_accuracy: 0.9063 Epoch 22/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2730 - accuracy: 0.9018 - val_loss: 0.2496 - val_accuracy: 0.9127 Epoch 23/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2701 - accuracy: 0.9027 - val_loss: 0.2495 - val_accuracy: 0.9103 Epoch 24/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2662 - accuracy: 0.9050 - val_loss: 0.2650 - val_accuracy: 0.9083 Epoch 25/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2630 - accuracy: 0.9067 - val_loss: 0.2464 - val_accuracy: 0.9112 Epoch 26/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2608 - accuracy: 0.9067 - val_loss: 0.2574 - val_accuracy: 0.9085 Epoch 27/64 211/211 [==============================] - 13s 62ms/step - loss: 0.2539 - accuracy: 0.9095 - val_loss: 0.2361 - val_accuracy: 0.9150 Epoch 28/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2531 - accuracy: 0.9091 - val_loss: 0.2401 - val_accuracy: 0.9140 Epoch 29/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2497 - accuracy: 0.9088 - val_loss: 0.2391 - val_accuracy: 0.9140 Epoch 30/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2526 - accuracy: 0.9090 - val_loss: 0.2376 - val_accuracy: 0.9170 Epoch 31/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2454 - accuracy: 0.9115 - val_loss: 0.2349 - val_accuracy: 0.9165 Epoch 32/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2470 - accuracy: 0.9114 - val_loss: 0.2332 - val_accuracy: 0.9163 Epoch 33/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2405 - accuracy: 0.9135 - val_loss: 0.2368 - val_accuracy: 0.9142 Epoch 34/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2417 - accuracy: 0.9126 - val_loss: 0.2293 - val_accuracy: 0.9170 Epoch 35/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2387 - accuracy: 0.9139 - val_loss: 0.2392 - val_accuracy: 0.9143 Epoch 36/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2363 - accuracy: 0.9149 - val_loss: 0.2343 - val_accuracy: 0.9155 Epoch 37/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2367 - accuracy: 0.9156 - val_loss: 0.2295 - val_accuracy: 0.9152 Epoch 38/64 211/211 [==============================] - 13s 61ms/step - loss: 0.2344 - accuracy: 0.9156 - val_loss: 0.2346 - val_accuracy: 0.9148 Trial 90 Complete [00h 08m 14s] val_accuracy: 0.9169999957084656 Best val_accuracy So Far: 0.9438333511352539 Total elapsed time: 04h 33m 12s Results summary Results in tuning/bandit Showing 10 best trials Trial summary Hyperparameters: convolution_depth: 2 convolution_width: 128 dense_depth: 2 dense_width: 512 activation: swish regularization_function: l1 regularization_penalty: 1e-05 dropout: 0.2 optimizer: sgd learning_rate: 0.001 learning_rate_schedule: exponential batch_size: 128 tuner/epochs: 64 tuner/initial_epoch: 22 tuner/bracket: 3 tuner/round: 3 tuner/trial_id: 0046 Score: 0.9438333511352539 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 128 dense_depth: 2 dense_width: 256 activation: sigmoid regularization_function: l1_l2 regularization_penalty: 1e-05 dropout: 0.2 optimizer: rmsprop learning_rate: 0.0001 learning_rate_schedule: none batch_size: 64 tuner/epochs: 64 tuner/initial_epoch: 22 tuner/bracket: 3 tuner/round: 3 tuner/trial_id: 0047 Score: 0.9433333277702332 Trial summary Hyperparameters: convolution_depth: 2 convolution_width: 128 dense_depth: 2 dense_width: 512 activation: swish regularization_function: l1 regularization_penalty: 1e-05 dropout: 0.2 optimizer: sgd learning_rate: 0.001 learning_rate_schedule: exponential batch_size: 128 tuner/epochs: 22 tuner/initial_epoch: 8 tuner/bracket: 3 tuner/round: 2 tuner/trial_id: 0036 Score: 0.9384999871253967 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 128 dense_depth: 2 dense_width: 256 activation: sigmoid regularization_function: l1_l2 regularization_penalty: 1e-05 dropout: 0.2 optimizer: rmsprop learning_rate: 0.0001 learning_rate_schedule: none batch_size: 64 tuner/epochs: 22 tuner/initial_epoch: 8 tuner/bracket: 3 tuner/round: 2 tuner/trial_id: 0035 Score: 0.9381666779518127 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 128 dense_depth: 2 dense_width: 512 activation: swish regularization_function: none regularization_penalty: 0.0001 dropout: 0.1 optimizer: sgd learning_rate: 0.001 learning_rate_schedule: none batch_size: 32 tuner/epochs: 22 tuner/initial_epoch: 8 tuner/bracket: 2 tuner/round: 1 tuner/trial_id: 0052 Score: 0.9380000233650208 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 128 dense_depth: 2 dense_width: 512 activation: swish regularization_function: none regularization_penalty: 0.0001 dropout: 0.1 optimizer: sgd learning_rate: 0.001 learning_rate_schedule: none batch_size: 32 tuner/epochs: 64 tuner/initial_epoch: 22 tuner/bracket: 2 tuner/round: 2 tuner/trial_id: 0067 Score: 0.9365000128746033 Trial summary Hyperparameters: convolution_depth: 1 convolution_width: 128 dense_depth: 3 dense_width: 256 activation: leaky regularization_function: none regularization_penalty: 0.0001 dropout: 0.0 optimizer: sgd learning_rate: 0.0001 learning_rate_schedule: exponential batch_size: 128 tuner/epochs: 64 tuner/initial_epoch: 22 tuner/bracket: 2 tuner/round: 2 tuner/trial_id: 0068 Score: 0.9325000047683716 Trial summary Hyperparameters: convolution_depth: 1 convolution_width: 128 dense_depth: 3 dense_width: 256 activation: leaky regularization_function: none regularization_penalty: 0.0001 dropout: 0.0 optimizer: sgd learning_rate: 0.0001 learning_rate_schedule: exponential batch_size: 128 tuner/epochs: 22 tuner/initial_epoch: 8 tuner/bracket: 2 tuner/round: 1 tuner/trial_id: 0065 Score: 0.9304999709129333 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 16 dense_depth: 0 dense_width: 64 activation: relu regularization_function: l1 regularization_penalty: 1e-05 dropout: 0.0 optimizer: rmsprop learning_rate: 0.01 learning_rate_schedule: cosine batch_size: 32 tuner/epochs: 22 tuner/initial_epoch: 0 tuner/bracket: 1 tuner/round: 0 Score: 0.9294999837875366 Trial summary Hyperparameters: convolution_depth: 3 convolution_width: 16 dense_depth: 3 dense_width: 64 activation: leaky regularization_function: l1_l2 regularization_penalty: 1e-05 dropout: 0.1 optimizer: rmsprop learning_rate: 0.001 learning_rate_schedule: none batch_size: 512 tuner/epochs: 64 tuner/initial_epoch: 22 tuner/bracket: 1 tuner/round: 1 tuner/trial_id: 0077 Score: 0.9290000200271606 {'convolution_depth': 2, 'convolution_width': 128, 'dense_depth': 2, 'dense_width': 512, 'activation': 'swish', 'regularization_function': 'l1', 'regularization_penalty': 1e-05, 'dropout': 0.2, 'optimizer': 'sgd', 'learning_rate': 0.001, 'learning_rate_schedule': 'exponential', 'batch_size': 128, 'tuner/epochs': 64, 'tuner/initial_epoch': 22, 'tuner/bracket': 3, 'tuner/round': 3, 'tuner/trial_id': '0046'} 313/313 [==============================] - 3s 7ms/step Model: "sequential" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= conv2d (Conv2D) (None, 28, 28, 128) 1280 batch_normalization (BatchN (None, 28, 28, 128) 512 ormalization) conv2d_1 (Conv2D) (None, 28, 28, 128) 147584 batch_normalization_1 (Batc (None, 28, 28, 128) 512 hNormalization) max_pooling2d (MaxPooling2D (None, 14, 14, 128) 0 ) dropout (Dropout) (None, 14, 14, 128) 0 conv2d_2 (Conv2D) (None, 14, 14, 128) 147584 batch_normalization_2 (Batc (None, 14, 14, 128) 512 hNormalization) conv2d_3 (Conv2D) (None, 14, 14, 128) 147584 batch_normalization_3 (Batc (None, 14, 14, 128) 512 hNormalization) max_pooling2d_1 (MaxPooling (None, 7, 7, 128) 0 2D) dropout_1 (Dropout) (None, 7, 7, 128) 0 flatten (Flatten) (None, 6272) 0 dense (Dense) (None, 512) 3211776 dropout_2 (Dropout) (None, 512) 0 dense_1 (Dense) (None, 512) 262656 dropout_3 (Dropout) (None, 512) 0 dense_2 (Dense) (None, 10) 5130 ================================================================= Total params: 3,925,642 Trainable params: 3,924,618 Non-trainable params: 1,024 _________________________________________________________________ real 273m53.027s user 214m35.935s sys 10m21.895s deeplearn@ML-RefVm-967342:~/fashion$ kaggle competitions submit -c ml530-2022-fall-fashion -f predictions.csv -m "2 + 2" 100%|██████████████████████████████████████████████████████████████████████████████████████████████| 78.1k/78.1k [00:00<00:00, 141kB/s] Successfully submitted to ml530-2022-fall-fashiondeeplearn@ML-RefVm-967342:~/fashion$