1. 정확도와 오차율

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/3694c710-6f48-42f2-904f-7c7cbdcbd1dc/0.2_0.4_full.png

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/b5a6598e-6e87-4954-8cc4-6b06c7967b54/0.2_0.4_full.png

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/f7250994-5e18-4f36-bc62-3220a99a32e6/0.4_0.4_full.png

====Y 값====

BP_D_Y_dec [90, 71, 74, 73, 71, 71, 73, 72, 67, 90, 70, 73, 65, 67, 72, 67, 80, 85, 72, 80, 71, 63, 65, 67, 70, 76, 63, 83, 92, 63, 75, 70, 70, 63, 77, 73, 63, 74, 65, 85, 70, 76, 64, 75, 70, 70, 83, 73, 64, 70, 75, 67, 73, 70, 73, 75, 72, 67, 64, 70, 70, 92, 73, 88, 73, 88, 76, 77, 83, 73, 70, 67, 72, 65, 88, 73, 76, 88, 65, 71, 73, 72, 73, 72, 85, 73, 80, 64, 85, 65, 71, 88, 76, 78, 72, 78, 59, 92, 77, 83, 76, 73, 65, 65, 73, 64, 70, 71, 64, 83, 65, 70, 78, 64, 70, 90, 80, 70, 75, 85, 63, 73, 70, 77, 74, 73, 67, 70, 70, 59, 73, 72, 67, 76, 65, 65, 70, 70, 59, 76, 63, 73, 67, 73, 72, 70, 77, 76, 74, 72, 77, 70, 63, 83, 71, 70, 73, 85, 63, 77, 70, 85, 64, 70, 78, 83, 77, 73, 77, 76, 80, 70, 73, 73, 63, 73, 73, 88, 85, 75, 65, 74, 90, 65]
BP_S_Y_dec [124, 115, 116, 107, 115, 115, 121, 116, 110, 124, 118, 121, 118, 110, 116, 110, 122, 124, 116, 122, 115, 105, 118, 110, 110, 123, 105, 134, 132, 105, 127, 110, 110, 105, 120, 107, 101, 116, 118, 124, 110, 123, 108, 127, 110, 110, 134, 125, 108, 118, 127, 110, 121, 98, 125, 127, 116, 110, 108, 110, 98, 132, 125, 142, 125, 142, 123, 120, 134, 121, 110, 110, 116, 118, 142, 121, 123, 142, 118, 115, 121, 116, 125, 116, 124, 121, 122, 108, 124, 118, 115, 142, 123, 126, 116, 126, 114, 132, 120, 134, 123, 125, 118, 118, 121, 108, 131, 115, 108, 134, 118, 131, 126, 108, 131, 124, 122, 131, 127, 124, 101, 107, 118, 120, 116, 121, 110, 131, 98, 114, 125, 116, 110, 123, 118, 118, 118, 118, 114, 123, 101, 121, 110, 125, 116, 118, 120, 123, 116, 116, 120, 131, 105, 134, 115, 131, 107, 124, 101, 120, 110, 124, 108, 110, 126, 134, 120, 125, 120, 123, 122, 118, 121, 125, 101, 121, 107, 142, 124, 127, 118, 116, 124, 118]

====predict 값====

BP_D_dec [90, 70, 70, 73, 70, 73, 75, 72, 76, 92, 70, 73, 71, 63, 72, 76, 78, 85, 72, 79, 71, 63, 70, 76, 70, 63, 63, 83, 90, 63, 75, 70, 70, 63, 77, 73, 63, 78, 65, 85, 63, 76, 70, 75, 70, 63, 85, 73, 64, 71, 75, 67, 70, 70, 73, 75, 72, 76, 71, 70, 70, 75, 73, 88, 73, 88, 63, 63, 85, 75, 70, 67, 72, 71, 88, 65, 63, 88, 65, 71, 65, 72, 73, 72, 85, 73, 80, 64, 85, 65, 71, 88, 76, 80, 72, 78, 59, 93, 77, 85, 76, 73, 65, 70, 73, 64, 70, 78, 64, 83, 70, 70, 78, 64, 73, 85, 78, 70, 75, 85, 63, 73, 70, 77, 73, 75, 67, 74, 70, 59, 73, 72, 67, 76, 65, 70, 71, 71, 59, 76, 63, 73, 63, 74, 72, 71, 77, 76, 80, 72, 77, 70, 63, 83, 70, 74, 73, 85, 77, 77, 70, 85, 64, 70, 79, 83, 63, 70, 75, 76, 78, 70, 65, 73, 63, 73, 73, 88, 85, 75, 71, 70, 92, 65]
BP_S_dec [115, 118, 124, 107, 118, 118, 127, 116, 123, 132, 118, 121, 113, 101, 116, 123, 125, 124, 116, 125, 112, 105, 118, 123, 110, 101, 105, 134, 124, 105, 127, 110, 110, 105, 120, 107, 101, 125, 118, 124, 105, 123, 118, 127, 110, 105, 124, 125, 108, 113, 127, 110, 118, 98, 125, 127, 116, 123, 115, 110, 98, 126, 124, 142, 125, 142, 101, 101, 124, 127, 110, 110, 116, 115, 142, 118, 101, 142, 118, 115, 118, 116, 125, 116, 124, 121, 122, 108, 124, 118, 115, 142, 123, 122, 116, 126, 114, 124, 120, 124, 123, 125, 118, 118, 121, 108, 131, 126, 108, 134, 118, 131, 126, 108, 124, 124, 126, 131, 127, 124, 101, 107, 118, 120, 125, 127, 110, 116, 98, 114, 131, 116, 109, 123, 118, 118, 114, 115, 114, 123, 101, 121, 101, 116, 116, 115, 120, 123, 122, 116, 120, 131, 105, 134, 118, 123, 107, 124, 101, 120, 110, 124, 108, 110, 125, 134, 101, 131, 127, 123, 126, 118, 118, 125, 101, 121, 101, 142, 124, 127, 115, 131, 132, 118]

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/63c70955-3949-42ce-8bc2-8801bb8dec89/0.4_0.4_full.png

====Y 값====

BP_D_Y_dec [90, 71, 74, 73, 71, 71, 73, 72, 67, 90, 70, 73, 65, 67, 72, 67, 80, 85, 72, 80, 71, 63, 65, 67, 70, 76, 63, 83, 92, 63, 75, 70, 70, 63, 77, 73, 63, 74, 65, 85, 70, 76, 64, 75, 70, 70, 83, 73, 64, 70, 75, 67, 73, 70, 73, 75, 72, 67, 64, 70, 70, 92, 73, 88, 73, 88, 76, 77, 83, 73, 70, 67, 72, 65, 88, 73, 76, 88, 65, 71, 73, 72, 73, 72, 85, 73, 80, 64, 85, 65, 71, 88, 76, 78, 72, 78, 59, 92, 77, 83, 76, 73, 65, 65, 73, 64, 70, 71, 64, 83, 65, 70, 78, 64, 70, 90, 80, 70, 75, 85, 63, 73, 70, 77, 74, 73, 67, 70, 70, 59, 73, 72, 67, 76, 65, 65, 70, 70, 59, 76, 63, 73, 67, 73, 72, 70, 77, 76, 74, 72, 77, 70, 63, 83, 71, 70, 73, 85, 63, 77, 70, 85, 64, 70, 78, 83, 77, 73, 77, 76, 80, 70, 73, 73, 63, 73, 73, 88, 85, 75, 65, 74, 90, 65]
BP_S_Y_dec [124, 115, 116, 107, 115, 115, 121, 116, 110, 124, 118, 121, 118, 110, 116, 110, 122, 124, 116, 122, 115, 105, 118, 110, 110, 123, 105, 134, 132, 105, 127, 110, 110, 105, 120, 107, 101, 116, 118, 124, 110, 123, 108, 127, 110, 110, 134, 125, 108, 118, 127, 110, 121, 98, 125, 127, 116, 110, 108, 110, 98, 132, 125, 142, 125, 142, 123, 120, 134, 121, 110, 110, 116, 118, 142, 121, 123, 142, 118, 115, 121, 116, 125, 116, 124, 121, 122, 108, 124, 118, 115, 142, 123, 126, 116, 126, 114, 132, 120, 134, 123, 125, 118, 118, 121, 108, 131, 115, 108, 134, 118, 131, 126, 108, 131, 124, 122, 131, 127, 124, 101, 107, 118, 120, 116, 121, 110, 131, 98, 114, 125, 116, 110, 123, 118, 118, 118, 118, 114, 123, 101, 121, 110, 125, 116, 118, 120, 123, 116, 116, 120, 131, 105, 134, 115, 131, 107, 124, 101, 120, 110, 124, 108, 110, 126, 134, 120, 125, 120, 123, 122, 118, 121, 125, 101, 121, 107, 142, 124, 127, 118, 116, 124, 118]

====predict 값====

BP_D_dec [89, 70, 73, 73, 70, 73, 75, 72, 76, 90, 56, 73, 70, 63, 72, 76, 80, 85, 72, 80, 64, 63, 70, 76, 70, 76, 63, 83, 92, 63, 75, 70, 70, 63, 77, 73, 63, 80, 73, 85, 70, 76, 70, 75, 70, 63, 83, 73, 64, 73, 75, 67, 73, 70, 73, 75, 72, 76, 65, 70, 70, 69, 73, 88, 73, 88, 63, 63, 85, 75, 70, 76, 72, 71, 88, 73, 63, 88, 70, 59, 73, 72, 73, 72, 85, 73, 80, 64, 90, 73, 70, 88, 76, 80, 72, 73, 59, 90, 77, 85, 76, 73, 65, 70, 73, 64, 70, 70, 64, 83, 73, 70, 78, 64, 73, 70, 78, 70, 75, 85, 63, 73, 70, 77, 73, 75, 76, 74, 70, 59, 73, 72, 76, 76, 70, 70, 70, 65, 59, 76, 63, 73, 63, 73, 72, 70, 77, 76, 80, 72, 77, 70, 63, 83, 70, 74, 73, 85, 76, 77, 70, 85, 64, 70, 80, 83, 63, 70, 77, 76, 78, 71, 73, 73, 63, 73, 73, 88, 85, 75, 71, 73, 92, 73]
BP_S_dec [124, 118, 124, 107, 118, 121, 127, 116, 123, 124, 114, 121, 118, 101, 116, 123, 122, 124, 116, 125, 108, 105, 118, 123, 110, 123, 105, 135, 132, 105, 127, 110, 110, 105, 120, 107, 101, 125, 121, 124, 110, 100, 118, 127, 110, 105, 134, 125, 108, 121, 127, 102, 121, 98, 124, 127, 116, 123, 118, 110, 98, 124, 124, 142, 124, 142, 101, 101, 124, 127, 110, 123, 116, 115, 142, 121, 101, 142, 118, 114, 121, 116, 124, 116, 124, 121, 122, 108, 124, 121, 116, 142, 123, 122, 116, 126, 114, 124, 120, 124, 123, 125, 118, 118, 121, 108, 131, 118, 108, 134, 121, 131, 126, 108, 124, 124, 126, 131, 127, 124, 101, 107, 118, 120, 125, 127, 120, 116, 98, 114, 124, 116, 123, 120, 118, 118, 118, 118, 114, 123, 101, 121, 101, 124, 116, 118, 120, 123, 122, 116, 120, 131, 105, 134, 118, 116, 106, 124, 120, 120, 110, 124, 108, 110, 125, 134, 101, 131, 120, 123, 126, 112, 121, 124, 101, 121, 109, 142, 124, 127, 116, 131, 132, 121]

2. 정확도

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/5cecb4f7-936d-4d93-a5ee-3282ab83c4bd/0.2_0.4_acc.png

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/da1293a7-cbf6-4ecb-9933-a4a3c3fed96b/0.2_0.4_acc.png

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/71455940-ada2-48e1-abcd-cde9eebb62e9/0.4_0.4_acc.png

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/a2fefc78-87c9-4f5f-8baa-436f5c019341/0.4_0.4_acc.png


3. 오차율

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/2308689a-cd97-4f0f-b218-b01b198da484/0.2_0.4_loss.png

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.2, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/65642958-adb7-47fa-a3b4-b1b0c328480f/0.2_0.4_loss.png

A. Relu-Relu-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/ad8f68d0-c899-47eb-9113-e5c8a923af11/0.4_0.4_loss.png

B. Sigmoid-Sigmoid-Sigmoid

Dropout ⇒ 0.4, 0.4

https://s3-us-west-2.amazonaws.com/secure.notion-static.com/94552dcc-91f4-41c4-a46b-08e93eff482b/0.4_0.4_loss.png