Round 1 Results

Round 1 is complete!

I generated a small test set of 1,000 items of training data, created some brand new Neural Networks to train, and then ran the first round-robin tourney. Here are the results:

(Edit: the results look much better in NotePad or NotePad++ than they do on this webpage)

Loading models...
Loading model #0, 1x100:
Loading model #1, 1x250:
Loading model #2, 1x500:
Loading model #3, 1x1000:
Loading model #4, 1x2500:
Loading model #5, 1x5000:
Loading model #6, 2x100:
Loading model #7, 2x250:
Loading model #8, 2x500:
Loading model #9, 2x1000:
Loading model #10, 2x2500:
Loading model #11, 2x5000:
Loading model #12, 3x100:
Loading model #13, 3x250:
Loading model #14, 3x500:
Loading model #15, 3x1000:
Loading model #16, 3x2500:
Loading model #17, 3x5000:
Loading model #18, 4x100:
Loading model #19, 4x250:
Loading model #20, 4x500:
Loading model #21, 4x1000:
Loading model #22, 4x2500:
Loading model #23, 4x5000:
Loading model #24, 5x100:
Loading model #25, 5x250:
Loading model #26, 5x500:
Loading model #27, 5x1000:
Loading model #28, 5x2500:
Loading model #29, 5x5000:
Models loaded successfully.


-1 is completely random.
-2 is random, but recognizes winning moves.
Black players are listed on the left, red players along the top. Black gets first move.


| -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29
-2 | - | b | R| R| b | b | R| b | R| b | R| R| R| R| R| R| R| b | b | b | R| R| b | b | b | b | R| R| b | b | b | R Black won 15:16
-1 | R| - | R| R| b | R| R| R| R| R| R| R| R| b | R| R| R| b | R| R| R| b | b | R| R| b | R| R| R| R| R| b Black won 7:24
0 | b | R| - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 29:2
1 | R| b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 29:2
2 | b | R| b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 30:1
3 | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 30:1
4 | R| b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 30:1
5 | R| b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 29:2
6 | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 30:1
7 | b | R| b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 30:1
8 | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 31:0
9 | R| R| b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 29:2
10 | R| R| b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 29:2
11 | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 31:0
12 | R| b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | R| b | b | b | b | b | R Black won 28:3
13 | R| b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 30:1
14 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b Black won 31:0
15 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 30:1
16 | b | R| b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | b | R Black won 29:2
17 | R| b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | b | b | R Black won 29:2
18 | b | b | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| - | R| R| R| R| b | b | b | b | b | R| R Black won 7:24
19 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b | R Black won 30:1
20 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b | b Black won 31:0
21 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | b | b Black won 31:0
22 | R| b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b | b | b | b | b | b | R Black won 29:2
23 | b | b | R| b | b | b | b | R| b | b | b | b | b | b | b | b | R| b | b | b | b | R| R| R| b | - | b | b | b | b | b | R Black won 24:7
24 | b | b | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| b | R| R| R| b | b | R| R| b | - | b | b | b | R| R Black won 9:22
25 | b | b | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| b | R| R| b | b | b | R| R| b | b | - | b | b | R| R Black won 10:21
26 | b | b | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| b | R| R| b | b | b | R| R| b | b | b | - | b | R| R Black won 10:21
27 | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| - | R| R| b | - | - | R| R| b | b | b | b | - | R| R Black won 5:23
28 | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | b | - | b Black won 31:0
29 | b | b | R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| R| b | b | b | b | b | R| - Black won 7:24
Top 3:
3x500 won 40 games.
2x500 won 39 games.
4x1000 won 39 games.


Complete list:
RandomWinner won 26 games.
Random won 14 games.
1x100 won 38 games.
1x250 won 37 games.
1x500 won 36 games.
1x1000 won 37 games.
1x2500 won 38 games.
1x5000 won 37 games.
2x100 won 38 games.
2x250 won 37 games.
2x500 won 39 games.
2x1000 won 37 games.
2x2500 won 37 games.
2x5000 won 38 games.
3x100 won 36 games.
3x250 won 38 games.
3x500 won 40 games.
3x1000 won 32 games.
3x2500 won 36 games.
3x5000 won 36 games.
4x100 won 11 games.
4x250 won 34 games.
4x500 won 34 games.
4x1000 won 39 games.
4x2500 won 36 games.
4x5000 won 25 games.
5x100 won 11 games.
5x250 won 12 games.
5x500 won 11 games.
5x1000 won 6 games.
5x2500 won 38 games.
5x5000 won 25 games.

I’m not too worried at this point about the quality of the learning; it was a small dataset, and these are brand new networks with no prior training.

I then played a game against the winner, 3×500:

AI gets first move.
5 | | | | | | | |
4 | | | | | | | |
3 | | | | | | | |
2 | | | | | | | |
1 | | | | | | | |
0 |b| | | | | | |
  |0|1|2|3|4|5|6|
Make your move: 3

5 | | | | | | | |
4 | | | | | | | |
3 | | | | | | | |
2 | | | | | | | |
1 | | | | | | | |
0 |b| | |R| | |b|
  |0|1|2|3|4|5|6|
Make your move: 3

5 | | | | | | | |
4 | | | | | | | |
3 | | | | | | | |
2 | | | | | | | |
1 | | | |R| | |b|
0 |b| | |R| | |b|
  |0|1|2|3|4|5|6|
Make your move: 3

5 | | | | | | | |
4 | | | | | | | |
3 | | | | | | | |
2 | | | |R| | |b|
1 | | | |R| | |b|
0 |b| | |R| | |b|
  |0|1|2|3|4|5|6|
Make your move: 3

5 | | | | | | | |
4 | | | | | | | |
3 | | | |R| | | |
2 | | | |R| | |b|
1 | | | |R| | |b|
0 |b| | |R| | |b|
  |0|1|2|3|4|5|6|
Skynet has fallen.

What we see here is basic and straightforward: the AI recognizes that it must achieve a run of 4 to win, so it pursues this single-handedly, in column 6. Unfortunately, it doesn’t yet realize that it needs to block MY winning play in column 3.

Now, I’m generating a new set of data (this time 100,000 lines of data), and running the training sessions. By my estimates, it should take roughly six hours to complete, so I’ll see tomorrow what the results are.

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s