Internet engine matches

Discussion about development of draughts in the time of computer and Internet.
Post Reply
Ed Gilbert
Posts: 792
Joined: Sat Apr 28, 2007 14:53
Real name: Ed Gilbert
Location: Morristown, NJ USA
Contact:

Re: Internet engine matches

Post by Ed Gilbert » Mon Apr 06, 2020 13:14

Ed play through dxp. Don't play through Tmgr. You'll only see differences in results.
Doing it with DXP is very tedious. You have to run the scan program, drag its program window to be overlapped with the other scan windows on the desktop, open kingsrow, position is program window, and go through all the mouse clicks to establish a DXP connection and start a match. Doing this 16 times is a lot of work.

The only results I have with both DXP and Tmgr are 75 moves/1 minute, 2-move openings. I get elo diffs of 4.7 and 6.2, so 1.5 elo difference between the two matches, which is small.

Kingsrow 1.61 vs Scan 3.1
75 moves in 1 minute using DXP

[ 0]: 0.508 score, 790 games, 16 wins, 4 losses, 770 draws, 0 unk
[ 1]: 0.507 score, 790 games, 14 wins, 3 losses, 772 draws, 1 unk
[ 2]: 0.504 score, 790 games, 14 wins, 7 losses, 769 draws, 0 unk
[ 3]: 0.508 score, 790 games, 15 wins, 2 losses, 773 draws, 0 unk
[ 4]: 0.511 score, 790 games, 24 wins, 6 losses, 759 draws, 1 unk
[ 5]: 0.502 score, 790 games, 9 wins, 6 losses, 775 draws, 0 unk
[ 6]: 0.504 score, 790 games, 12 wins, 5 losses, 772 draws, 1 unk
[ 7]: 0.506 score, 790 games, 12 wins, 3 losses, 775 draws, 0 unk
[ 8]: 0.504 score, 790 games, 15 wins, 9 losses, 766 draws, 0 unk
[ 9]: 0.507 score, 790 games, 14 wins, 3 losses, 773 draws, 0 unk
[10]: 0.510 score, 790 games, 22 wins, 7 losses, 759 draws, 2 unk
[11]: 0.506 score, 790 games, 16 wins, 6 losses, 768 draws, 0 unk
[12]: 0.504 score, 790 games, 13 wins, 6 losses, 771 draws, 0 unk
[13]: 0.510 score, 790 games, 18 wins, 3 losses, 768 draws, 1 unk
[14]: 0.508 score, 790 games, 17 wins, 4 losses, 769 draws, 0 unk
[15]: 0.508 score, 790 games, 16 wins, 3 losses, 770 draws, 1 unk
total 0.507 score, 12640 games, 247 wins, 77 losses, 12309 draws, 7 unk
elo diff 4.7

Kingsrow settings:
hashtable: 256 mb
egdb: 8 pieces, 5500 mb cache
search threads: 1
pondering: off
book: best

Scan settings:
book = true
book-ply = 4
book-margin = 0
threads = 1
tt-size = 24
bb-size = 6


Match stats Kingsrow 1.61 vs. Scan 3.1 (using Tmgr)

[ 1]: 0.507 score, 790 games, 17 wins, 6 losses, 767 draws, 0 unk
[ 2]: 0.513 score, 790 games, 22 wins, 1 losses, 767 draws, 0 unk
[ 3]: 0.508 score, 790 games, 17 wins, 4 losses, 769 draws, 0 unk
[ 4]: 0.508 score, 790 games, 17 wins, 5 losses, 768 draws, 0 unk
[ 5]: 0.508 score, 790 games, 15 wins, 3 losses, 772 draws, 0 unk
[ 6]: 0.510 score, 790 games, 19 wins, 3 losses, 768 draws, 0 unk
[ 7]: 0.505 score, 790 games, 13 wins, 5 losses, 771 draws, 1 unk
[ 8]: 0.509 score, 790 games, 15 wins, 0 losses, 775 draws, 0 unk
[ 9]: 0.512 score, 790 games, 22 wins, 3 losses, 765 draws, 0 unk
[10]: 0.508 score, 790 games, 16 wins, 3 losses, 771 draws, 0 unk
[11]: 0.510 score, 790 games, 21 wins, 5 losses, 764 draws, 0 unk
[12]: 0.508 score, 790 games, 13 wins, 1 losses, 775 draws, 1 unk
[13]: 0.510 score, 790 games, 18 wins, 2 losses, 769 draws, 1 unk
[14]: 0.510 score, 790 games, 18 wins, 2 losses, 770 draws, 0 unk
[15]: 0.506 score, 790 games, 15 wins, 5 losses, 770 draws, 0 unk
[16]: 0.511 score, 790 games, 19 wins, 2 losses, 769 draws, 0 unk
total 0.509 score, 12640 games, 277 wins, 50 losses, 12310 draws, 3 unk
elo diff 6.2
LOS 1.00

Match control file:

[General]
start-pos-file = d:\tmgr\2move_ballots.pdn
games = 790
parallel-matches = 16
time = 60
moves = 75
#inc = 0.5
egdb-wld-path = d:\db_intl\wld_v2

[Engine]
engine-dir = d:\kr_hub
engine-command = d:\kr_hub\kr_hub
draw-count = 5
draw-pieces = 10
draw-score = 0.07
win-score = 20
set-param egdb-wld-pieces = 8
set-param egdb-wld-mem = 5500
set-param egdb-wld-path = d:\db_intl\wld_v2
set-param threads = 1
set-param tt-mem = 256
set-param tt-load = false
set-param book = true
set-param book-quality = best

[Engine]
engine-command = "\projects\scan_31\scan.exe hub"
engine-dir = \projects\scan_31
draw-count = 5
draw-pieces = 7
draw-score = 0.0
win-score = 80
set-param tt-size = 24
set-param bb-size = 6
set-param book = true
set-param book-ply = 4
set-param book-margin = 0
set-param threads = 1

Krzysztof Grzelak
Posts: 874
Joined: Thu Jun 20, 2013 17:16
Real name: Krzysztof Grzelak

Re: Internet engine matches

Post by Krzysztof Grzelak » Mon Apr 06, 2020 13:28

I use dxp and I have match results.I have no other.

Krzysztof Grzelak
Posts: 874
Joined: Thu Jun 20, 2013 17:16
Real name: Krzysztof Grzelak

Re: Internet engine matches

Post by Krzysztof Grzelak » Tue Apr 07, 2020 00:13

Match KINGSROW - SCAN (3-move ballots)

Kingsrow 1.61 vs. Scan 3.1 8 wins, 3 losses, 974 draws, 1 unknowns

Kingsrow 1.61 x64

Opening Book = Best Moves
HashTable Size = 512 MB
DB cache Size = 30000 MB
The base ends = 8 Pieces
Threads = 8
Time = 1 Min / 75 Moves

Scan 3.1 x64

Variant = normal
Book = true
Book-ply = 4
Book-margin = 0
Threads = 8
Tt-size = 26
Bb-size = 6
Time = 1 Min / 75 Moves

Match played on a computer with the equipment.

Processor - AMD Ryzen Threadripper 1950X
Hard disc - Samsung 860 Pro SSD 1 TB
Memory of frames - 128 GB DDR4 2400
System - Windows 10 64 bit Pro
Attachments
dxpgames.pdn
Match Kingsrow - Scan
(940.64 KiB) Downloaded 29 times

Krzysztof Grzelak
Posts: 874
Joined: Thu Jun 20, 2013 17:16
Real name: Krzysztof Grzelak

Re: Internet engine matches

Post by Krzysztof Grzelak » Sun May 24, 2020 22:51

Match KINGSROW - SCAN (2-move ballots)

Damage 15.3 vs. Kingsrow 1.61 0 wins, 12 losses, 146 draws, 0 unknowns

Damage 15.3 x64

Variant = normal
Book = 0
Threads = 8
Tt-shared = 1
Tt-size = 25
Bb-cache = 5
Bb-size = 7
Bb-preload = 7
Time = 1 Min / 75 Moves

Kingsrow 1.61 x64

Opening Book = Best Moves
HashTable Size = 512 MB
DB cache Size = 30000 MB
The base ends = 8 Pieces
Threads = 8
Time = 1 Min / 75 Moves

Match played on a computer with the equipment.

Processor - AMD Ryzen Threadripper 1950X
Hard disc - Samsung 860 Pro SSD 1 TB
Memory of frames - 128 GB DDR4 2400
System - Windows 10 64 bit Pro
Attachments
dxpgames.pdn
Match Damage - Kingsrow
(152.85 KiB) Downloaded 16 times

BertTuyt
Posts: 1415
Joined: Wed Sep 01, 2004 19:42

Re: Internet engine matches

Post by BertTuyt » Mon May 25, 2020 09:29

Krzysztof, thanks for sharing and testing. I will upload in the evening an engine update (also with a new weights file).
Im interested in new test results from your side, hope to get below the 20 ELO points difference compared with Kingsrow.

Bertt

Krzysztof Grzelak
Posts: 874
Joined: Thu Jun 20, 2013 17:16
Real name: Krzysztof Grzelak

Re: Internet engine matches

Post by Krzysztof Grzelak » Wed May 27, 2020 13:19

Match DAMAGE - KINGSROW (2-move ballots)

Damage 15.3 vs. Kingsrow 1.61 0 wins, 16 losses, 142 draws, 0 unknowns

Damage 15.3 x64

Variant = normal
Book = 0
Threads = 8
Tt-shared = 1
Tt-size = 25
Bb-cache = 5
Bb-size = 7
Bb-preload = 7
Time = 1 Min / 75 Moves

Kingsrow 1.61 x64

Opening Book = Best Moves
HashTable Size = 512 MB
DB cache Size = 30000 MB
The base ends = 8 Pieces
Threads = 8
Time = 1 Min / 75 Moves

Match played on a computer with the equipment.

Processor - AMD Ryzen Threadripper 1950X
Hard disc - Samsung 860 Pro SSD 1 TB
Memory of frames - 128 GB DDR4 2400
System - Windows 10 64 bit Pro
Attachments
dxpgames.pdn
(151.95 KiB) Downloaded 12 times

Post Reply