Star Swarm - Oxide bench thread

pgi947 · 30 Jan 2014 at 23:22

Run 1: 30.80

Everytime I go to do a second run I need to restart my PC to get it to happen

gazzaa · 30 Jan 2014 at 23:26

Oxide Games
Star Swarm Benchmark - ©2013
C:\Users\gary\Documents\Star Swarm\Benchmark_14_01_30_2317.txt
Version 0.95
01/30/2014 23:17
===========================================================

== Hardware Configuration =================================
GPU: AMD Radeon R9 200 Series
CPU: AuthenticAMD
AMD FX(tm)-6300 Six-Core Processor
Physical Cores: 3
Logical Cores: 6
Physical Memory: 8544595968
Allocatable Memory: 140737488224256
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioAttract.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 16.6 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 2535

Average FPS: 21.12
Average Unit Count: 3797
Maximum Unit Count: 5524
Average Batches/MS: 680.32
Maximum Batches/MS: 929.00
Average Batch Count: 33965
Maximum Batch Count: 201295
===========================================================

6300@ 4.5
270x @ stock

DamnedLife · 30 Jan 2014 at 23:35

pgi947 said:
Run 1: 30.80

Everytime I go to do a second run I need to restart my PC to get it to happen

Really? Hmm :confused:

Working on it

pgi947 · 30 Jan 2014 at 23:37

Restarted got 30.85 so fairly consistent

GPU is a 780 @ 1006/6000

What do you get with your custom scenario and what GPU?

Edit: Its not just second run with that specific setting, any setting causes it, likely something at my end.

DamnedLife · 30 Jan 2014 at 23:43

pgi947 said:
Restarted got 30.85 so fairly consistent

GPU is a 780 @ 1006/6000

What do you get with your custom scenario and what GPU?

Edit: Its not just second run with that specific setting, any setting causes it, likely something at my end.

Hmm okay I got Sapphire R9 290X TRI-X and FX 8350 and 16GB GSKILL Ripjaws X 1866 CL10 all at stock.

alex_123_fra · 30 Jan 2014 at 23:45

I got a system service exception BSOD shortly after I ran this bench. System totally stable on gaming and all other benches plus LinX.

Finguz · 30 Jan 2014 at 23:49

First run with your custom .csv, I'll run it again now.

===========================================================
Oxide Games
Star Swarm Benchmark - ©2013
C:\Users\Paul\Documents\Star Swarm\Benchmark_14_01_30_2345.txt
Version 0.95
01/30/2014 23:45
===========================================================

== Hardware Configuration =================================
GPU: AMD Radeon R9 200 Series
CPU: GenuineIntel
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz
Physical Cores: 4
Logical Cores: 8
Physical Memory: 8524423168
Allocatable Memory: 140737488224256
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioCustom.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 16.6 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 4034

Average FPS: 33.61
Average Unit Count: 3543
Maximum Unit Count: 5353
Average Batches/MS: 1188.65
Maximum Batches/MS: 1703.25
Average Batch Count: 37225
Maximum Batch Count: 144774
===========================================================

Sorry for the delay, the missus demanded my attention

Second run, and it's quite different.

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 5080

Average FPS: 42.32
Average Unit Count: 3656
Maximum Unit Count: 5413
Average Batches/MS: 1140.75
Maximum Batches/MS: 1727.85
Average Batch Count: 27573
Maximum Batch Count: 95963
===========================================================

And a third time before I go to bed.

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 4591

Average FPS: 38.26
Average Unit Count: 3768
Maximum Unit Count: 5399
Average Batches/MS: 1073.72
Maximum Batches/MS: 1711.22
Average Batch Count: 30160
Maximum Batch Count: 134201
===========================================================

Night guys

I squeezed one more run in, this time with pgi947's FixedFrameMS tweak. I couldn't run it at 8.3 it kept crashing after the loading screen but 9.3 was ok and has made a rather large improvement.

== Configuration ==========================================
API: DirectX
Scenario: ScenarioCustom.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 9.3 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 8039

Average FPS: 66.99
Average Unit Count: 3682
Maximum Unit Count: 5431
Average Batches/MS: 783.80
Maximum Batches/MS: 1655.33
Average Batch Count: 13655
Maximum Batch Count: 78333
===========================================================

pgi947 · 30 Jan 2014 at 23:53

DamnedLife said:
Hmm okay I got Sapphire R9 290X TRI-X and FX 8350 and 16GB GSKILL Ripjaws X 1866 CL10 all at stock. Also posted my results back there: http://forums.overclockers.co.uk/showpost.php?p=25762475&postcount=77

Go into the steamapps/common/star swarm benchmark/assests, find 'Settings_Extreme.ini' open it with note pad and change:

FixedFrameMS=16.6

To something like...

FixedFrameMS=8.3

BOOM!!!

Magical frame rate increase.

The 16.6 ms triggered something from one of the gsync threads, its some form of rate at which frames are pushed to the monitor, with this being fixed its holding the card back. I went from 30fps in attract extreme to 83 fps.

I genuinely hope this is a mistake by oxide and not a deliberate attempt to make DX look pathetic.

DamnedLife · 30 Jan 2014 at 23:55

alex_123_fra said:
I got a system service exception BSOD shortly after I ran this bench. System totally stable on gaming and all other benches plus LinX.

It is due to bad copy and past I believe it happened to me too, delete ScenarioCustom.csv and make Steam check file integrity, it will replace it with original.

Sgt_Pepper · 31 Jan 2014 at 00:16

DamnedLife said:
Try iterating with this as your ScenarioCustom.csv, so that we can figure the right values for getting consistent FPS results.

Good effort, hopefully it will help make it a useful bench.

pete910 · 31 Jan 2014 at 00:42

Mines all over the place too.

Stock r290x on a Phenom x6 1090t @ 3.6

===========================================================
Oxide Games
Star Swarm Benchmark - ©2013
C:\Users\pete\Documents\Star Swarm\Benchmark_14_01_31_0011.txt
Version 0.95
01/31/2014 00:11
===========================================================

== Hardware Configuration =================================
GPU: AMD Radeon R9 200 Series
CPU: AuthenticAMD
AMD Phenom(tm) II X6 1090T Processor
Physical Cores: 6
Logical Cores: 6
Physical Memory: 17177305088
Allocatable Memory: 8796092891136
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioAttract.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 16.6 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 3031

Average FPS: 25.25
Average Unit Count: 3782
Maximum Unit Count: 5497
Average Batches/MS: 592.21
Maximum Batches/MS: 842.92
Average Batch Count: 23498
Maximum Batch Count: 85703
===========================================================

in contrast then this :confused:

===========================================================
Oxide Games
Star Swarm Benchmark - ©2013
C:\Users\pete\Documents\Star Swarm\Benchmark_14_01_31_0019.txt
Version 0.95
01/31/2014 00:19
===========================================================

== Hardware Configuration =================================
GPU: AMD Radeon R9 200 Series
CPU: AuthenticAMD
AMD Phenom(tm) II X6 1090T Processor
Physical Cores: 6
Logical Cores: 6
Physical Memory: 17177305088
Allocatable Memory: 8796092891136
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioAttract.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 16.6 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1959

Average FPS: 16.32
Average Unit Count: 3634
Maximum Unit Count: 5585
Average Batches/MS: 639.28
Maximum Batches/MS: 835.33
Average Batch Count: 40513
Maximum Batch Count: 200799
===========================================================

Had mine dip to 4 fps when it was spinning around the battle..
Looked at my GPU/CPU usage and both never went above 40% on any core of cpu/gpu

So is that the alpha/engine problem or to show DX short falls?

jinxpad · 31 Jan 2014 at 00:49

Spec in Sig -

== Hardware Configuration =================================
GPU: AMD Radeon R9 200 Series
CPU: GenuineIntel
Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
Physical Cores: 4
Logical Cores: 8
Physical Memory: 6439768064
Allocatable Memory: 140737488224256
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioAttract.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 16.6 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 3764

Average FPS: 31.35
Average Unit Count: 3757
Maximum Unit Count: 5343
Average Batches/MS: 693.93
Maximum Batches/MS: 1166.86
Average Batch Count: 23527
Maximum Batch Count: 179929
===========================================================

DamnedLife · 31 Jan 2014 at 00:52

Would it be okay to look from afar and not follow any units? You know static camera angle??

DamnedLife · 31 Jan 2014 at 01:04

Get this one for consistent FPS

Wow I'm getting real good consistent results. The camere is completely static, and everything definitely moves exactly the same as far as I can see.

ScenarioCustom.csv file

Command,Subject,Player Number,Start Time,Max Reps,Unit Rep Rate,Unit Spawn Rate (the time between units spawned into this squadron once it has materialized (in seconds)),X,Y,z
SpawnBackgroundObject,TheCosmos,,0,1,1,0,0,0,0
SpawnBackgroundObject,Planet,,0,1,1,0,0,-12000,-2300
SpawnBackgroundObject,PlanetAtmosphere,,0,1,1,0,0,-12000,-2300
SpawnBackgroundObject,StarSphere,,0,1,1,0,0,0,0
SpawnBackgroundObject,StarSphere,,0,1,1,0,0,0,0
SpawnBackgroundObject,StarSphere,,0,1,1,0,0,0,0
SpawnBackgroundObject,StarSphere,,0,1,1,0,0,0,0
SpawnBackgroundObject,StarSphere,,0,1,1,0,0,0,0
SpawnBackgroundObject,TheSuns,,0,1,1,0,0,0,0
CameraToUnit,,,0.1,0,0,0,0,0,0
CameraToRandomAngle,,,0.1,0,0,0,,,
CameraToRandomUnit,,,0,0,0,0,,,
SetGrids,,,0,1,1,0,0,0,0
SpawnSquadron,Bench FighterA1-0-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-1-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-2-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-3-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-4-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-5-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-6-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-7-0,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-0-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-1-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-2-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-3-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-4-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-5-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-6-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterA1-7-1,0,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-0-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-1-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-2-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-3-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-4-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-5-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-6-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-7-0,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-0-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-1-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-2-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-3-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-4-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-5-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-6-1,1,0,3,12,0,,,
SpawnSquadron,Bench FighterB1-7-1,1,0,3,12,0,,,
SpawnSquadron,Bench BomberA1-0,0,0,24,100,0.2,,,
SpawnSquadron,Bench BomberA1-1,0,0,24,100,0.2,,,
SpawnSquadron,Bench BomberB1-0,1,0,8,200,0.2,,,
SpawnSquadron,Bench BomberB1-1,1,0,8,200,0.2,,,
SpawnSquadron,Bench CarrierA1-0,0,0,1,0,0,,,
SpawnSquadron,Bench CarrierA1-1,0,0,1,0,0,,,
SpawnSquadron,Bench CarrierB1-0,1,0,1,0,0,,,
SpawnSquadron,Bench CarrierB1-1,1,0,1,0,0,,,
SpawnSquadron,Stress00,0,1,250,12,0.01,,,
SpawnSquadron,Stress01,1,1,250,12,0.01,,,
SpawnSquadron,Stress02,1,1,250,12,0.01,,,
SpawnSquadron,Stress03,0,1,250,12,0.01,,,
SpawnSquadron,Stress10,0,1,250,12,0.01,,,
SpawnSquadron,Stress11,1,1,250,12,0.01,,,
SpawnSquadron,Stress12,1,1,250,12,0.01,,,
SpawnSquadron,Stress13,0,1,250,12,0.01,,,
ResetScenario,,,2700,99999999,,,,,

My first run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1695

Average FPS: 14.12
Average Unit Count: 3358
Maximum Unit Count: 5621
Average Batches/MS: 689.43
Maximum Batches/MS: 851.64
Average Batch Count: 51384
Maximum Batch Count: 96843

My second run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1658

Average FPS: 13.81
Average Unit Count: 3282
Maximum Unit Count: 5447
Average Batches/MS: 686.37
Maximum Batches/MS: 858.66
Average Batch Count: 52325
Maximum Batch Count: 99661

My third run
Results ================================================
Test Duration: 120 Seconds
Total Frames: 1660

Average FPS: 13.82
Average Unit Count: 3270
Maximum Unit Count: 5367
Average Batches/MS: 692.29
Maximum Batches/MS: 847.61
Average Batch Count: 52760
Maximum Batch Count: 101677

These are all consecutive runs with fan profile set to automatic so first one got better results then rest decrease a bit.

Now I will repeat the prodecure after cold booting my pc, changing into my fan curve still at stock tho

and will run 4 more times.

EDIT: Uploaded my ScenarioCustom file please try this out: http://speedy.sh/yau85/ScenarioCustom.csv

DamnedLife · 31 Jan 2014 at 01:27

I ve got almost always the same results

First run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1686

Average FPS: 14.05
Average Unit Count: 3342
Maximum Unit Count: 5652
Average Batches/MS: 685.59
Maximum Batches/MS: 814.13
Average Batch Count: 51355
Maximum Batch Count: 95558
===========================================================

Second run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1670

Average FPS: 13.91
Average Unit Count: 3307
Maximum Unit Count: 5423
Average Batches/MS: 690.71
Maximum Batches/MS: 854.31
Average Batch Count: 52292
Maximum Batch Count: 96238
===========================================================

Third Run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1685

Average FPS: 14.04
Average Unit Count: 3304
Maximum Unit Count: 5261
Average Batches/MS: 688.09
Maximum Batches/MS: 838.51
Average Batch Count: 51636
Maximum Batch Count: 95076
===========================================================

Foruth run
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1665

Average FPS: 13.87
Average Unit Count: 3260
Maximum Unit Count: 5325
Average Batches/MS: 682.53
Maximum Batches/MS: 803.67
Average Batch Count: 51824
Maximum Batch Count: 94542
===========================================================

Fifth run (did one extra)
== Results ================================================
Test Duration: 120 Seconds
Total Frames: 1645

Average FPS: 13.71
Average Unit Count: 3283
Maximum Unit Count: 5566
Average Batches/MS: 660.32
Maximum Batches/MS: 801.24
Average Batch Count: 50658
Maximum Batch Count: 96612
===========================================================

Inbetween runs I checked out the results and compared with my early reasults so there may be some time past between these runs which in turn led to fans cooling the gpu and fps variance is absolutely due to that, if Ive done them one after other then the fps would gradually decrease

So this way is perfectly consistent imo

try it out

Also in every run I noticed the HUD with squadron is missing for me between 78ish and 100ish seconds, so it means it is consistent

pete910 · 31 Jan 2014 at 01:49

That's damn close TBF . Should serve as a base at least now.

Gregster · 31 Jan 2014 at 05:42

Well done DL. If people want to run that and post results, I will start to do a results system

Just one thing, I noticed my unit count was quite a difference to yours but see how it goes. Here is my run for verification.

===========================================================
Oxide Games
Star Swarm Benchmark - ©2013
C:\Users\Greg\Documents\Star Swarm\Benchmark_14_01_31_0555.txt
Version 0.95
01/31/2014 05:55
===========================================================

== Hardware Configuration =================================
GPU: NVIDIA GeForce GTX TITAN
CPU: GenuineIntel
Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz
Physical Cores: 6
Logical Cores: 12
Physical Memory: 17122181120
Allocatable Memory: 8796092891136
===========================================================

== Configuration ==========================================
API: DirectX
Scenario: ScenarioCustom.csv
User Input: Disabled
Resolution: 1920x1080
Fullscreen: True
GameCore Update: 8.4 ms
Bloom Quality: High
PointLight Quality: High
ToneCurve Quality: High
Glare Overdraw: 16
Shading Samples: 64
Shade Quality: Mid
Motion Blur Frame Time: 16
Motion Blur InterFrame Time: 2
Detailed Frame Info: Off
===========================================================

== Results ================================================
Test Duration: 120 Seconds
Total Frames: 4724

Average FPS: 39.36
Average Unit Count: 3651
Maximum Unit Count: 5330
Average Batches/MS: 1360.94
Maximum Batches/MS: 2034.88
Average Batch Count: 35721
Maximum Batch Count: 75023
===========================================================

spankingtexan · 31 Jan 2014 at 06:48

Can't take this bench seriously yet, gpu usage really low, no sli, My gpu hit 99% for a millisecond then the rest of test was at like 30-40% usage.

Gregster · 31 Jan 2014 at 06:53

spankingtexan said:
Can't take this bench seriously yet, gpu usage really low, no sli, My gpu hit 99% for a millisecond then the rest of test was at like 30-40% usage.

Same for me. I tried PGI's fix but the bench locks up at the very start

spankingtexan · 31 Jan 2014 at 07:19

Wondering how well optimised this bench is for Mantle, while crippling DX, as PGI said, I hope they haven't deliberately doctored it to make DX look pathetic. Time will tell I guess.