So what do you recommend for me?
Forget about Trixx and Afterburner for now.
Start with copy and pasting the below load of text into notepad and save as
Remove CCC Limits.reg
After you install the driver inc CCC, then reboot, then double click the 'Remove CCC Limits.reg' and press ok, then reboot again.
This way you just use CCC panel and you can't really fry your card as it won't let you overvolt it, just overclock it without the limits.
Manually set your fan to at least 70% in CCC, I would go for the full 100% myself to be sure, until you get a feel for the card and what kind of temps it gives off.
Try 850/1250, if it's fine, try 860/1250, keep going until you get sparklies/artifacts then back down to when it was fine.
Then start upping the memory to 1270 and add 20 each time, same way as you did with the core.
You can run Heaven to test it as Kombustor/Furmark is mental.
Here is the text to make the reg entry:
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Class\{4D36E968-E325-11CE-BFC1-08002BE10318}\0000]
"PP_PhmSoftPowerPlayTable"=hex:6f,01,05,01,00,04,04,10,18,58,00,68,00,b8,00,e8,\
03,e8,03,58,00,00,80,01,00,0f,00,00,02,08,3c,00,00,68,00,b8,00,00,18,01,09,\
00,18,01,26,01,83,01,00,00,a0,0c,00,00,30,01,40,01,4b,01,00,00,00,00,00,00,\
aa,00,00,00,78,00,00,00,60,ea,00,00,56,01,0a,00,00,00,14,00,00,00,00,00,00,\
00,01,01,02,03,02,02,02,04,03,02,02,04,80,38,01,48,e8,01,01,ff,7e,04,00,00,\
01,00,00,00,a8,61,00,98,3a,00,84,03,b6,03,00,00,01,00,00,00,50,c3,00,48,e8,\
01,e8,03,7e,04,00,00,01,00,00,00,68,3c,01,48,e8,01,01,ff,7e,04,00,00,01,00,\
00,00,34,1b,01,48,e8,01,01,ff,7e,04,00,00,01,00,00,00,08,00,00,00,78,00,00,\
00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,05,00,00,00,78,00,00,00,\
00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,04,00,00,7a,00,00,00,00,\
00,00,f0,d2,00,00,40,9c,00,00,00,00,00,00,00,00,00,00,00,7a,00,00,00,00,04,\
00,70,11,01,00,c0,da,00,00,00,00,00,00,00,01,06,94,11,c4,22,54,24,60,09,3c,\
0f,88,13,0a,00,d0,78,02,00,90,d0,03,00,03,40,9c,00,84,03,50,c3,00,e8,03,68,\
3c,01,01,ff,02,98,3a,00,b6,03,48,e8,01,7e,04,02,98,3a,00,84,03,48,e8,01,e8,\
03,04,84,03,11,00,00,00,e8,03,1a,00,00,00,4b,04,28,00,00,00,4c,04,28,00,00,\
00