Locate the four turbo multipliers (core 1/2/3/4) in the BIOS, and bump them all up to 45 (4.5GHz). Don't touch the main CPU multiplier for now. Turbo multi OC is ideal for 24/7.
Locate the ring/cache/uncore (same thing called different names by different board makers) multiplier and bump that up to 44.
Begin a process of upping those values by 1, and restarting the computer, until you can't boot into Windows or it crashes shortly after booting into Windows. When that happens, reduce the values by 1 and begin benchmarking/stress testing. Stuff like Asus RealBench, Cinebench, Firestrike.
If all goes well, you'll have discovered your stable overclock at stock voltages.
From there, if temps are within reason, you can start increasing the Vcore along with upping the multiplier values by 1, etc. To see the max stable overclock you can get without too high temps/excessive voltage. Try to stay around 1.35 Vcore max for now. There might be more wiggle room but that's a good target to begin with.
The ring/cache multiplier is debatable. I like keeping it 100MHz behind the cores, but you could leave it on default till you find your max cores overclock.
Same for the RAM, you may want to run it at the motherboard's default speed (usually 2133/2400 unless your RAM XMP's by itself) till you find your max stable OC.
Make sure to have voltage/temp monitoring programs like HWiNFO64 and CPU-Z, and keep an eye on them while you test. Especially Vcore value and CPU temp, along with the CPU frequency.
Which RAM and which mobo are they?