The Machine Learning Thread

[MTA99]

Are you able to give examples of the metrics you record?

Are they traditional hardware stuff like CPU, GPU, memory usage, IO etc. or LLM specific?

 

[gpuerrilla]

Very interested in getting a discussion going here. I work extensively with LLMs in my day job

It is a great topic, I have identified myself that whether or not the employer invests that I need to spend a bit more time on API's these days. What tools are you using and the hardware?