Got any standardized methods that could be automated/scripted under a clean Windows environment and doesn't require internet access / licensing? Give me a shout - ian@anandtech.com
And like the other comment said, you can probably get complimentary copies of the IDEs from Jetbrains to run benchmarks with. They're also scriptable which helps.
1 .https://dotnet.microsoft.com/download/visual-studio-sdks
I'm sorry, I wish I did! Interest in hardware performance is only a relatively recent interest of mine. I especially think the IDE tests would be a bit challenging as I'm not even sure how to instrument or measure those. I might reach out to the Intellij folks to see if they have any ideas..
> under a clean Windows environment
Ah, shucks. I haven't touched Windows in years :). That's the tricky thing: according to Stack Overflow's surveys, only about half of software developers use Windows. The other half are split evenly between Mac and Linux. Covering all three platforms would likely be a challenge.
> Give me a shout
Thanks! I'll do some research, and if I have something more concrete I'll be sure to pass it along.
user@host$ (time make -j[insert number of threads]) 2>logfile.txt
Compiling Visual Studio Code Typescript could be an interesting target too.
There should be a large open-source C# and/or Java project out there that can be compiled as well.
My limited experience using Node worker threads (to compile small React apps with WebPack in parallel) showed lots of overhead and memory usage for just starting the build (Node and library instances, can't say in what proportion), although it is still worth the expense.
[0] https://github.com/microsoft/TypeScript/blob/master/scripts/...