We're working on this exact problem at Empirical http://empiricalci.com

We're building a way for CS researchers to run, share and compare experiments including their whole research environment.

We just applied to Apply HN and would appreciate your feedback: https://news.ycombinator.com/item?id=11586948