When translating from C++ to Python, 67.2% of TransCoder’s generations returned the expected outputs.
When translating from Java to C++, 91.6% of TransCoder’s generations returned the expected outputs.
When translating from Python to Java, 56.1% of TransCoder’s generations returned the expected outputs.
When translating from Python to C++, 57.8% of TransCoder’s generations returned the expected outputs.
When translating from Java to Python, 68.7% of TransCoder’s generations returned the expected outputs."
Probably beats standard models but at first glance still seems far from useful for any sizable project.