Really depends on the license. If its something like the Apache 2 license, then you can do want with code. If its something like the GPL then you need to give back any changes AND your code that uses the GPL code (more or less).
GPL3 attempts to make it a bit clearer. AGPL as well.