Surely ruby's blocks are much better here. For one they're a much more general construct than with, and second exception handling is done with normal language constructs like rescue and ensure. Implementing one is simple and obvious and is nicely contained in a single method.
For example
File.open(args) do |file|
# use file
end
And the implementation is simply def self.open(*args)
file = File.new(*args)
begin
yield file
ensure
file.close
end
end