We were angry about losing, from our perspective, our homeland. The Canal Zone police force was disbanded and the PDF (Panama Defense Forces) started patrolling my home town. More and more Panama encroached on what I thought of as my homeland. During Noriega I was convinced Panama would run the canal into the ground.
I went back to Panama 8 years ago and I was pleasantly surprised at the progress the country has made. They've done a great job in running the canal and the country has noticeably benefited from America's withdrawal. My anecdotal experience is that colonialism is bad. Even in benign forms.
I talked with an elderly rabiblanco the last time I was there. He said America leaving made Panama grow up. By all indications they have done so and I'm glad to see it.