Yes, but there are downsides to cash which Bitcoin solves.

For example, crossing country borders with more than $2k-$5k in cash is a felony many places. Bitcoin, however, is as blind to borders as TCP/IP.

Yes, cash is more anonymous. Though, large deposits and withdrawals of cash receive more scrutiny.