As I said: skewed demographics, certainly. Outright racism? Quite possibly.
I'm not questioning your views specifically. I'm making a comment on my own informal, but long-duration, observations of composition of technical vs. unskilled positions.
If you can provide racial demographics on people holding janitorial positions, please do.
There are numerous studies which show hiring biases for identical resumes with different names attached to them:
"Employers' Replies to Racial Names"
http://www.nber.org/digest/sep03/w9873.html
Job applicants with white names needed to send about 10 resumes to get one callback; those with African-American names needed to send around 15 resumes to get one callback.
"Should you be concerned with name discrimination on your resume?"
http://www.techrepublic.com/blog/career-management/should-yo...
"How an ethnic-sounding name may affect the job hunt" http://www.theglobeandmail.com/report-on-business/careers/ho...
My experience with janitorial and housekeeping staff through much of the US, including the west coast, is that they're frequently economically disadvantaged minority or immigrant in ethnicity. It's a low-education position.
http://www.bls.gov/ooh/Building-and-Grounds-Cleaning/Janitor...
Finding specific references to ethnic composition is difficult, but the incidental evidence is strong:
White janitors are exceptional and notworthy: "Even the Janitor is White" http://eric.ed.gov/?id=ED534328
A union history of west-coast janitorial labor organization emphasizes Mexican and Hispanic groups: "Unions and the Fight for Multi-Racial Democracy" http://dbacon.igc.org/Unions/11mulrac.htm
Working-class power will determine especially if this democracy represents the needs of African-American, Asian, Latino, Native American and other people of color, who are overwhelmingly working-class themselves.