151 karma · joined November 27, 2019
Across every single metric, trans people, especially trans POC face disproportionate adversity. i.e. income, murder rate, housing insecurity, education etc...
I left my old company and wanted to start a competing business in a different vertical in the e-commerce space. What actually stopped me was the privacy and inventions and non disclosure agreements.
Pretty much it prevented me from using any know how I learned while at my last company and disallowed me from using any of the same suppliers and marketplaces to buy and sell on (of which there are few in my business domain).
In my experience, these types of agreements can be the actual thing that stops you from doing your own thing.
I suck at UI/UX design and don't want to write a bunch of JS for async webapp stuff, so retool is a force multiplier there and would highly recommend. I Don't want to manage any infra, so appengine handles that for me. After getting everything setup with terraform in a day or so, I spend all of my time developing core functionality and 0 time managing servers or getting a UI to do what I want it to do.
Total cost to host is < $100
I 100% support siphoning as much money as possible while doing as little work as possible (a.k.a coasting). However, from a capitalist perspective, it makes sense to try to weed those people out. Gone are the days of a 26 year old making as much as a neurosurgeon while working 20 hours a week.
Tier 1: Outrageous comp and difficult interviews. Tier 2: Great comp and medium level difficulty interviews. Tier 3: Companies that pay at or below average for an engineer and sometimes don't even have a coding interview!
for the tier 1s I was outright rejected my application twice as often as before. I also noticed that they are more selective. I've passed "high bar" technical interviews before, so have some understanding of what it takes. This time around I thought I did pretty well, but didn't get an offer (coincidentally at Google). More candidates + focus on cost cutting has made things much more competitive for really high paying jobs.
For those tier 2/3 jobs they are exactly the same as before. Recruiters constantly messaging and got an offer after only being on the market for a couple of weeks.
https://github.com/InteractiveAdvertisingBureau/USPrivacy/bl...
There's also a requirement that you have to delete data from downstream vendors that you've shared customer data with. That being said, I wouldn't trust for a minute that companies are complying with 3rd party deletions
I'm now at a tiny company without the infra to support Airflow, so I tested all the managed airflow providers (Composer, MWAA, and Astronomer) and ultimately settled on Astronomer. I also spent some time creating a framework that generates Dags from configuration and now 90% of my new etls just involve creating a config and a sql query. Pretty happy with my current setup and my only complaint is that Astronomer won't let you exec into a Task pod, which is actually kind of a big deal, but still better than having to manage a k8s cluster.
There are deliberate attempts by politically and monetarily motivated groups to spread objectively false propaganda. FUD/HODL to mislead investors, conspiracy theories to sway public opinion, pseudoscience to peddle ineffective medical treatments... The people doing this effectively aren't individuals disagreeing with mainstream discourse, they know exactly what they're doing.
Let me know how I can reach out to you!
Scraping facebook is an operation. One I wish to make happen one day :D
> actually appreciate it that YouTube seems to suppress ads that target political topics
I think that youtube should be suppressing shitty adds, not potentially decisive content. The way they are currently handling the situation signals to creators from marginalized groups that they should not talk about substantive issues if they want to get paid.
This is disheartening as it is ironic because Google (and literally every other mega corporation) tries to posture themselves as being socially conscious, but as soon as people want to talk about injustice or inequality, they are essentially soft-deplatformed.
> even if the blocklist is still incomplete
I might be a little cynical, but I feel like it is complete because it's working the way they want it to. The one-sidedness of the blacklist doesn't tell me that google is discriminatory. It tells me that the companies buying ads are discriminatory, and google changes their policies to make them happy. Google's tacit acceptance of prejudice tells me everything I need to know about their principals.
But the real world is so much more complicated and that it is the real gatekeeper. I've taught several non-technical people how to code, and the biggest first hurdles usually are: setting up their dev environment, installing dependencies, understanding the command line.
I think it's interesting that explaining why you have to add things to your $PATH is harder than explaining how an if statment works.
>It should be impossible to comment referencing someone else without a signed waver from the participants
If the comment is a nude picture of myself and I didn't give you permission to post it the law already agrees that this should be illegal. All I'm asking is to make it enforceable.
Porn is shady industry ripe with abuse and exploitation. How do you know the person you are watching is over 18? Let me answer that... You don't. Some industries should be given more regulatory scrutiny than others.
Being a victim of revenge porn means that you can be blackmailed at anytime. Most people do not want to be sexualized, and it's humiliating to have to live with the fact that your coworkers will now have ammo to harass over you if they discover your videos. Don't get me started on what happens if you have kids, and their friends find out you were in porn.
Realistically, you can't scrub the internet of a video. I personally feel like the solution is that porn should be highly regulated. A formalized content upload process, licensing, required staff to deal with these types of complaints. It should be impossible to upload a video without a signed waver from the participants. Sure, this might remove pure anonymity, but you can still have mechanisms in place to protect your identity if you want to make amateur content without divulging your identity to the public.
If it's a static website that has consistently structured HTML and is easy to enumerate through all the webpages I'm looking for, then simple python requests code will work.
The less clear case is when to use a headless browser vs reverse engineering JS/server side APIs. Typically, I will do like a 10 minute dive into the client side js and monitor ajax requests to see if it would be super easy to hit some API that returns JSON to get my data. If reverse engineering seems to hairy, then I will just do headless browser.
I have a really strong preference for hitting JSON apis directly because, well, you get JSON! Also you usually get more data then you even knew existed.
Then again, if I was creating a spider to recursively crawl a non-static website, then I think Headless is the path of least resistance. But usually, I'm trying to get data in the HTML, and not the whole document.
It was an accident. I needed to accomplish an admin task which required modifying a SQL query someone else wrote. I just fully dove into SQL mainly for reporting purposes after that.
>What are you doing at your job? Is it everything you dreamed of and more?
I am a data engineer for a unicorn startup. It is really awesome! The pay is ridiculous, especially considering I live in a low cost of living area but have a standard tech SF salary. Also the talent is insane. I get to interact with some really smart folks.
> How did you break that first-job barrier?
I saw the opportunity to automate an admin problem with a SQL query. I asked a developer to pretty much be my senpai, and he gave me an SQL crash course. After that, I did SQL tutorial after SQL tutorial and eventually got promoted from call center agent to data analyst.
>What were you doing before this?
I was a call center agent and working at a car wash right before that. That was like 5 years ago :D
>Any tips for the rest of us?
Get in touch with your companies IT/engineering department if you can. Lots of software people love curiosity. Try to find someone like that where you currently work. Also, do a lot of projects and be prepared to feel really confused about how things work. I think I would not be where I am today if I didn't have some really good mentors. Secondly, programming tutorials will have you believe that the world is just a bunch of for loops and if statements. But then you look at a real life production system and it's wayyyyy more complicated than that. Just know that the minimum amount of knowledge you need to have a software job is probably a lot lower than it would seem. Don't be discouraged when you feel like you have no idea how something works because it will happen a lot.
Of course, sometimes obfuscating how your website works can make it needlessly more complicated, so it's a trade off.