HNHacker News
TopNewBestAskShowJobs

gwittel

453 karma · joined August 29, 2019

Computer security Anti-spam / malicious content filtering Backends Scaling

glwittel [at] gmail [dot] com

submissionscomments
gwittel··on DOE announces breakthrough in residential cold climate heat pump technology
For reference, here’s what we have: 36KBTU AIRHANDLER/HEATPUMP HI-STATIC M SERIES DUCTED SYSTEM INDOOR MOD# SVZ-KP36NA OUTDOOR MOD# SUZ-KA36NA2

It’s a slightly older model as we had height restrictions to work around. This prevented us from getting a newer or hyper heat model. IIRC ours had good efficiency into the 20F range which was plenty for us.

In comparison, the Trane dropped efficiency at 50F and needed heat strips at that temp (so pretty crap).

gwittel··on DOE announces breakthrough in residential cold climate heat pump technology
I found it in their catalog. You’ll need your model or series. After all the specs there were some efficiency/temp tables. It was under Pros (vs homeowner) -> USA -> product support -> catalog -> m and p series.

Catalog:

https://mylinkdrive.com/viewPdf?srcUrl=http://enter.mehvac.c...

pocket guide:

https://mylinkdrive.com/viewPdf?srcUrl=http://enter.mehvac.c...

gwittel··on DOE announces breakthrough in residential cold climate heat pump technology
I used Mitsubishis site to find the local “diamond” contractors (those factory trained and do enough volume). Then cross referenced vs yelp.

https://www.mitsubishicomfort.com/find-a-contractor

I see a few in Portland and several in nearby zip codes. Hopefully one can work for you. There are different tiers of “diamond” so you can compare if the difference matters to you.

One thing that’s a bit different is the air handler and outside compressor run on one circuit (mine is a 3 ton unit). So there’s a power line between the 2 units. That threw off our city inspector. But it works out nice since I now have an extra 20A breaker free :)

gwittel··on DOE announces breakthrough in residential cold climate heat pump technology
Many of the Mitsubishi heat pumps work with central ducted systems just fine. I have one (replaced a central gas heat, electric AC system). It’s just a different air handler but the heat pump was the same as would have been used in a mini-split install.

When cross shopping the Mitsubishi vs Trane, the Mitsubishi was miles ahead. I didn’t even get the most cold weather efficient option (not needed for my climate).

gwittel··on How City Museum defied building codes to become a St. Louis landmark
If you have a chance to go (with kids or not), do it. It’s an awesome experience. Though, I might suggest knee pads if you’re tall.
gwittel··on Twitter CEO: “Let’s talk about spam, with the benefit of data, facts, context”
The conversation we should be having is where are we now, and what is good enough?

Having worked in large scale anti-abuse detection for most of my career (~18 years), the points mentioned line up in the Twitter thread align with my experience. Scaling in this area is hard. 99% efficacy sounds great, until you say 99% out of millions/billions. The amount of FNs ('bad' or unwanted things) is still substantial enough for users to notice. Taking a 229m active user count [1], 99% fake account detection efficacy sets you at 2.2m fake accounts. Looking into tweets/day you've similarly large numbers if you want to look at content detection.

Twitter can most likely do better given the right resources, people, and leadership support (Facebook has similar problems aligning all 3 of those). Once they have those, the open question is how much better they can get. Each incremental increase in efficacy gets more expensive.

To top it off, as detection gets better, you think those abusing Twitter will sit still? Of course not, they'll change tactics (content, usage of hacked accounts, etc.).

[1] Twitter 10-Q 2022-Q1 - https://www.sec.gov/ix?doc=/Archives/edgar/data/0001418091/0...

gwittel··on We need a middle class for startups
I can’t speak for ipinfo, but in comparing free vs commercial data only very basic geolocation by IP is public. This might be due to the IP block allocation (country/region/city) or handy things like ISPs that use geo names in the host name. Many other ranges are opaque blocks or allocated to something like a reseller, etc.

Getting finer grained data down to smaller groups blocks is harder and not public.

Packaging it up into easy to consume (normalized) is yet another layer of work.

gwittel··on Ask HN: Who is hiring? (May 2022)
TwinWave | Sr Software Engineer | REMOTE (US) | Full Time | https://www.twinwave.io/

Want to have fun while helping keep the world safe from cybersecurity threats?

TwinWave is looking for a senior software engineer to join our development team. We are passionate about creating products that solve real problems and help protect organizations from the security threats they face every day. This drive to build amazing products has resulted in a loyal customer base that includes some of the world's largest banks, insurance companies and other Fortune 500 organizations.

We are looking for someone with 5+ years professional experience as a Software Engineer to join our core development team. This team is responsible for all layers of our product stack, from our front-end UI to our back-end services. Daily responsibilities will include:

- Designing and developing code in Go, Python and Javascript/Typescript (React) to bring exciting new functionality to our customers

- Working in a team environment to decide what engineering work will best help our product, and planning to accomplish it together

- Observing our product in action and taking action to improve its operation

- Focusing on creating testable, maintainable and secure code using best practices

- Contributing to our CI/CD and DevOps technologies to improve our developer and operational experience

TwinWave pays market competitive salaries based on experience and qualifications. The salary range for this position is $150,000 – $200,000 along with participation in our bonus (profit sharing) program.

At TwinWave we truly believe in work life balance. We want people to take the time outside of work so that they can recharge and do their best work when they are working. We offer fully paid health insurance, 401k, flexible hours and lots of time off.

Interested? Please send your resume to: jobs@twinwave.io

https://www.twinwave.io/jobs/

gwittel··on Ask HN: What happens to unvested grants at Twitter?
Unfortunately It depends on the agreement. You could get nothing or something. There will have to be an SEC filing with details soon.

More commonly, twitter will try to do something to prevent people from jumping ship. It’s likely your RSUs will be converted to cash grants. Then they might vest as cash awards on a schedule. The vesting may be on the same as RSU schedule or different.

gwittel··on Ask HN: Who is hiring? (April 2022)
TwinWave | Sr Software Engineer | REMOTE (US) | Full Time | https://www.twinwave.io/

Want to have fun while helping keep the world safe from cybersecurity threats?

TwinWave is looking for a senior software engineer to join our development team. We are passionate about creating products that solve real problems and help protect organizations from the security threats they face every day. This drive to build amazing products has resulted in a loyal customer base that includes some of the world's largest banks, insurance companies and other Fortune 500 organizations.

We are looking for someone with 5+ years professional experience as a Software Engineer to join our core development team. This team is responsible for all layers of our product stack, from our front-end UI to our back-end services. Daily responsibilities will include:

- Designing and developing code in Go, Python and Javascript/Typescript (React) to bring exciting new functionality to our customers

- Working in a team environment to decide what engineering work will best help our product, and planning to accomplish it together

- Observing our product in action and taking action to improve its operation

- Focusing on creating testable, maintainable and secure code using best practices

- Contributing to our CI/CD and DevOps technologies to improve our developer and operational experience

Even though we are small, we truly believe in work life balance. We want people to take the time outside of work so that they can recharge and do their best work when they are working. We offer fully paid health insurance, flexible hours and lots of time off.

Interested? Please send your resume to: jobs@twinwave.io

gwittel··on Does DoorDash jack up prices even if your on a subscription?
Yes. IIRC some merchants might also do this to compensate for the fees DoorDash charges them.

Especially for pick up, I try to order direct with the restaurant to save them on fees. Their margins are slim enough already.

gwittel··on Ask HN: What are these low quality “code snippet” sites?
Pretty much this. It’s likely down to the lack of incentives for leaders and line workers. Ie: search spam volume isn’t a measure by which search team performance is graded
gwittel··on Former Facebook staffers launch Integrity Institute
(1) Thank you so much for doing this. Facebook has been after me for years (> 15 years in anti-spam/email abuse). I keep putting it off, but its time for a clear "no thanks". As an outsider saying "no" - is there anything I can convey to them to drive the message home?

(2) Minor - your "Join Us" link from the Founders Letter page is 404 -- https://integrityinstitute.org/join-us

gwittel··on Ask HN: How does Kubernetes modify/add API endpoints at Runtime?
Do you mean with respect to balancing when endpoints come/go (e.g. a POD goes up/down)? Or something else?

In this case, it depends on the ingress controller used. The default nginx ingress case has some docs: https://kubernetes.github.io/ingress-nginx/how-it-works/

Note that nginx-ingress has limitations as a side effect of its Lua balancer vs normal nginx. As an example, it does NOT do TLS-resume on the nginx<->service hop. Normal nginx would, but the lua balancer lacks the necessary code [1]. In some high volume scenarios, this can cause trouble on the backend.

[1] https://github.com/openresty/lua-nginx-module/pull/1312

gwittel··on Ask HN: Where do large companies register domains?
Mainly MarkMonitor. The main thing these services provide is high security around changes. They also offer a lot of things like brand protection related services.

Even bigger ones will sometimes run their own registry (like Google).

gwittel··on UPenn uses 3rd party to scan and rewrite all URLs in emails
Disclaimer: Involved in building these sort of systems so I can go on about a lot (though not as much detail as I'd like).

At this point, most security vendors that handle email do this (or offer it). The main reason for re-writing is its device independent. A browser plugin only gets you so far, and doesn't handle modern needs where devices that have mail access will be unmanaged.

The tradeoff is yeah, the URLs are ugly. There's a balance between highlighting where the URL goes, embedding the info necessary for redirects, preventing redirect abuse, per user policy, etc.

In the end, its all really about buying time. At mail delivery time, you can only get some % of threats. Given there's a gap between delivery, and click time, you can use that to your advantage and at least prevent some % of the user base being exposed to bad stuff.

On top of it all, you have all sorts of edge cases like what to do with things that aren't URLs, but mail clients turn into clickable links. What about URLs in attachments? \o/ Time to run away.

gwittel··on If software engineering is in demand, why is it so hard to get a job?
I do something very similar and it works quite well for anyone except fresh grads (I've a different variant for them).

I pose a situation and introduce the v1 code. They look for bugs and propose fixes. Then I add on a new feature, and they look for more bugs. I've maybe 4-5 levels overall each having different classes of bugs, some of more or less subtlety. Fits on one whiteboard / single piece of paper in the end.

There are no syntax errors, just logic. Errors are in categories like: robustness, failure handling (internal or external), data/thread races, unforseen side effects, etc. The more experienced you are, the more problems I expect to be found. A "I don't know" is just fine (and often the following discussion is MORE informative).

gwittel··on Toledo’s Last Swordmakers
I bought a kitchen knife there maybe 8 years ago. Lovely knife, surprisingly cheap. Still excellent; I wish I had bought more. It was so much cheaper than our other (german made) kitchen knives and just as good if not better.

Mr Zamorano was also super nice despite our limited spanish. Hint - get it wrapped well for travel. He asked if were traveling on rail/air and made sure the knife was nicely sealed. Sure enough, the RENFE folks found the knife and inspected it carefully before we could board.

gwittel··on High Voltage SID Collection – Commodore 64 music for the masses
Sadly I haven't had the time to keep up with SID music or demoscene in recent years. Just checked out Influx Deluxe -- very impressive. Hard to believe it came from just 2 SID chips.
gwittel··on High Voltage SID Collection – Commodore 64 music for the masses
What a nice surprise. I haven't heard about HVSC in ages. I can't remember when I first heard about it. Perhaps circa 1998-2000 while in college. There was a radio station (KDVS) where one of the DJs would spend his weekly slot playing SID music.

Anyway, nice to see its still around.

gwittel··on Bloom Filters: More than a space-efficient hashmap
Depending on how you look at it, bloom filters have been surpassed. In practice I find there are variables driven by implementation factors which can push bloom filters to the top choice.

Starting with language, you might not find what you need (eg vacuum is C only so far afaik). The complexity of the algorithm may force you to decide porting is problematic (understandability, effort, cost of verifying the port).

Then you goto the practical things. Do you need to handle: threads, merging, serialization, etc. after all this, you might find the only unicorn is bloom due to its simplicity, and wide implementation availability.

In my case, after lots of testing I ended up extending fastfilter Java’s bloom filter by adding merge (trivial in bloom), serialization, moving to XX3 hash, and simplified constructors. Doing all this in say Cuckoo or vacuum would have been a lot of work. I’m not certain if/how how merging might work in these offhand.

gwittel··on She risked everything to expose Facebook. Now she’s telling her story
The various teams in Facebook recruit under the surmise of helping protect people. Be it marketplace (payments), spam/phish/malware, inauthentic content, etc. For many, this is a strong draw.

Unfortunately, Facebook leadership has repeatedly shown that investing in this area is not a priority unless it hits their bottom line. I applaud Sophie for speaking out, I just wish it would make a bigger difference. In the end, I don't think Facebook will change their behavior will unless forced.

gwittel··on Show HN: Sioyek – PDF viewer for reading research papers and technical documents
Not the OP, but a related feature -- I could also see use in tying notes to a document or sentence.

Sometimes I "translate" a difficult passage to something I can understand (on paper I might write this in margins). At other times, I end up accumulating definitions of terms (or letters) while reading a paper. Today I write those on a separate piece of paper so I can have my definitions table viewable at all times. It would be really nice to have that sort of thing stored and available while I'm working my way through a paper (perhaps similar to the portal feature).

gwittel··on Ribbon filter: Practically smaller than Bloom and Xor
Correct. I've been going deep into this looking for a unicorn implementation friendly to distributed environments:

* Mutable - streaming applications

* Mergable - so you can avoid querying N filters all the time or share slices.

* Scalable - so you don't have to pre-size

* Performant

* Serialize to bytes

* Language - Implemented in multiple languages. Many are in C only which is suboptimal (and often too complicated to easily port).

* Bonus: Thread safe implementation

Typically you can get some of these, but not all. Sometimes its not just possible with the structure (e.g. mutability in xor filter), sometimes its an implementation gap (serialization, etc.)

In my case finding the magical combination in Java has been quite difficult. The only way was to do custom, and relax some requirements (like auto scalable structures).

After doing a lot of testing I ended up with pre-sized bloom filters behind an MPSC model. The tradeoff of having to monitor/pre-size filters is one I'm not happy with but weighed against other tradeoffs it made sense.

Cuckoo was far too slow (and merging was iffy), and I can get a huge speed increase switching and customizing implementations (Guava -> spark -> fastfilter), and also big boost using xx3 (or xxh) rather then murmur which is pretty popular in off the shelf implementations.

Porting CQF, and much of the latest research was just too much (and many implementations lack merging, etc so you have to really understand the structure to do it right).

gwittel··on Ribbon filter: Practically smaller than Bloom and Xor
This is an interesting structure. It’s important to note that it’s an immutable structure so it’s more comparable to xor filters rather than bloom in that aspect.

I’ve been looking for a simple but more efficient than bloom structure but many of the alternatives are quite complex (so hard to reimplement/port) or less performant. Still quite interesting. Will need to read this more closely.

gwittel··on Trump Says He Is Suing Facebook, Google and Twitter for Alleged Censorship
It is. See also “barratry” (common law).

In the end it has no merit. Trumps M.O. is to threaten legal action to get what he wants. Sometimes he follows through. In this case he gets his name in the news, and whips up his supporters. Now he can again claim he went after big tech. The details like merit and results don’t matter.

gwittel··on A foreign seller has hijacked my Amazon Klein bottle listing
Target has started this as well. It’s baffling that companies will so willingly work to destroy consumer trust.
gwittel··on Stop using your work laptop or phone for personal stuff, because I know you are
It depends on the MDM. My works' MDM required full access to my phone. That is the MDM software was fully capable of wiping the full device (not just the MDM data store). IT promised they wouldn't/couldn't do that; yet the app required the permissions. So yeah, noped right out of that.
gwittel··on I know the secret to the quiet mind but wish I’d never learned it
> poor science and poor scientific understanding of people on the M.D. track

Definitely a thing. At least historically, research is not a big part of a MD program in the US. MD/PhD programs are where its at -- Basically you do a few years of med school, then PhD, then finish MD. Its a very long haul. After which you usually go into Postdoc research or medical residency.

The best doctor I ever had was incredibly perceptive and compassionate. What did she teach in med school? How to work with patients (i.e. bedside manner). She moved on to head palliative care, another area where empathy is key.

Like any other profession doctors span a range of competency. There is an old joke: What do you call the person who finished last in medical school? Doctor.

gwittel··on Exponential Backoff and Jitter (2015)
Its not presented in a very clear way from the charts alone -- Here the goal was to reduce/optimize the amount of unnecessary 'work' done. There is an implied cost of handling more work where contention is the root cause of extra (unnecessary) work. We're basically saying "I'd rather have a little more latency vs handle X times higher load".

One common real world situation where this comes into play are things like thundering herd scenarios. Rather than trying to cope with huge bursts of traffic, we want to spread the load out in time.

← PreviousPage 2 of 6Next →