HNHacker News
TopNewBestAskShowJobs

soumyadeb

627 karma · joined June 30, 2011

Founder of RudderStack, an opensource alternative to segment https://github.com/rudderlabs/rudder-server/
submissionscomments
soumyadeb··on You’re not anonymous. I know your name, email, and company (2012)
Unfortunate but this is a very common practice in the ad-tech world. Companies like LiveRamp rely on this "signed-up-email-sharing" between publishers to make their email onboarding products (via which they are able to map email to cookie).

Well, they claim to be privacy aware and won't let you map < 20 emails to cookie at a time but it's pretty easy to bypass that.

soumyadeb··on WhiteHat Jr’s founder files $2.6M defamation suit against critic
Founders, hiring managers in this group can play a big role in stopping this fraud. Maybe we should publicly call out WhieHat Jr in our job postings? A single statement like "A degree from WhiteJat Jr. won't impact your chances of getting hired" can go a long way.
soumyadeb··on Palo Alto Networks sends cease-and-desist letter to take down review videos
Most likely than not, they have legal basis for what they are asking for. Check with your lawyers and if they agree, you should just accept and move on. The distraction (and cost) of having to fight a legal battle to have a comparison page on your website is just not worth it for most startups.

We are a tiny company building an open-source alternative to an existing SaaS app and we have received two such letters in the last 6 months. First time I just replied in an email, second time I had the lawyers respond to create a legal trail. I don't think we were at fault in both the cases but it is still not worth it.

soumyadeb··on Emerging Architectures for Modern Data Infrastructure
Indeed. Even when you have the full identity graph in warehouse and just want to assign a cannonical-ID (by doing a transitive closure), it is not easy in SQL. We wrote a blog on it (sorry for the shameless plug) https://rudderstack.com/blog/identity-graph-and-identity-res...

Creating the ID graph is a next level problem altogether!!. How do you know a record in Salesforce is the same as the anonymous visitor on your website. Requires joining across at-least 3 (possibly more IDs) - anonymousID, userID email (if the user signs up) and Salesforce record email.

Should the data pipe do this automatically? If not, what API abstraction should be exposed to the user?

soumyadeb··on Emerging Architectures for Modern Data Infrastructure
That's a great point. On similar vein, marketing teams too are increasingly data driven and would tools like Braze, CustomerIO etc to run personalized data driven campaigns. Support teams are using tools like GainSight

All these tools need to be fed data about user behavior - from apps, server backends, other tools etc. It's a messy data connection problem, not just one way from SaaS to warehouse. Mobile App->SaaS; SaaS->SaaS; Warehouse->SaaS; SaaS->Warehouse and so on.

soumyadeb··on AWS forked my project and launched it as its own service
I hear you but GPL makes it hard for everyone else (most companies have policies against GPL). We run an open-source project and it's AGPL licensed for the exact same reason. But lot of orgs have blanket ban on AGPL.

Maybe there is a way to define "bad" practices in OS outside of license. Similar to how monopolistic practices are banned in business because they are unhealthy for the broader ecosystem. Just asking

soumyadeb··on AWS forked my project and launched it as its own service
Can there be a license - Permissive Open source for the rest of the world except the cloud providers? Or some kind of anti-monopolistic rule to protect open-source?

The cloud providers taking over open-source projects, launching their own forks (with restrictive licenses) etc isn't great for the open-source ecosystem. If you take away the incentives for the developers (respect, fame, etc) to write open-source software, then isn't it kind of doomed in the long run?

soumyadeb··on Why Twilio Acquired Segment
Got a free trial key. Didn't know they had a min requirement
soumyadeb··on Why Twilio Acquired Segment
Beyond the developer friendly aspect, I would think running a payment infra is very different business than running SMS/email/integrations? Former has lot of challenges around compliance, fraud etc too.

If Twilio wants to own the entire developer ecosystem, maybe they will do others like APM first (Datadogs etc)?

soumyadeb··on Why Twilio Acquired Segment
I have tried bandwidth.com before. They are cheaper and claim they own the VOIP infra so can afford to be.

https://www.bandwidth.com/twilio-alternative/

For a fun project though so can't comment on uptime etc. However, if they are powering the VOIP infra behind the other providers, should be good I guess?

soumyadeb··on Why Twilio Acquired Segment
Never used Sendgrid (have always used mailchimp) but was it also considered very developer friendly?
soumyadeb··on Twilio set to acquire Segment for $3.2B
Yes, we can :) But we require you to provide an S3/GCP bucket where to dump all the data for replay.

We are also working on a functionality where we can replay from your warehouse too.

soumyadeb··on Twilio set to acquire Segment for $3.2B
Segment published a report on tool usage. "SMS and Push" was @ 12% and was not in the top-10. Even in the "SMS and Push", there was Braze/Iterable etc but no Twillio.

https://segment.com/blog/customer-data-platform/

This is not surprising. The personalized SMS/push notification use cases (for which you need Segment data) are commonly implemented via marketing platforms (like Braze etc) as opposed to directly via Twillio.

I think this was the other way around. Twillio is powering a lot of these new age marketing automation tools. Instead of just being at the infrastructure layer, it wants to go up the stack and own the marketing applications. Sendgrid and now Segment acqusitions are part of the same strategy.

They did the same thing for the contact center (call center) software space. Lot of the cloud contact center companies were using Twillio and now they launched their own contact center product. That has been one of the key drivers in their 3x increase in valuation in the last 1 yr.

https://www.twilio.com/use-cases/contact-center

Segment's partners like Braze etc should be worried.

soumyadeb··on Twilio set to acquire Segment for $3.2B
RudderStack (https://rudderstack.com/) founder here. We have a different pricing vector (event-volume vs monthly-users/MTUs of Segment) so it's not directly comparable. Having said that, RudderStack can be much cheaper in two scenarios

1) Low # of events per users. For example, if you have a lot of anonymous users who don't do many events and leave. In this case, you may have a lot of MTUs but low number of events. True for a lot of consumer businesses.

2) You have a huge scale (10s to 100s of millions of events per day). In that scenario, we support deploying enterprise RudderStack inside your VPC but still managed by us. In this case, we don't have to incur infra/data-transfer cost (and charge 80% margin) so can be much much cheaper. We have a couple of customers in this model. Some choose this for privacy/security reasons.

In normal scenarios too we can be 50% or more cheaper. Unlike Segment, we don't store any data (which is a major cost) so our COGS are quite lower. We use your warehouse for all the CDP features.

soumyadeb··on Twilio set to acquire Segment for $3.2B
Wow, congrats to the team @ Segment. This is very well deserved - they created this category. Also, looks that Twillio is investing big time in owning the marketing stack.
soumyadeb··on Why is Snowflake so Valuable?
Sorry, I didn't clarify well. I am sure it scales technically well but not on cost.

My experience of TD is > 10 yrs and then the multi-node version was substantially more expensive than the single-node version. Also, storage and compute was coupled which meant I had to pay for nodes even if 99% of my data was cold. That's a problem with RedShift too but not for Snowflake.

De-coupling storage and compute was a brilliant move by Snowflake. BigQuery can completely abstracted compute - you don't provision compute and only pay for data scanned. However, it gives you a sense of insecurity around cost - A single bad cron job running a query every sec can blow up your cost (real-life experience). Snowflake provides the best cost/performance tradeoff I have seen.

soumyadeb··on Why is Snowflake so Valuable?
That's interesting. I thought Vertica's pitch was real-time analytics for which draditional disk based data-warehouses are too slow.
soumyadeb··on Why is Snowflake so Valuable?
People are excited about Snowflake because it can completely disrupt the traditional data-warehouse market.

The legacy players like Teradata and Exadata (from Oracle) really don't scale. Teradata has ~2B in revenue, Exadata is probably in the same range. That's all up for grabs but that's only scratching the surface.

Historically, only transactional data was dumped into the warehouse. Snowflake is selling storage at S3 price (plus you get compression so often ends up cheaper) while they are making money of compute/query. If they can provide all the right query abstractions (SQL, full-text search), in theory all data can be thrown in Snowflake. Yes, tech savy bay area companies can setup their own stack using Presto etc but rest of the world is not like that.

soumyadeb··on Grouparoo: Open-source app to sync customer data with 3rd party tools
Congrats guys from the team @ RudderStack. Glad to see more open-source products in this broad customer data space.

Is it fair to say this is more like the Segment personas's product? We see a bunch of use cases for personas (which we don't have in RudderStack) so can point to you guys.

Congrats again on the launch.

soumyadeb··on Grouparoo: Open-source app to sync customer data with 3rd party tools
Founder of RudderStack here. Totally agree that data warehouse is messy but marketing systems are way more messier. In my previous startup, we did a bunch of Marketo implementation and issues I ran into

1) generating a simple report (like how many people came to your website and then opened your emails in last 1 yr) used to take for ever. Storing data was costly.

2) You could not generate complicated reports, say combining marketing + product data (e.g. number of people who came through campaign X and did used the product)

3) You were stuck with their not-so-great UI.

4) Analytics is one use case. Segmentation is another. If you want to create a segment of users (e.g. customers using the free tier of your product and have become active in last 7 days) and sync that segment to multiple destinations like email, salesforce etc, there is not a great way to do that from all the marketing systems.

On the other hand, if you can get all the data in your warehouse, you can use the best of breed tools for storage (Snowflake etc), Visualization (Looker/ChartIO/Tableau) and so on.

But you would need a product like Segment, RudderStack (and now Grouparoo) to get the data into the warehouse and sync it from warehouse back to different destinations.

soumyadeb··on Show HN: SQL Generator for Segment/RudderStack Event Data
Thanks for pointing. Fixed it now (it was a private repo)
soumyadeb··on Show HN: EventNative – An open-source, user event collection service
RudderStack founder here.

Because we are Segment event structure/API compatible, there is an inherent structure in events. You can pass arbitrary JSON but only inside the properties or traits field of track/identify call. We do automatically create the schemas for those cases.

Congrats on your launch!! Glad to see more projects in this space. Would love to checkout your repo and share ideas etc.

soumyadeb··on Ask HN: Is using master/slave terminology anti-diversity?
master/replica sounds perfect to me. That should be fine I guess?
soumyadeb··on Ask HN: Is using master/slave terminology anti-diversity?
Thanks for the pointer. Missed that thread
soumyadeb··on Ask HN: Is using master/slave terminology anti-diversity?
Ah, that sounds much better
soumyadeb··on Ask HN: Which tools have made you a much better programmer?
I started my career programming in Vim on VT100 terminals (https://en.wikipedia.org/wiki/VT100) - yes, I am old.

There was no IDE, auto-complete, visual debugger etc. You really had to think before you typed any code. Even fixing compilation error was a pain - you had to note down the line number and the error, go back and open vim, fix the error, exit vim, re-compile and rinse and repeat. Taught me the paradigm of thinking hard about the problem before starting to code and I think that has helped a lot.

This was still better than the punch-card days I have heard but I personally never had the experience.

soumyadeb··on Thank HN: My startup was born here and is now 10 years old
Congrats and thanks for sharing your story. It's just amazing how many startups this community has helped built.
soumyadeb··on How we raised $3M for an open source project
Congrats guys. Great progress in a very short time!!

We @RudderStack also raised a round recently. Glad to see investors putting money in Open-Source projects.

soumyadeb··on New York Times phasing out all 3rd-party advertising data
Is there any data to show that audience segment based advertising works better than content-based advertising?

We can target an audience segment, (say men over 35) and show them same advt on all the pages I view. Or we show ads which are relevant for the content I am reading right now - if I am reading travel stories, show me travel ads.

Is the concern that we won't be able to sell all the inventory doing the latter?

soumyadeb··on Ask HN: People who rejected a FAANG offer. Why?
Rejected a Google offer in 2008 to join a company called DataDomain. I had just finished my PhD and my co-advisor was in Data Domain so it wasn't a very hard choice. At that point, Google also didn't assign you a team before joining so the choice was between join an unknown team at Google VS go and work for someone I knew and respected. Also, Google paid well but wasn't as crazy as things today.

Learned a lot at DataDomain as it scaled from a reasonably small team to a large enterprise and eventually got acquired. Financially though, would have fared much better in Google (assuming I had stuck around).

← PreviousPage 4 of 8Next →