pea

If you are comfortable writing Python, check out our open-source framework for creating data web apps: https://github.com/datapane/datapane.

It makes it simple to programmatically create serverless web apps from data, plots, and layout components, and you can embed them directly in your own product.

Here's an example of an e-commerce report: https://cloud.datapane.com/reports/dA9yQwA/e-commerce-report

Not a value judgement on either opinion, but, ironically, there is a buddhist perspective here which would rhyme with: that's exactly what you are doing in your normal life without children every second while chasing your ambition. And OP's solution of letting go of yourself is the antidote to that cycle.

If you are technical, I would recommend looking at the open-source Python ecosystem to create reports and dashboards. It has amazing analysis and visualization libraries (like Altair and Plotly).

We are building an open-source library to create data front-ends like reports and dashboards using Python (https://github.com/datapane/datapane). You could programmatically create a dashboard for each user and save it as HTML to something like S3. As the dashboards can be pre-rendered and static, they can scaled really heavily if you need.

I think many compelling companies come from rigorously testing lots of possible solutions for a problem that the founders understand deeply.

You might experiment and fail with 10 different ways to solve that problem, before one of them sticks. But the important thing for building the right solution is understanding the context, situation, nature of the pain-point, implications of it, and why the world would be better served if it was solved. The benefit of solving your own painpoint is that you often understand these things instinctively, but it's helpful to talk to other people to understand how it is different for them. From there, the first solutions should be to validate this -- maybe the first version is a Google form or a manual inbox (i.e. "What can we test in 1 week vs. 1 year?").

For an example from me, I previously had a start-up where we provided version control for PowerPoint documents. Our first iteration was way too complicated and we went in solution-first. We built all kinds of shit people didn't need, like slide-by-slide version control, git integration, etc. On your current site, I could ask people if they want a plugin into PowerPoint which gives slide-by-slide version control using git, and get a bunch of feedback on that specific solution. Instead, it would be more helpful to step back and try and validate that sharing PowerPoint documents over email leads to versioning problems. From there, maybe I could dig deeper into specific use-cases, verticals, and understand a wider problem space, before talking about how people need the problem to be solved. I think the learnings would be 100x more useful than getting some specific feedback on my myopic solution.

Similarly, I have found that users often love talking about their problems more than they love giving feedback on individual solutions.

Nice work on a cool side project! Just my 2c, but I would find this more useful as a place to validate and support early pain-points, as opposed to solutions. Validating that a genuine burning pain exists for a small group of people - with access to early adopters - would be really helpful, and I think would provide a nice play to do discovery. Going solution-first puts the cart before the horse imo.

Nice work! We had to solve this problem a few years ago and iterated through a bunch of technical solutions and rabbit holes.

Funnily enough, the best performing solution for users was having the two PDFs rendered as images with a slider to "switch" between them, and relying on the human eye to spot the differences.

It's still early in the space, but there are real advantages to defining visualisations, metrics, and reports in a code-first way. Aside from being able to do more powerful things with something like pandas as opposed to Tableau, being able to check your dashboards into git, create reusable libraries internally, review changes in PR format etc., goes a long way to making things reproducible and less of a black hole. Also, creating reports and dashboards programmatically opens up some interesting use-cases where a drag and drop tool would break down.

We're building an open-source framework for creating reports and dashboards using Python, which you might find helpful: https://github.com/datapane/datapane. You can think of Datapane as the view layer / interface for any BI analysis you're doing using the open-source Python ecosystem. Any feedback would be much appreciated!

Cisco has an interesting playbook with spin-outs as well, that I haven't seen many companies pull off (i.e. mpls multiple times over)

In this sort of deal, is it common for the buyer (or whoever is leveraging them) to purchase some sort of hedge to protect themselves from the stock price diving during the DD or legal process? For instance, if I agree to buy company for $X but buy LEAPS to protect me if it dips below X*0.75.

You might find the Python framework we've been working on helpful for that use-case: https://github.com/datapane/datapane. It allows you to create interactive HTML reports comprised of pandas DataFrames, plots, and UI elements (e.g. dropdowns, selects, pages).

Standalone HTML files provide a really nice alternative to PDF as they maintain interactively: you can host them static sites, allow people to download data, use plots interactively, click through pages, similar to a statically generated website. That said, there is still a definite blocker in non-technical people receiving a .HTML file over email and immediately thinking it's suspicious or a virus (doesn't help that gmail has such poor support for them.) It's a shame, because PDFs have so many warts and HTML can be used as a really nice distributable file format, especially as you can make them fully standalone by baking in datasets, plots, libraries, etc. so they can be used without network.

IMO Jupyter is great at what it is - a REPL - but, outside of sharing a step-by-step "here are the steps I took to come to this answer", isn't the ideal format for sharing insights, as there is no reason a report would follow the same narrative as the analysis itself.

That isn't what is happening here. Criminal barristers are not employed by the government for defence and the Criminal Bar Association is not a public sector union. For legal-aid defence, they are mostly self-employed and have the freedom to pick up cases as they choose.

The barristers in this case are stating that legal-aid cases (i.e. acting as a public defender) don't pay enough so are refusing to take the jobs. Much as how you could choose to not take a consulting job in your own profession, if you pleased.

Strangely, I've observed the same behaviour with people on the exact opposite side of the spectrum too (i.e. UHNW).

A friend of mine worked on superyachts which were £400k a week to rent. He said that without fail the owners would be penny pinching at the end over a few £ here and there (on food, drink, suncream etc.) Same with upper-class Brits who had hundreds of years of intergenerational wealth but won't turn their heating on until November.

Not sure what to make of this; I've often wondered if it is a form of bell curve.

Re your HTML point, we've been hacking on a framework which lets you programmatically create and share data reports in Python which you might find helpful (https://github.com/datapane/datapane). It supports Plotly, Pandas, Altair, Folium, MPL, etc., and provides some neat layout components like pages, selects, columns, and dropdowns.

If you need anything or want some help, feel free to make an issue or ping me on leo [-at-] datapane.com

I use a combination of Brave + Blokada which seems to work well (I haven't seen an ad in over a year, I don't think). Turning off Blokada is horrifying.

It's crazy reading some older press on this guy [0]. It seems he duped people who should know what they're talking about. How did they fall for it?

> "Dr. Serhat recently presented his research findings at the 2021 Conference on Retroviruses and Opportunistic Infections (CROI), regarded in the medical research community as the leading HIV and viral research conference in the world. His Hijack RNA treatment method is an elegant scientific approach that highlights his signature creativity for addressing these treatable, but incurable illnesses," says Dr. W. David Hardy, Adjunct Clinical Professor of Medicine at The Keck School of Medicine at USC. "This strategy beautifully reflects Dr. Serhat's exceptionally keen understanding of how viruses work."

[0] https://www.prnewswire.com/news-releases/la-based-research-s...

I wonder if the quality of other data processing frameworks is also getting 'good enough' for many use-cases, and they often have less complexity than Spark. With Hadoop, many companies bought clusters because they thought they needed them, but they rotted because people didn't actually have suitable workloads. Does Databricks have a similar risk? Just based on users of our Python reporting framework[0] we are starting to see Dask/Ray displacing some workloads that would have been in Spark a few years ago. How quickly things progress in that space (e.g. Arrow/DuckDB[1]) is pretty incredible to watch.

[0] https://github.com/datapane/datapane

[1] https://duckdb.org/

If you can write visualisations in Python itself, I am a big fan of Altair's syntax (https://github.com/altair-viz/altair), which is based on vega-lite. A while back, I wrote a brief guide and comparison of the main plotting libraries: https://datapane.com/reports/87NNEJ7/the-ultimate-guide-to-p...

One benefit of having them in actual code is that you can programmatically automate the creation of things like dashboards and reports. For instance, schedule a script to share an interactive plot every Monday morning, or build a live dashboard that updates every 10m. This opens up a lot of possibilities that would be impossible in a traditional drag-and-drop tool.

One cool library I saw recently for helping on the visualisation side is https://github.com/vegafusion/vegafusion

It allows you to use Altair in Python for visualising data, but does the computation in the backend using Arrow DataFusion. Not for 15GB perhaps, but cool nonetheless.

Datapane | https://datapane.com | UK & Ireland

Datapane is the frontend for the data science ecosystem. Our open-source library helps data scientists use the tools they love to create reports, dashboards, and apps for non-technical end-users.

We are backed by some of the top investors in the world, and have grown to be the most popular way to create and share data science reports. We are proud to put the power of the open-source ecosystem in the hands of over 50,000 end-users each month.

Take a look at our Employee Handbook to learn about the application process and how we work: https://handbook.datapane.com

Stack: Python, F#, Kubernetes, Django, htmx, Vue.js, Tailwind, Apache Arrow, Pandas

Product Framework: Basecamp's Shape Up

- Senior Software Engineer, Core : https://apply.workable.com/datapane/j/8F393A3B1D/

- Mid Software Engineer, Core : https://apply.workable.com/datapane/j/6C7B598092/

- Senior Software Engineer, Full-stack : https://apply.workable.com/datapane/j/B7DBF23A18/

- DevOps / Infrastructure Engineer : https://apply.workable.com/datapane/j/50E784B9B1/

- Developer Evangelist (Data Science) : https://apply.workable.com/datapane/j/65AAF53FAC/

- Director of Growth : https://apply.workable.com/datapane/j/D6FBB3EA06/

- Community Engineer : https://apply.workable.com/datapane/j/3FB5636CF4/

Learn more at https://datapane.com/careers.

Play 2 was all fun and games until you needed to parse JSON

I used to think that social rituals were bullshit, but I've completely changed my mind. I think they are just often done poorly and distract the team from what is important. I'm sure there is room for improvement and YMMV, but our current process is working really well for us:

- As some context, we use Basecamp's Shape Up to deliver features. This prioritises independence, async communication, and deep work. Engineers and designers are largely free to manage their active projects to how they see fit (managers provide context).

- Team social activities only happen on Mondays and Friday. Tuesday -> Thursday are reserved for deep work.

- We found that mixing social and work meetings didn't work (i.e. a weekly kick-off where people both talk about their weekend and their priorities). Instead, we have a 100% social coffee video call on Monday mornings with some jazz. Weekly work updates happen async and are project-dependent.

- On Fridays afternoons we have a quiz or a board game. We like doing it later afternoon on Friday, where deep work is less likely to happen. We also have an async social check-in with a different prompt each week, where you can share some experiences, pictures of a holiday, etc.

- Quarterly retreats where we get the team together. We do a morning session and an afternoon session every day, with the rest of the time unstructured/fun.

Things are avoid:

- We avoid stand-ups which devolve into people listing out what they did yesterday - instead, we encourage async self-organization

- We try and back to back meetings to avoid context switching and 30m-2hr deadzones

- We discourage arranging calls just to organize thoughts (I was bad at this myself). In our experience, communication is higher fidelity if it is written up in message threads on Basecamp. Video calls are really only used for 1:1s, social meetings, demos, or regrouping in the context of an active project.

- We got rid of Slack. Active projects have their own chat rooms, but the rule of thumb is: presume anything not in a forum thread or document is ephemeral and will be lost forever.

We have started putting together a lot of our rituals and culture together in our handbook (https://handbook.datapane.com), so would love any feedback.

Datapane | https://datapane.com | Remote (UK & Europe)

Datapane is the frontend for the data science ecosystem. Our open-source library helps data scientists use the tools they love to create reports, dashboards, and apps for non-technical end-users.

We are backed by some of the top investors in the world, and have grown to be the most popular way to create and share data science reports. We are proud to put the power of the open-source ecosystem in the hands of over 50,000 end-users each month.

Take a look at our Employee Handbook to learn about the application process and how we work: https://handbook.datapane.com

Stack: Python, F#, Kubernetes, Django, htmx, Vue.js, Tailwind, Apache Arrow, Pandas

Product Framework: Basecamp's Shape Up

- Senior Software Engineer, Core : https://apply.workable.com/datapane/j/8F393A3B1D/

- Mid Software Engineer, Core : https://apply.workable.com/datapane/j/6C7B598092/

- Senior Software Engineer, Full-stack : https://apply.workable.com/datapane/j/B7DBF23A18/

- DevOps / Infrastructure Engineer : https://apply.workable.com/datapane/j/50E784B9B1/

- Developer Evangelist (Data Science) : https://apply.workable.com/datapane/j/65AAF53FAC/

- Director of Growth : https://apply.workable.com/datapane/j/D6FBB3EA06/

Learn more at https://datapane.com/careers.

Interesting, thanks for sharing your perspective. Do you think both could be true?

For anyone interested in a perspective on the current woke/anti-woke zeitgeist from someone on the left, I would highly recommend Fisher's "Exiting the Vampire Castle": https://www.opendemocracy.net/en/opendemocracyuk/exiting-vam...

> The Vampires’ Castle specialises in propagating guilt. It is driven by a priest’s desire to excommunicate and condemn, an academic-pedant’s desire to be the first to be seen to spot a mistake, and a hipster’s desire to be one of the in-crowd. The danger in attacking the Vampires’ Castle is that it can look as if – and it will do everything it can to reinforce this thought – that one is also attacking the struggles against racism, sexism, heterosexism. But, far from being the only legitimate expression of such struggles, the Vampires’ Castle is best understood as a bourgeois-liberal perversion and appropriation of the energy of these movements. The Vampires’ Castle was born the moment when the struggle not to be defined by identitarian categories became the quest to have ‘identities’ recognised by a bourgeois big Other.

I had something similar (for years) and I actually found zazen and mindfulness very helpful.

I think diving into ego death when via substances in uncontrolled settings isn't a great idea, because you can get bogged down in delusion and paranoia.

I found it helpful with zazen to realise that any judgement of whatever I was experiencing (whether good or bad / joy or fear / enlightenment or hell), was just as much a delusion in itself as much as anything else. I personally found this made it illogical to be scared by whatever is happening inside your head, because that fear is just line noise.

Regarding the inability to detect red/white, this study is brought up quite a bit and I find it hard to believe it's anything but an anomaly. I blind-tasted wine competitively at a national level, and it is pretty commonplace to identify region/sub-region/year/grape across 10 wines blind with ~80% accuracy. Many tastings go further than this and people are identifying chateau/year from 10 wines from the same region. It's relatively simple to train yourself to do this.

Not saying you couldn't find some reds and whites which, if tasted without seeing the colour, would be challenging to tell apart; but I cannot really see this holding up if reproduced in better settings (perhaps my bias though).

No qualms re people's preferences, which is of course subjective; lots of cheaper wines are may be more enjoyable, which is great. IMO wine flavour profiles are often full of weird signalling about what 'good' is, i.e. "taste x is considered desirable/refined/distinguished, ergo it tastes better", which is nonsense and snobbery.

Datapane | https://datapane.com | Remote (Europe)

Datapane is the world's most popular way to create data science reports using Python. Our open-source framework is used by thousands of data scientists to create interactive reports, and our API-first platform serves over 50,000 people a month.

We're a technical, remote team based in the UK and founded by YC alum and compsci PhDs. We're just closing a round from top-tier investors and hiring fully-remote for:

- Mid and Sr Backend (Python/Django)

- Systems / Infrastructure Engineer (Python/K8S)

- Developer Evangelist (Data Science)

- Product Designer (HTML/CSS/Tailwind)

- Marketing Manager

Learn more at https://datapane.com/careers, or apply directly at https://apply.datapane.com

An interesting thought experiment is how feasible and expensive would it be to run a large-scale PR and marketing campaign to get that 25% of adblockers to 50%, and how would this disrupt the current hegemony.

If you were given the task "Remove $1BN of ad revenue. Here is $100M to spend.", how would you do it? I'd imagine it could be reasonably high leverage.

Aside from preferences, is there a reason why C# or F# wouldn't be a more natural choice? I'd imagine porting TS to C# would be easier (especially for this specific use-case) and that the performance would be good.

Showing my naivety, but could someone explain to me how these sort of things are becoming partisan left/right issues?

I am based in Britain. I'm presuming London's mayor (Sadiq Khan) and many others comparable figures are significantly more left-leaning -- both economically and socially -- than their US counterparts in these cities. Yet, I can't imagine the London Metropolitan police would not come down on this sort of thing like a ton of bricks. It's not like socialist or communist countries haven't prosecuted or penalised theft historically.

Similarly, I keep reading on Twitter that the left in the US wants to ban calculus. How is this a leftist policy? I am pretty sure Soviet Russia streamed students based on ability.