Sadly, neither my gym or work access card were cloneable even though they are MIFARE Classic. So I did not end up getting an implant.
1,969 karma · joined January 29, 2018
Sadly, neither my gym or work access card were cloneable even though they are MIFARE Classic. So I did not end up getting an implant.
Which is the implementation from the original paper.
The pure vector approach of in-chunk text augmentation is much simpler of course, but my hypothesis is that the resulting vector will cause too much false positives in retrieval.
In my experience retrieval precision is most commonly the problem not recall with vector similarity. This method will indeed improve recall for out-of-context chunks, but for me recall has not been a problem very often.
But it is only natural that different QA use cases require different strategies. I built 3 production RAG systems / virtual assistant now, and 4 that didn't make it past PoC and what advanced techniques works really depends on document type, text content and genre, use case, source knowledgebase structure and metadata to exploit etc.
Current go-to is semantic similarity chunking (with overlap) + title or question generation > retriever with fusion on bienc vector sim + classic bm25 + condensed question reformulated QA agent. If you don't get some decent results with that setup there is no hope.
For every project we start the creation of a use-case eval set immediately in parallel with the actual RAG agent, but sometimes the client doesn't think this is priority. We convinced them all it's highly important though, because it is.
Having an evaluation set is doubly important in GenAI projects: a generative system will do unexpected things and an objective measure is needed. Your client will run into weird behaviour when testing and they will get hung up on a 1-in-100 undesirable generation.
It's not perfect but the best bet for complex and collaboration-heavy projects.
Here's a fun challenge: try to determine channel priority in your conda env, go ahead try.
Conda is the single worst packaging tool I have ever used.
> An investigation by the publisher found a number of articles, including this one, with a number of concerns, including but not limited to compromised editorial handling and peer review process, inappropriate or irrelevant references or not being in scope of the journal or guest-edited issue.
It's quite a leap to arrive at AI generated content.
It is all speculation, but it sounds more likely the guest editor did not properly handle peer review (not blind, befriended or non-expert reviewer) and/or misapplied submission selection criteria (maybe out of scope papers by friendly colleagues were not rejected).
For many extractive tasks BloombergGPT was quite disappointing. A 5-10% performance hit with much larger inference cost compared to smaller models is not desirable.
But the research investment for Bloomberg makes sense to take the risk: a do-it-all generative model can mean significant complexity reduction in maintenance and deployment overhead.
It didn't directly pay off for many extractive tasks, but I bet they're iterating. Bloomberg has the data moat and the business needs in their core products to make it worthwhile.
I think this is default policy for thesis based on publication agreements here.
In any case, I am not too worried.
I doubt you can fine-tune BERT-large on a phone. A quantized, inference optimised pipeline can be leaps and bounds more efficient and is not comparable with the huggingface training pipelines on full models I did at the time. For non-adapter based training you're going to need GPUs ideally.
404 Content moderation response in 4% of articles. This is just financial news text.
It is a prime reason we are considering open models.
LLM approaches were evaluated on my own time and but published (I left research after obtaining my PhD).
Personally, my PhD did fine grained ACE-like event and sentiment extraction and "small" specialized finetuned transformers outperformed prompting LLMs like BERT and Roberta-large. Would love to see an inclusion of small model scores with some sota pipelines.
This is great work anyway even if it replicates known results!
They were always present at ACL with decent open research as far as I have been studying/working in NLP (2014).
It's part of a strategy to attract top talent in the field. If you want top researchers you have to let them publish, which in turn hones a reputation of solid research, attracting more talent.
Seems like only the Greens, the left and within ID the AFD voted against.
Seems like only the Greens, The Left and Afd within ID were against that first version of Chat Control.
___
This isn't the case though: the right-wing Identity and Democracy faction is explicitly pro-privacy, digital rights and against Chat Control.
- https://id-party.eu/program/ (ID Party Official Site)
- https://idgroup.eu/news/online-censorship-is-a-threat-to-eur... (ID Group News)
- https://en.wikipedia.org/wiki/Identity_and_Democracy (Wikipedia Overview)
- https://id-party.eu/declaration-of-antwerp/ (ID Party Official Site)
The ID group is opposed to EU-wide surveillance measures, and promises to protecting individual privacy and national sovereignty.
Now ECR is also sceptical and have expressed concerns, though their voting record on privacy related legislation is more inconsistent, I believe.
Representative democracy works better with increased locality, where policy and politicians are directly beholden to constituents.
- https://id-party.eu/program/ (ID Party Official Site)
- https://idgroup.eu/news/online-censorship-is-a-threat-to-eur... (ID Group News)
- https://en.wikipedia.org/wiki/Identity_and_Democracy (Wikipedia Overview)
- https://id-party.eu/declaration-of-antwerp/ (ID Party Official Site)
The ID group is opposed to EU-wide surveillance measures, and promises to protecting individual privacy and national sovereignty.
There are many nationally disgraced politicians seating in the EP, EC or council. Only the ones in the EP were electible.
The people have correctly identified that a massive supranational unaccountable government is the problem, enabling corrupt people to keep ruling which undermines the core functioning of representative democracy.
During my linguistic studies, the course material was comprised of the Oxford and Cambridge Handbook of Linguistic Typology (and a bunch of papers on specific linguistic features). But the Oxford handbook is a very good start.
It's a very cool field of study that will allow you to identify commonalities across languages and the differences between them. A good typologist should be able the be dropped in a completely unknown language context and learn the features from use (which was basically our exam).
Are you sure that there study/studies are sound and use directly comparable measures for passive vocabulary items?
It did lead to my first publication as co-author and some interesting insights: https://kuleuven.limo.libis.be/discovery/fulldisplay?docid=l...
The kind of result that makes careers: seemingly elegant and simple study design, common sense hypothesis and overall great marketability.
Diederik Stapel was one of the largest science fraudster in history and this kind of stuff was his bread and butter. More recently Francesca Gino was caught falsifying the data of the "honesty pledge at the top of form" that is highly similar in concept to this.
Now for the career-ending question: Will it replicate?
Probably historic reasons, anyway solid 9/10 API.
Reliance on cloud services is a legitimate worry though for privacy, IP, process control, reliability, etc.
The comparison between Optuna and WandB was not apples to apples. Optuna is completely self-hosted and local. It also focuses on hyperopt narrowly with flexible design unlike WandB that now assumes to be capture a large part of cloud-based MLOPS workflow.
It would be more fair to compare Optuna to Hyperopt. And I think Optuna was the better choice there, but I did simple PoCing and have no strong opinions.
Optuna lost out by a long mile back then in feature parity and dashboarding. Optuna did not have hyperband optimization which was and still is one of the best search algos for hyperopt. It looks like it is possible to implement hyperband yourself now, but in the loosely coupled architecture between Sampler and Pruner it's a bit baroque [1].
Anyway back then it was clear WandB was the far superior choice for features, ease of use, experiment tracking and dashboarding. We went with WandB for our lab.
Could be Optuna caught up, but WandB has seen significant development too. Looking at their dashboard docs, it looks meagre compared to what you can do with WandB.
1. https://tech.preferred.jp/en/blog/how-we-implement-hyperband...