156 karma · joined September 10, 2015
Github: https://github.com/lopuhin/ Kaggle: https://www.kaggle.com/lopuhin/
So the actual bright part of the Andromeda, seen with naked eye under dark skies, is much smaller.
No, a TOTP app is also allowed.
> Do the cutout in feature space, not the original input space.
I think they do the cutout in the original input space, based on examples they show, e.g. they mask parts of text and grey out parts of an image.
> and make the network predict the missing part
I think predict the latent representation (as you say in (2)), but not of the missing part, but of the whole corrupted sample, and require it to be close to latent representation of the original input done by the teacher.
At Zyte (formerly Scrapinghub), our goal is to help you get the data from the web, so we develop services such as smart rotating proxies, browser rendering API, data extraction API, a cloud for running your crawling jobs, etc.
At the data science team, the main project we work on is data extraction API, which can extract articles, products, job postings and other data types from any website, and also do automatic crawling and discovery. We approach this as a machine learning problem, with a deep learning model combining web page screenshot, text, node information and other features, trained on hundreds of thousands of web pages. We work on improving the quality of extraction and increasing coverage of attributes and data types. I find this problem really fascinating to work on, as on one side, you get to work on a neural network which uses both image, text and graphs as inputs and can find inspiration from current ML literature, but on the other hand, web extraction is not so well studied, and a great deal of experimentation is required. Our tech stack on the ML side is Python and PyTorch. We love Open Source: Zyte founders are authors of a popular Scrapy framework, and we open source many libraries we heavily rely on internally, such as dateparser and extruct.
The company has been fully remote since the start, and hires from a large number of countries. Please check more details at https://wrkbl.ink/iNsRDym, and feel free to check other positions at https://apply.workable.com/zyte/
Not a great time to predict this, at this point in the solar cycle we're close to a minimum of solar activity, the max should be between 2023 and 2026, but it's not expected to be too big either - cycle 25 is expected to be similar to 24 which was quite modest.
(and that's on CIFAR-10). But why not report these results and also test on a more realistic datasets? The internet is full of M1 TF brenchmarks on CIFAR or MNIST, has anyone seen something different?
In terms of the approach, the whole page is rendered in a headless browser, we extract the whole page screenshot, text and other features, and feed them into one neural network where all modalities are joined and which handles the extraction.
Browser extensions are in an interesting position here as they can probably have access to much richer features from the browser context (element size, position, CSS properties), but still want to be low overhead. I think I saw such an implementation, maybe even from Mozilla, but can't find it right now.
This is an evaluation of article body extraction for AutoExtract (ours), Diffbot, newspaper3k, readability-lxml, dragnet, boilerpipe and html-text. Since we're evaluating the quality of our system as well, we tried to be extra careful to be fair and transparent, releasing dataset, evaluation scripts and all details in the technical report.