DS/ML digest 32

Highlights:

- A way to replace softmax in NMT;

- Large visual reasoning dataset;

- PyText;

spark-in.me/post/2018_ds_ml_digest_32

#digest

#deep_learning

#data_science

2018 DS/ML digest 32

2018 DS/ML digest 32 Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

ganbreeder.app/

A collaborative tool for discovering images.

PyText

- PyText github.com/facebookresearch/pytext from Facebook:

- TLDR - FastText meets PyTorch;

- Very similar to AllenNLP in nature;

- Will be useful if you can afford to write modules for their framework to solve 100 identical tasks (i.e. like Facebook with 200 languages);

- In itself - seems to be too high maintenance to use;

I will not use use it.

#nlp

#deep_learning

facebookresearch/pytext

A natural language modeling framework based on PyTorch - facebookresearch/pytext

www.youtube.com/watch?v=ZKQp28OqwNQ

BigGANs: AI-Based High-Fidelity Image Synthesis

PyText?

NLP library build on top of PyTorch 1.0 by Facebook?

- No repo link though (github.com/facebookresearch/pytext)

- The paper also mentions the same limited API as AllenNLP has ... =(

research.fb.com/publications/pytext-a-seamless-path-from-nlp-research-to-production/

facebookresearch/pytext

A natural language modeling framework based on PyTorch - facebookresearch/pytext

youtu.be/kSLJriaOumA

A Style-Based Generator Architecture for Generative Adversarial Networks

Simpsons paradox

Nice explanation

towardsdatascience.com/simpsons-paradox-and-interpreting-data-6a0443516765

#data_science

Simpson’s Paradox and Interpreting Data

The importance of storytelling in statistics.

DS/ML digest 31

Highlights of the week:

- PyTorch 1.0 released;

- Drawing with GANs;

- BERT explained;

spark-in.me/post/2018_ds_ml_digest_31

#digest

#deep_learning

#data_science

2018 DS/ML digest 31

2018 DS/ML digest 31 Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

PyTorch 1.0 release

View Release:

 github.com/pytorch/pytorch/releases/tag/v1.0.0

#deep_learning

pytorch/pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration - pytorch/pytorch

youtu.be/AGm3hF_BlYM

This AI Learns Human Movement From Videos

Painting with GANs

This looks just awesome.

I guess it will not work in real resolutions yet.

gandissect.res.ibm.com/ganpaint.html?project=churchoutdoor&layer=layer4

#deep_learning

Painting with GANs from MIT-IBM Watson AI Lab

This demo lets you modify a selection of meaningful GAN units for a generated image by simply painting.

This kind of mirrors my own old post

spark-in.me/post/epistemic-responsibility

Эпистемологическая ответственность

Почему мы должны нести ответственность за идеи, в которые верим и которыми пользуемся Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

A cheeky ML/DS themed sticker pack for our channel

Thanks to @birdborn for his art.

You are welcome to use it:

t.me/addstickers/ML_spark_in_me_by_BB

If you would like to contribute / create your own stickers - please ask around in our channel chat.

#data_science

Channel Edit Photo

Article about the reality of CV in Russia / CIS

(RU)

cv-blog.ru/?p=253

Also a bit on how to handle various types of "customers", who want to contract CV systems from you.

Warning - too much harsh reality)

#deep_learning

DS/ML digest 30

spark-in.me/post/2018_ds_ml_digest_30

#digest

#deep_learning

#data_science

2018 DS/ML digest 30

2018 DS/ML digest 30 Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

youtu.be/_lphFvojA-8

AI-Based Hair Synthesis... From Just One Photo!

Creating a new user

With the above hack, user creation can be done as easy as:

USER="YOUR_USER" && \

GROUP="YOUR_GROUP" && \

sudo useradd $USER && \

sudo adduser $USER $GROUP && \

sudo mkdir -p /home/$USER/.ssh/ && \

sudo touch /home/$USER/.ssh/authorized_keys && \

sudo chown -R $USER:$USER /home/$USER/.ssh/ && \

sudo wget -O - github.com/$USER.keys | sudo tee -a /home/$USER/.ssh/authorized_keys#linux

Getting your public key from Github ... with wget!

I kind of saw it when installing Ubuntu 18 from scratch. But it is super awesome!

wget -O - github.com/snakers4.keys >> test

Just replace test with your authorized_keys file and profit!

#linux

Jupyter extensions

Looks like they are near end of their support.

Alas.

On a fresh build you will need this

conda install notebook=5.6

To use them.

Will need to invest some time into making Jupyter Lab actually usable.

#data_science

TDS article follow-up

TDS also accepted a reprint of the article

towardsdatascience.com/winning-a-cft-2018-spelling-correction-competition-b771d0c1b9f6

#nlp

Winning a CFT 2018 spelling correction competition

Or building a task-agnostic seq2seq pipeline on a challenging domain

Our victory in CFT-2018 competition

TLDR

- Multi-task learning + seq2seq models rule;

- The domain seems to be easy, but it is not;

- You can also build a pipeline based on manual features, but it will not be task agnostic;

- Loss weighting is crucial for such tasks;

- Transformer trains 10x longer;

spark-in.me/post/cft-spelling-2018

#nlp

#deep_learning

#data_science

Winning a CFT 2018 spelling correction competition

Building a task-agnostic seq2seq pipeline on a challenging domain Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

Problems with GPUs in DL box

Cryptic messages like:

GPU is lost

Usually this is either:

- PSU;

- Or bad PCIE contact;

- Too much load on PCIE bus;

#deep_learning

DS/ML digest 29

spark-in.me/post/2018_ds_ml_digest_29

#digest

#deep_learning

#data_science

2018 DS/ML digest 29

2018 DS/ML digest 29 Статьи автора - http://spark-in.me/author/snakers41 Блог - http://spark-in.me

An intro to RL

Though published by OpenAI with TF, this is simply amazing:

- spinningup.openai.com/en/latest/spinningup/rl_intro.html

#rl

youtu.be/zL6ltnSKf9k

This AI Learned To Isolate Speech Signals

When it is colder, under full load GPUs run at 70C

Towards Data Science

Our article was accepted to their publication:

- towardsdatascience.com/building-client-routing-semantic-search-in-the-wild-14db04687c7e

Also when you have published once there, then you can just publish your work on TDS on recurrent basis =)

I doubt that this will be properly distributed to all 130k of their subs, but nevertheless this is a milestone.

#data_science

Building client routing / semantic search in the wild

A comparison of novel NLP techniques within an applied business setting