Spark in me - Internet, data science, math, deep learning, philo

snakers4 @ telegram, 1361 members, 1660 posts since 2016

All this - lost like tears in rain.

Data science, deep learning, sometimes a bit of philosophy and math. No bs.

Our website
Our chat
DS courses review

snakers4 (Alexander), December 19, 08:16

DS/ML digest 32


- A way to replace softmax in NMT;

- Large visual reasoning dataset;

- PyText;




2018 DS/ML digest 32

2018 DS/ML digest 32 Статьи автора - Блог -

snakers4 (Alexander), December 17, 13:18

A collaborative tool for discovering images.

snakers4 (Alexander), December 17, 09:24


- PyText from Facebook:

- TLDR - FastText meets PyTorch;

- Very similar to AllenNLP in nature;

- Will be useful if you can afford to write modules for their framework to solve 100 identical tasks (i.e. like Facebook with 200 languages);

- In itself - seems to be too high maintenance to use;

I will not use use it.




A natural language modeling framework based on PyTorch - facebookresearch/pytext

snakers4 (Alexander), December 15, 17:50

BigGANs: AI-Based High-Fidelity Image Synthesis
This episode was supported by "Anything outside life extension is a complete waste of time". See their papers: - Papers: www.ncbi.nlm.n...

snakers4 (Alexander), December 14, 19:10


NLP library build on top of PyTorch 1.0 by Facebook?

- No repo link though (

- The paper also mentions the same limited API as AllenNLP has ... =(


A natural language modeling framework based on PyTorch - facebookresearch/pytext

snakers4 (Alexander), December 14, 03:57

A Style-Based Generator Architecture for Generative Adversarial Networks
Paper (PDF): Authors: Tero Karras (NVIDIA) Samuli Laine (NVIDIA) Timo Aila (NVIDIA) Abstract: We propose an alternative generator a...

snakers4 (Alexander), December 10, 15:14

Forwarded from Админим с Буквой:

WireGuard — прекрасный VPN будущего?

Наступило время, когда VPN уже не является каким-то экзотическим инструментом бородатых сисадминов. Задачи у пользователей разные, но факт в том, что VPN стал...

snakers4 (Alexander), December 10, 04:27

Simpsons paradox

Nice explanation


Simpson’s Paradox and Interpreting Data

The importance of storytelling in statistics.

snakers4 (Alexander), December 09, 07:59

DS/ML digest 31

Highlights of the week:

- PyTorch 1.0 released;

- Drawing with GANs;

- BERT explained;




2018 DS/ML digest 31

2018 DS/ML digest 31 Статьи автора - Блог -

snakers4 (Alexander), December 08, 05:17

PyTorch 1.0 release

View Release:



Tensors and Dynamic neural networks in Python with strong GPU acceleration - pytorch/pytorch

snakers4 (Alexander), December 07, 03:06

This AI Learns Human Movement From Videos
The paper "Towards Learning a Realistic Rendering of Human Behavior" is available here: Pick up cool perks on our Patre...

snakers4 (Alexander), December 06, 09:04

Painting with GANs

This looks just awesome.

I guess it will not work in real resolutions yet.


Painting with GANs from MIT-IBM Watson AI Lab

This demo lets you modify a selection of meaningful GAN units for a generated image by simply painting.

snakers4 (Alexander), December 05, 14:35

This kind of mirrors my own old post

Эпистемологическая ответственность

Почему мы должны нести ответственность за идеи, в которые верим и которыми пользуемся Статьи автора - Блог -

Forwarded from Вастрик.Пынь:

💌 Вастрик.Инсайд #37: Этикет, грамотность и обжорство в информационном поле

Давно хотелось поговорить на тему осознанного потребления информации и организации личного инфополя. Почему самоограничения и разборчивость — хорошо, но удалять все аккаунты и уходить в лес — не очень хорошая крайность. Если вы сами не организуете своё инфополе, это сделают за вас.

В конце выпуска есть формочка для вопросов на итоговый выпуск. Воспользуйтесь.

Вастрик.Инсайд #37

Этикет, грамотность и обжорство в информационном поле

snakers4 (Alexander), December 02, 09:40

A cheeky ML/DS themed sticker pack for our channel

Thanks to @birdborn for his art.

You are welcome to use it:

If you would like to contribute / create your own stickers - please ask around in our channel chat.


snakers4, November 30, 11:01

Channel Edit Photo

snakers4 (Alexander), November 29, 08:10

Article about the reality of CV in Russia / CIS


Also a bit on how to handle various types of "customers", who want to contract CV systems from you.

Warning - too much harsh reality)


snakers4 (Alexander), November 28, 11:55

DS/ML digest 30




2018 DS/ML digest 30

2018 DS/ML digest 30 Статьи автора - Блог -

snakers4 (Alexander), November 27, 18:55

AI-Based Hair Synthesis... From Just One Photo!
The paper "3D Hair Synthesis Using Volumetric Variational Autoencoders" is available here:

snakers4 (Alexander), November 25, 05:29

Creating a new user

With the above hack, user creation can be done as easy as:



sudo useradd $USER && \

sudo adduser $USER $GROUP && \

sudo mkdir -p /home/$USER/.ssh/ && \

sudo touch /home/$USER/.ssh/authorized_keys && \

sudo chown -R $USER:$USER /home/$USER/.ssh/ && \

sudo wget -O -$USER.keys | sudo tee -a /home/$USER/.ssh/authorized_keys#linux

snakers4 (Alexander), November 25, 04:59

Getting your public key from Github ... with wget!

I kind of saw it when installing Ubuntu 18 from scratch. But it is super awesome!

wget -O - >> test

Just replace test with your authorized_keys file and profit!


snakers4 (Alexander), November 23, 12:43

Jupyter extensions

Looks like they are near end of their support.


On a fresh build you will need this

conda install notebook=5.6

To use them.

Will need to invest some time into making Jupyter Lab actually usable.


snakers4 (Alexander), November 23, 08:21

TDS article follow-up

TDS also accepted a reprint of the article


Winning a CFT 2018 spelling correction competition

Or building a task-agnostic seq2seq pipeline on a challenging domain

snakers4 (Alexander), November 22, 11:56

Our victory in CFT-2018 competition


- Multi-task learning + seq2seq models rule;

- The domain seems to be easy, but it is not;

- You can also build a pipeline based on manual features, but it will not be task agnostic;

- Loss weighting is crucial for such tasks;

- Transformer trains 10x longer;




Winning a CFT 2018 spelling correction competition

Building a task-agnostic seq2seq pipeline on a challenging domain Статьи автора - Блог -

snakers4 (Alexander), November 22, 11:49

Problems with GPUs in DL box

Cryptic messages like:

GPU is lost

Usually this is either:

- PSU;

- Or bad PCIE contact;

- Too much load on PCIE bus;


snakers4 (Alexander), November 19, 13:59

Forwarded from Loss function porn:
"80 years of AI research. Epic battle between connectionist (~neural networks) and symbolic (~rule based) methods. Who will win?"
👤 @OriolVinyalsML (twitter)
📉 @loss_function_porn

snakers4 (Alexander), November 15, 08:09

DS/ML digest 29




2018 DS/ML digest 29

2018 DS/ML digest 29 Статьи автора - Блог -

snakers4 (Alexander), November 14, 08:36

An intro to RL

Though published by OpenAI with TF, this is simply amazing:



snakers4 (Alexander), November 12, 19:26

This AI Learned To Isolate Speech Signals
The paper "Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation " is available here: looking-to-li...

snakers4 (Alexander), November 12, 09:09

When it is colder, under full load GPUs run at 70C

snakers4 (Alexander), November 10, 18:32

Towards Data Science

Our article was accepted to their publication:


Also when you have published once there, then you can just publish your work on TDS on recurrent basis =)

I doubt that this will be properly distributed to all 130k of their subs, but nevertheless this is a milestone.


Building client routing / semantic search in the wild

A comparison of novel NLP techniques within an applied business setting