Data Science by ODS.ai 🦜

15 Nov 2022 11:25

#events : ML-тренировка
Когда: 17 (четверг) ноября 2022, 19:00 - 21:30 (сбор с 18:00)
Место: офис Яндекса (Москва, улица Льва Толстого, 16) + онлайн
Язык - русский

В этот раз нас ждёт 3 доклада:
- призер только что завершившегося Yandex ML Cup,
- 2ое место хакатона AgroCode Hack по анализу спутниковых снимков для виноградников
- организатор ML соревнований в информационной безопасности

Подробная программа по ссылке ниже
Будем рады видеть всех очно и онлайн ;)
Регистрация обязательна

Data Science by ODS.ai 🦜

28 Oct 2022 10:05

Amos: An Adam-style Optimizer with Adaptive Weight Decay towards Model-Oriented Scale

Amos is a new optimizer that we propose to pre-train large language models. It is more efficient and converges faster than AdamW: ≤ 51% memory for slot variables, and better valid loss within ≤ 70% training time!Amos is a new optimizer that we propose to pre-train large language models. It is more efficient and converges faster than AdamW: ≤ 51% memory for slot variables, and better valid loss within ≤ 70% training time!

ArXiV: https://arxiv.org/abs/2210.11693

#NLU #NLP #optimizer

Data Science by ODS.ai 🦜

23 Oct 2022 11:51

State of AI Report 2022

TLDR: We are moving forward and effective international collaboration is the key to progress.

Major Themes:

* New independent research labs are rapidly open sourcing the closed source output of major labs
* Safety is gaining awareness among major AI research entities
* The China-US AI research gap has continued to widen
* AI-driven scientific research continues to lead to breakthroughs

Website: https://www.stateof.ai

#report #stateofai #AI

Data Science by ODS.ai 🦜

22 Mar 2018 08:16

“Listing Embeddings for Similar Listing Recommendations and Real-time Personalization in Search”

From #Airbnb team
https://medium.com/airbnb-engineering/listing-embeddings-for-similar-listing-recommendations-and-real-time-personalization-in-search-601172f7603e

Data Science by ODS.ai 🦜

09 Jan 2018 14:34

Unfortunately, discrimination against ML competition participants becomes more frequent. CrowdANALYTIX recently launched a competition that simply bans different countries from opportunity to participate, this time including Russia.

Spread the word so that we could make Data Science and ML more open, without obsolete discriminatory rules on competition platforms:
https://www.facebook.com/DataChallenges/photos/a.136318350296824.1073741827.136313013630691/182693245659334/?type=3&theater

Data Science by ODS.ai 🦜

05 Dec 2017 12:14

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs.

Now mankind can generate content for social networks without taking photoes.

Github: https://github.com/NVIDIA/pix2pixHD
Arxiv: https://arxiv.org/pdf/1711.11585.pdf

Data Science by ODS.ai 🦜

03 Dec 2017 13:32

AI index report, demonstrating hype around AI techonologies: https://aiindex.org/2017-report.pdf

Data Science by ODS.ai 🦜

28 Nov 2017 17:45

#DeepLearning predicts when patients die with Average Precision 0.69 (that’s high).

Andrew Ng announced new project in his twitter: ML to help prioritize palliative (end-of-life) care. Model uses an 18-layer Deep Neural Network that inputs the EHR data of a patient, and outputs the probability of death in the next 3-12 months.

The trained model achieves an AUROC score of 0.93 and an Average Precision score of 0.69 on cross validation.

Site: https://stanfordmlgroup.github.io/projects/improving-palliative-care/
Arxiv: https://arxiv.org/abs/1711.06402

#project #DSinthewild #casestudy

Data Science by ODS.ai 🦜

27 Nov 2017 12:21

StarGAN — a novel and scalable approach that can perform image-to-image translations for multiple domains using only a single model.

GitHub: https://github.com/yunjey/StarGAN
Arxiv: https://arxiv.org/abs/1711.09020

#deeplearning #gan #cv

Data Science by ODS.ai 🦜

26 Nov 2017 15:21

Realtime object detection by Google.

https://research.googleblog.com/2017/11/automl-for-large-scale-image.html

YouTube demo: https://www.youtube.com/watch?time_continue=70&v=ERglPgx8wFg

#deeplearning #google #caption #detection

Data Science by ODS.ai 🦜

23 Nov 2017 12:00

An article about #BigBrother. How Facebook is able to track users interests based on 3 likes.

Enhancing Transparency and Control When Drawing Data-Driven Inferences About Individuals

http://online.liebertpub.com/doi/full/10.1089/big.2017.0074

Data Science by ODS.ai 🦜

16 Nov 2017 11:07

#CapsNet #architecture

Data Science by ODS.ai 🦜

14 Nov 2017 07:04

Imitation learning for structured prediction in natural language processing

https://sheffieldnlp.github.io/ImitationLearningTutorialEACL2017

#nlp #tutorial

Data Science by ODS.ai 🦜

12 Nov 2017 21:22

Release of a nice NLP-processing library.

https://www.techleer.com/articles/404-spacy-20-released-natural-language-processing-with-python/

#nlp #python

Data Science by ODS.ai 🦜

08 Nov 2017 14:17

Great example of feature visualisation

https://distill.pub/2017/feature-visualization/

Data Science by ODS.ai 🦜

13 Nov 2022 10:29

Reinforcement learning course from MIPT.

The course consists of:
- Theoretical and practical material for beginners and advanced users
- Classical approaches based on utility functions and strategy gradient, as well as modern trends in improving the efficiency of the study of the environment, interaction with planning, using memory and hierarchical approaches.
- The best of David Silver's lectures, Sutton and Barto's book, and OpenAI, DeepMind works and articles from 2019-2022.

Materials:
- PDF slides and video lectures on each topic, Colab master classes and video lectures in Russian.

Course: https://clck.ru/32a3c9

If you are interested in an internship at MIPT in the areas of Reinforcement Learning, Computer Vision, Robotics or Self Driving Cars, you can apply here: https://cogmodel.mipt.ru/internship

Data Science by ODS.ai 🦜

24 Oct 2022 07:57

Just in case you didn’t know what to wear for Halloween party.

Data Science by ODS.ai 🦜

22 Mar 2018 08:55

Nature has published an article with a #superresolution approach for #CT scans.

https://www.sciencedaily.com/releases/2018/03/180321155324.htm
#arxiv: https://arxiv.org/abs/1704.08841

Data Science by ODS.ai 🦜

13 Jan 2018 18:00

Graph shows what people really mean when they use vague terminology describing the probability of an event.

Data Science by ODS.ai 🦜

23 Dec 2017 00:00

Another paper on automl: Neural Nets learning to design Neural Nets.

A reinforcement learning agent that learns to program new neural network architectures.
Same/better results as LSTMs but with funky nonlinearities (sine, SeLus, etc) and new connections that result in different activation patterns.

Arxiv: https://arxiv.org/abs/1712.07316
Post: https://einstein.ai/research/domain-specific-language-for-automated-rnn-architecture-search

Data Science by ODS.ai 🦜

05 Dec 2017 12:13

pix2pix Demo: Neural network generates cityscape based on the input label map.

Data Science by ODS.ai 🦜

30 Nov 2017 15:22

Video displaying progress of GANs for photo generation. Now you can use neural networks to generate HD photo of a person who never existed.

https://www.youtube.com/watch?v=XOxxPcy5Gr4

#GAN #youtube

Data Science by ODS.ai 🦜

28 Nov 2017 13:50

An article about the impossibility of intelligence explosion. There will be no singularity or significant breakthrough and humanity will die off becuase of sun explosion.

francois.chollet/the-impossibility-of-intelligence-explosion-5be4a9eda6ec" rel="nofollow">https://medium.com/@francois.chollet/the-impossibility-of-intelligence-explosion-5be4a9eda6ec

Data Science by ODS.ai 🦜

27 Nov 2017 12:20

Astonishing results on emotion generation and image altering with StarGAN

Data Science by ODS.ai 🦜

24 Nov 2017 19:33

#CapsNet #tutorial on the YouTube

https://www.youtube.com/watch?v=pPN8d0E3900

#deeplearning

Data Science by ODS.ai 🦜

16 Nov 2017 11:08

And another posts on #CapsNet and how they work.

Capsule Networks Are Shaking up AI — Here’s How to Use Them: https://hackernoon.com/capsule-networks-are-shaking-up-ai-heres-how-to-use-them-c233a0971952

Understanding Hinton’s Capsule Networks. Part I: Intuition:
pechyonkin/understanding-hintons-capsule-networks-part-i-intuition-b4b559d1159b" rel="nofollow">https://medium.com/@pechyonkin/understanding-hintons-capsule-networks-part-i-intuition-b4b559d1159b

Understanding Hinton’s Capsule Networks. Part II: How Capsules Work:
pechyonkin/understanding-hintons-capsule-networks-part-ii-how-capsules-work-153b6ade9f66" rel="nofollow">https://medium.com/@pechyonkin/understanding-hintons-capsule-networks-part-ii-how-capsules-work-153b6ade9f66

Data Science by ODS.ai 🦜

16 Nov 2017 11:07

On 1st of November Geoff Hinton — one of the top NN researches has published two papers introducing new approach for #CV problems: Capsule Networks.

These architecture allows to recognize a face on the picture by detecting eyes, nose, mouth, regardless of the position / scaling / rotating the elements.

In other words, these approach allows neural network to be invariant to transformation of object.


First of papers: https://arxiv.org/abs/1710.09829
Second paper: https://openreview.net/forum?id=HJWLfGWRb&noteId=HJWLfGWRb

Article on Wired: https://www.wired.com/story/googles-ai-wizard-unveils-a-new-twist-on-neural-networks/

Explanation on hackernoon: https://hackernoon.com/what-is-a-capsnet-or-capsule-network-2bfbe48769cc

Another post with explanation: https://kndrck.co/posts/capsule_networks_explained/

Data Science by ODS.ai 🦜

13 Nov 2017 00:42

Google's open source candy for all ML community:

Source-to-Source Debuggable Derivatives


https://opensource.googleblog.com/2017/11/tangent-source-to-source-debuggable.html?m=1

#opensource #nn #python #google

Data Science by ODS.ai 🦜

11 Nov 2017 11:08

The State of Data Science & Machine Learning 2017 by Kaggle.

Very informative article about age, job titles, most popular languages and everything related to DS / ML.

Not to mention that source data is included.

https://www.kaggle.com/surveys/2017

#kaggle #statistics

Data Science by ODS.ai 🦜

30 Oct 2017 10:21

Winning approaches for solving Advanced Driver Assistance System challenge on Kaggle:

https://blog.getnexar.com/how-a-22-year-old-from-shanghai-won-a-global-deep-learning-challenge-76f2299446a1

#deeplearning #kaggle #cv