Global AI and Data Science

Global AI & Data Science

Train, tune and distribute models with generative AI and machine learning capabilities

 View Only
Back to Library

Machine Learning Blueprint Newsletter, Edition 8, 11/16/17 

Wed June 19, 2019 02:52 PM

B
This newsletter is written and curated by Mike Tamir and Mike Mansour

November 16, 2017

Spotlight Machine Learning Articles
AWS, Facebook, Microsoft and several other major players in the deep learning space announce ONNX an open source neural network format for Caffe2, MSF Cognitive, MXNet and Pytorch.
Machine Learning Blueprint's Take
Google’s TensorFlow ecosystem has dominated the deep learning world for the past several years. While different frameworks now integrated under the ONNX umbrella like Pytorch have offered advantages over TF, as discussed in the last MLBP issue, Google is quickly bridging any gaps through the release of new dynamic eager execution modes and investment in Keras as a front end. ONNX standardization promises to enable quick development combining the advantages (and libraries) across the diverse frameworks of most major TF competitors. Coupled with promised hardware optimizations, we might be seeing a reification of a true rival to Google dominance.
Until December 31, 2018, all NumPy releases will fully support both Python2 and Python3. Starting on January 1, 2019, any new feature releases will support only Python3. On January 1, 2020 community support for the last Python2 supporting release will end.
DeepMind releases details of their “probability density distillation” (PDD) technique, which enables high speed real time execution of the WaveNet algorithm. PDD uses an architecture similar to GAN networks, where a pre-trained “teacher” model functions as the discriminative algorithm and a “student” model functions as the generative algorithm. The student model learns to generate waveforms that match the teacher model but can move at high speed since the waveform distribution does not have to be generated sequentially. A related discussion on visualizing Wavenet with dimensionality reduction techniques can also be found here.
094033e1-807b-45d6-96f3-f9cc933124fc.gif

Learning Machine Learning
An intuitive explanation of the Single Shot Detector (SSD), an deep image classifier for drawing multiple bounding boxes that performs inference at 59 frames/second.
00369bca-f3aa-493c-b69d-8d2e3343a1c3.png
With macOS High Sierra supporting external GPU’s via thunderbolt 3, but TensorFlow dropping GPU support on macs, Hackintosh power users and new MBP owners can use this guide to backport TensorFlow to train DNN’s with whatever Nvidia setup they might have.
Interesting Research
Alberg and Lipton present models suggesting that deep learning techniques can be used to forecast future estimates of publicly traded company fundamentals. Results indicate that using these techniques they are able outperform a standard factor approach with over 18% lift over compounded annual return performance.
Machine Learning News Links
This Ai Algorithm Probably Means The End Of High-end Art Forgeries. Researchers have devised a way to use machine learning to detect art fakes by looking at the characteristics of the brush strokes, which have latent features that are akin to a signature and transcend compositional features.
Machine Learning Blueprint's Take
The interesting part of the cited research paper is in the featurization of the image input using graphs to identify the strokes that will be used for training and classification. While deep learning is known for doing its own feature extraction, by performing this preprocessing they can force the algorithms to focus on the individual strokes instead of the compositional features. In the end, comparing both traditional ML algorithms with handcrafted features (worth checking out) and deep learning methods, the traditional ML approach detects fakes the best. An interesting extension of this research might be to evaluate performance of detecting fakes generated by a GAN.
7911ff59-973c-4740-94c1-c5a8beeb0a1f.png
Scientists Look at How Humans Drive in Self-Driving Cars. MIT releases their research plan for collecting data and understanding how humans adapt to driving-assistance technology. This longitudinal study will use camera footage of drivers coupled with all the self-driving sensors to improve the technology-user relationship.
74ab4b1e-5bdf-4887-b603-1b4e6d9cb1a0.png
365d3eba-115f-4f86-a98c-76481f1d9124.jpg
Using Machine Learning to Unveil Congress’ Priorities. ProPublica showcases applied machine learning with topic modeling through Doc2Vec on press releases filed by Congress members. Results reveal current topic-labeling systems may incorrectly categorize documents (e.g. abortion bills may fall under “Health”, or “Law & Crime”). Furthermore, the current topics may not reflect important topics to a granular enough level. These press releases are assumed to be more telling of the Congress Person’s priorities.
AI Can Help Hunt Down Missile Sites in China. University of Missouri uses GoogleNet and ResNet to tackle the challenge of identifying missile sites from satellite imagery. This problem is confounded by not only a lack of training data, but a huge class imbalance issue.


#GlobalAIandDataScience
#GlobalDataScience

More Data Science News
Statistics
0 Favorited
7 Views
0 Files
0 Shares
0 Downloads