Training machine learning models often requires data from multiple parties. However, in some cases, data owners cannot share their data due to legal or privacy constraints but would still benefit from training a model jointly with multiple parties. Federated learning has arisen as an alternative to allow for the collaborative training of models without the sharing of raw data. However, attacks in the literature have demonstrated that simply maintaining data locally during training processes does not provide strong enough privacy guarantees. We need a federated learning system capable of preventing inference over the messages exchanged between parties during training as well as the final, trained model. Read More
Monthly Archives: March 2019
Split learning for health: Distributed deep learning without sharing raw patient data
Can health entities collaboratively train deep learning models without sharing sensitive raw data? This paper proposes several configurations of a distributed deep learning method called SplitNN to facilitate such collaborations. SplitNN does not share raw data or model details with collaborating institutions. The proposed configurations of splitNN cater to practical settings of i) entities holding different modalities of patient data, ii) centralized and local health entities collaborating on multiple tasks and iii) learning without sharing labels. We compare performance and resource efficiency trade-offs of splitNN and other distributed deep learning methods like federated learning, large batch synchronous stochastic gradient descent and show highly encouraging results for splitNN. Read More
A little-known AI method can train on your health data without threatening your privacy
Machine learning has great potential to transform disease diagnosis and detection, but it’s been held back by patients’ reluctance to give up access to sensitive information. Read More
A new AI method can train on medical records without revealing patient data
When Google announced that it would absorb DeepMind’s health division, it sparked a major controversy over data privacy. Though DeepMind confirmed that the move wouldn’t actually hand raw patient data to Google, just the idea of giving a tech giant intimate, identifying medical records made people queasy. This problem with obtaining lots of high-quality data has become the biggest obstacle to applying machine learning in medicine. Read More
SplitNet: Learning to Semantically Split Deep Networks for Parameter Reduction and Model Parallelization
A novel deep neural network that is both lightweight and effectively structured for model parallelization. Our network, which we name as SplitNet, automatically learns to split the network weights into either a set or a hierarchy of multiple groups that use disjoint sets of features, by learning both the class-to-group and feature-to-group assignment matrices along with the network weights. This produces a treestructured network that involves no connection between branched subtrees of semantically disparate class groups. SplitNet thus greatly reduces the number of parameters and required computations, and is also embarrassingly modelparallelizable at test time, since the evaluation for each subnetwork is completely independent except for the shared lower layer weights that can be duplicated over multiple processors, or assigned to a separate processor. Read More
Daddy’s Car: a song composed by Artificial Intelligence – in the style of the Beatles
AI Superpowers: China, Silicon Valley, and the New World Order
Dr. Kai-Fu Lee—one of the world’s most respected experts on AI and China—reveals that China has suddenly caught up to the US at an astonishingly rapid and unexpected pace. Read More
Kai-Fu Lee on China’s Race to the Future
Silicon Valley may be the center of the tech world right now, but Kai-Fu Lee says that’s going to change, and fast. Lee—a computer scientist who worked at Apple, Microsoft, and Google before becoming a venture capitalist—predicts that China will soon overtake the United States as the world leader in innovation. Read More
‘AI Superpowers’: A Conversation With Kai-Fu Lee
China is overtaking the U.S. as the leader in artificial intelligence
China is executing its strategy for AI while the U.S. is still wrestling to create one.
Researchers, companies and countries around the world are racing to explore — and exploit — the possibilities of artificial intelligence technology. China is working on an extremely aggressive multi-billion-dollar plan for government investment into AI research and applications. The U.S. government has been slower to act. Read More
Rick's Cafe AI 