迁移学习相关资料_transformer 迁移 王晋东

转自王晋东的博客

迁移学习简介

迁移学习(transfer learning)通俗来讲，就是运用已有的知识来学习新的知识，核心是找到已有知识和新知识之间的相似性，用成语来说就是举一反三。由于直接对目标域从头开始学习成本太高，我们故而转向运用已有的相关知识来辅助尽快地学习新知识。比如，已经会下中国象棋，就可以类比着来学习国际象棋；已经会编写Java程序，就可以类比着来学习C#；已经学会英语，就可以类比着来学习法语；等等。世间万事万物皆有共性，如何合理地找寻它们之间的相似性，进而利用这个桥梁来帮助学习新知识，是迁移学习的核心问题。

图1不同位置、不同传感器的迁移标定。已知一个房间中A点的WiFi信号与相应的人体行为，如何标定另一个房间中C点的蓝牙信号？

具体地，在迁移学习中，我们已有的知识叫做源域(source domain)，要学习的新知识叫目标域(target domain)。迁移学习研究如何把源域的知识迁移到目标域上。特别地，在机器学习领域中，迁移学习研究如何将已有模型应用到新的不同的、但是有一定关联的领域中。传统机器学习在应对数据的分布、维度，以及模型的输出变化等任务时，模型不够灵活、结果不够好，而迁移学习放松了这些假设。在数据分布、特征维度以及模型输出变化条件下，有机地利用源域中的知识来对目标域更好地建模。另外，在有标定数据缺乏的情况下，迁移学习可以很好地利用相关领域有标定的数据完成数据的标定。

图2 迁移学习与传统机器学习的不同。(a)传统机器学习对不同的学习任务建立不同的模型，(b)迁移学习利用源域中的数据将知识迁移到目标域，完成模型建立。插图来自：Sinno Jialin Pan and Qiang Yang, A survey on transfer learning. IEEE TKDE 2010.

迁移学习按照学习方式可以分为基于样本的迁移，基于特征的迁移，基于模型的迁移，以及基于关系的迁移。基于样本的迁移通过对源域中有标定样本的加权利用完成知识迁移；基于特征的迁移通过将源域和目标域映射到相同的空间（或者将其中之一映射到另一个的空间中）并最小化源域和目标域的距离来完成知识迁移；基于模型的迁移将源域和目标域的模型与样本结合起来调整模型的参数；基于关系的迁移则通过在源域中学习概念之间的关系，然后将其类比到目标域中，完成知识的迁移。

理论上，任何领域之间都可以做迁移学习。但是，如果源域和目标域之间相似度不够，迁移结果并不会理想，出现所谓的负迁移情况。比如，一个人会骑自行车，就可以类比学电动车；但是如果类比着学开汽车，那就有点天方夜谭了。如何找到相似度尽可能高的源域和目标域，是整个迁移过程最重要的前提。

迁移学习方面，代表人物有香港科技大学的Qiang Yang教授，南洋理工大学的Sinno Jialin Pan，以及第四范式的CEO戴文渊等。代表文献是Sinno Jialin Pan和Qiang Yang的A survey on transfer learning。

作者网站：http://jd92.wang.

[参考资料]

[1] Pan S J, Yang Q. A survey on transfer learning[J]. IEEE Transactions on knowledge and data engineering, 2010, 22(10): 1345-1359.

[2] Introduction to Transfer Learning: http://jd92.wang/assets/files/l03_transferlearning.pdf。

[3] Qiang Yang: http://www.cse.ust.hk/~qyang/.

[4] Sinno Jialin Pan: http://www.ntu.edu.sg/home/sinnopan/.

[5] Wenyuan Dai: https://scholar.google.com/citations?user=AGR9pP0AAAAJ&hl=zh-CN.

Transfer learning applications

迁移学习的应用

• 20191222 NIPS-19 workshop Sim-to-Real Domain Adaptation For High Energy Physics

  • Transfer learning for high energy physics
  • 迁移学习用于高能物理

• 20191222 arXiv Transfer learning in hybrid classical-quantum neural networks

  • Transfer learning for quantum neural networks

• 20191214 arXiv Unsupervised Transfer Learning via BERT Neuron Selection

  • Unsupervised transfer learning via BERT neuron selection

• 20191214 arXiv Transfer Learning-Based Outdoor Position Recovery with Telco Data

  • Outdoor position recorvey with Telco data using transfer learning

• 20191214 NIPS-19 workshop Cross-Language Aphasia Detection using Optimal Transport Domain Adaptation

  • Optimal transport domain adaptation

• 20191201 arXiv A Transfer Learning Method for Goal Recognition Exploiting Cross-Domain Spatial Features

  • A transfer learning method for goal recognition
  • 用迁移学习分析语言中的目标

• 20191201 AAAI-20 Zero-Resource Cross-Lingual Named Entity Recognition

  • Zero-resource cross-lingual NER
  • 零资源的跨语言NER

• 20191125 arXiv Attention Privileged Reinforcement Learning For Domain Transfer

  • Attention privileged reinforcement learning for domain transfer

• 20191124 Cantonese Automatic Speech Recognition Using Transfer Learning from Mandarin

  • Cantonese speech recognition using transfer learning from mandarin
  • 普通话语音识别迁移到广东话识别

• 20191115 arXiv Instance-based Transfer Learning for Multilingual Deep Retrieval

  • Instance based transfer learning for multilingual deep retrieval
  • 基于实例的迁移学习用于多语言的retrieval

• 20191115 arXiv Unsupervised Pre-training for Natural Language Generation: A Literature Review

  • Unsupervised pre-training for natural language generation survey
  • 一篇无监督预训练用于自然语言生成的综述

• 20191115 AAAI-20 Unsupervised Domain Adaptation on Reading Comprehension

  • 无监督DA用于阅读理解
  • Unsupervised DA for reading comprehension

• 20191113 arXiv Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation

  • Supervised multi-modal domain adaptation in VQA
  • 有监督的多模态DA用于VQA任务

• 20191113 arXiv NegBERT: A Transfer Learning Approach for Negation Detection and Scope Resolution

  • Transfer learning for negation detection and scope resolution
  • 迁移学习用于否定检测

• 20191113 AAAI-20 TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

  • Finetune twice for answer sentence selection
  • 两次finetune用于answer sentence selection

• 20191111 NIPS-19 workshop Transfer Learning in 4D for Breast Cancer Diagnosis using Dynamic Contrast-Enhanced Magnetic Resonance Imaging

  • Transfer learning in 4D for breast cancer diagnosis

• 20191111 BigData-19 Deep Transfer Learning for Thermal Dynamics Modeling in Smart Buildings

  • Transfer learning for thermal dynamics modeling

• 20191111 arXiv Unsupervised Domain Adaptation of Contextual Embeddings for Low-Resource Duplicate Question Detection

  • Unsupervised DA for low-resource duplicate question detection

• 20191111 arXiv Towards Domain Adaptation from Limited Data for Question Answering Using Deep Neural Networks

  • DA for question answering using DNN

• 20191111 arXiv Teacher-Student Training for Robust Tacotron-based TTS

  • Teacher-student network for robust TTS

• 20191111 arXiv SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization

  • Fine-tuning for pre-trained language model

• 20191111 arXiv Change your singer: a transfer learning generative adversarial framework for song to song conversion

  • Adversarial transfer learning for song-to-song conversion

• 20191111 arXiv Transfer Learning in Spatial-Temporal Forecasting of the Solar Magnetic Field

  • Transfer learning for solar magnetic field

• 20191111 arXiv Deep geometric knowledge distillation with graphs

  • Deep geometric knowledge distillation with graphs

• 20191101 arXiv Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning

  • Adversarial transfer learning for aspect-based sentement analysis
  • 对抗迁移用于aspect层级的情感分析

• 20191101 Transfer Learning from Transformers to Fake News Challenge Stance Detection (FNC-1) Task

  • A fake news challenges based on transformers
  • 一个基于transformer的假新闻检测挑战

• 20191029 arXiv NER Models Using Pre-training and Transfer Learning for Healthcare

  • Pretraining NER models for healthcare
  • 预训练的NER模型用于健康监护

• 20191029 WACV-20 Progressive Domain Adaptation for Object Detection

  • Progressive domain adaptation for object recognition
  • 渐进式的DA用于物体检测

• 20191029 WSDM-20 Meta-Learning with Dynamic-Memory-Based Prototypical Network for Few-Shot Event Detection

  • Meta learning with dynamic memory based prototypical network for few-shot event detection

• 20191017 arXiv Evolution of transfer learning in natural language processing

  • Survey transfer learning works in NLP
  • 综述了最近迁移学习在NLP的一些进展

• 20191017 arXiv Unsupervised Domain Adaptation Meets Offline Recommender Learning

  • Unsupervised DA meets offline recommender learning
  • 无监督DA用于离线推荐系统

• 20191017 Transfer Learning for Algorithm Recommendation

  • Transfer learning for algorithm recommendation
  • 迁移学习用于算法推荐

• 20191015 arXiv Emotion Recognition in Conversations with Transfer Learning from Generative Conversation Modeling

  • Emotion recognition in conversations with transfer learning
  • 用迁移学习进行对话中的情绪识别

• 20191015 WSDM-20 DDTCDR: Deep Dual Transfer Cross Domain Recommendation

  • Cross-modal recommendation using dual transfer learning
  • 用对偶迁移进行跨模态推荐

• 20191011 NeurIPS-19 Unified Language Model Pre-training for Natural Language Understanding and Generation

  • Unified language model pre-training for understanding and generation
  • 统一的语言模型预训练用于自然语言理解和生成

• 20191011 ICIP-19 Cross-modal knowledge distillation for action recognition

  • Cross-modal knowledge distillation for action recognition
  • 跨模态的知识蒸馏并用于动作识别

• 20191011 NeurIPS-19 workshop Language Transfer for Early Warning of Epidemics from Social Media

  • Language transfer to predict epidemics from social media
  • 通过社交网络数据预测传染病并进行语言模型的迁移

• 20191008 arXiv, ICCV-19 demo Cross-Domain Complementary Learning with Synthetic Data for Multi-Person Part Segmentation

  • Learning human body part segmentation without human labeling
  • 基於合成數據的跨域互補學習人體部位分割

• 20191008 arXiv Transfer Brain MRI Tumor Segmentation Models Across Modalities with Adversarial Networks

  • Transfer learning for multi-modal brain MRI tumor segmentation
  • 用迁移学习进行多模态的MRI肿瘤分割

• 20191008 ICONIP-19 Semi-Supervised Domain Adaptation with Representation Learning for Semantic Segmentation across Time

  • Semi-supervised domain adaptation with representation learning for semantic segmentation
  • 半监督DA用于语义分割

• 20191008 arXiv Noise as Domain Shift: Denoising Medical Images by Unpaired Image Translation

  • Noise as domain shift for medical images
  • 医学图像中的噪声进行adaptation

• 20190926 arXiv Restyling Data: Application to Unsupervised Domain Adaptation

  • Restyle data using domain adaptation
  • 使用domain adaptation进行风格迁移

• 20190916 ISWC-19 Cross-dataset deep transfer learning for activity recognition

  • Cross-dataset transfer learning for activity recognition
  • 跨数据集的深度迁移学习用于行为识别

• 20190912 MICCAI workshop Multi-Domain Adaptation in Brain MRI through Paired Consistency and Adversarial Learning

  • Multi-domain adaptation for brain MRI
  • 多领域的adaptation用于大脑MRI识别

• 20190909 IJCAI-FML-19 FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare

  • The first work on federated transfer learning for wearable healthcare
  • 第一个将联邦迁移学习用于可穿戴健康监护的工作

• 20190829 EMNLP-19 Investigating Meta-Learning Algorithms for Low-Resource Natural Language Understanding Tasks

  • Investigating MAML for low-resource NMT
  • 调查了MAML方法用于低资源的NMT问题的表现

• 20190829 EMNLP-19 Unsupervised Domain Adaptation for Neural Machine Translation with Domain-Aware Feature Embeddings

  • Domain adaptation for NMT

• 20190828 MICCAI-19 workshop Cross-modality Knowledge Transfer for Prostate Segmentation from CT Scans

  • Cross-modality transfer for prostate segmentation
  • 跨模态的迁移用于前列腺分割

• 20180828 ICCV-19 workshop Unsupervised Deep Feature Transfer for Low Resolution Image Classification

  • Deep feature transfer for low resolution image classification
  • 深度特征迁移用于低分辨率图像分类

• 20190828 arXiv VAE-based Domain Adaptation for Speaker Verification

  • Speaker verification using VAE domain adaptation
  • 基于VAE的speaker verification

• 20190821 arXiv Shallow Domain Adaptive Embeddings for Sentiment Analysis

  • Domain adaptative embedding for sentiment analysis
  • 迁移学习用于情感分类

• 20190813 IJAIT Transferring knowledge from monitored to unmonitored areas for forecasting parking spaces

  • Transfer learning for forecasting parking spaces
  • 用迁移学习预测停车空间

• 20190809 ICCASP-19 Cross-lingual Text-independent Speaker Verification using Unsupervised Adversarial Discriminative Domain Adaptation

  • Text independent speaker verification using adversarial DA
  • 文本无关的speaker verification用DA

• 20190809 IJCAI-19 Progressive Transfer Learning for Person Re-identification

  • Progressive transfer learning for RE_ID
  • 渐进式迁移学习用于RE_ID

• 20190809 NeurIPS-18 MacNet: Transferring Knowledge from Machine Comprehension to Sequence-to-Sequence Models

  • Transfer learning from machine comprehension to sequence to senquence Models
  • 从机器理解到序列模型迁移

• 20190802 arXiv Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning

  • Accurate Sleep Staging with deep transfer learning
  • 用深度迁移学习进行精准的睡眠阶段估计

• 20190729 MICCAI-19 Annotation-Free Cardiac Vessel Segmentation via Knowledge Transfer from Retinal Images

  • Cardiac vessel segmentation using transfer learning from Retinal Images
  • 用视网膜图片进行迁移学习用于心脏血管分割

• 20190703 arXiv Disentangled Makeup Transfer with Generative Adversarial Network

  • Makeup transfer with GAN
  • 用GAN进行化妆的迁移

• 20190703 arXiv Applying Transfer Learning To Deep Learned Models For EEG Analysis

  • Apply transfer learning to EEG
  • 用深度迁移学习进行EEG分析

• 20190626 arXiv A Novel Deep Transfer Learning Method for Detection of Myocardial Infarction

  • A deep transfer learning method for detecting myocardial infarction
  • 一种用于监测心肌梗塞的深度迁移方法

• 20190517 PHM-19 Domain Adaptive Transfer Learning for Fault Diagnosis

  • Domain adaptation for fault diagnosis
  • 领域自适应用于错误检测

• 20190515 ACL-19 Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies

  • Cross-lingual transfer of NMT
  • 跨语言的NMT模型迁移

• 20190509 arXiv Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Images

  • Domain adaptation for semantic segmentation in aerial images
  • DA应用于鸟瞰图像语义分割

• 20190508 arXiv Text2Node: a Cross-Domain System for Mapping Arbitrary Phrases to a Taxonomy

  • Cross-domain system for mapping arbitrary phrases to a taxonomy

• 20190508 arXiv On Transfer Learning For Chatter Detection in Turning Using Wavelet Packet Transform and Empirical Mode Decomposition

  • Transfer learning for chatter detection
  • 用迁移学习进行叽叽喳喳聊天识别

• 20190416 arXiv Deep Transfer Learning for Single-Channel Automatic Sleep Staging with Channel Mismatch

  • Using deep transfer learning for sleep stage recognition
  • 用深度迁移学习进行睡眠阶段的检测

• 20190415 PAKDD-19 Targeted Knowledge Transfer for Learning Traffic Signal Plans

  • Targeted knowledge transfer for traffic control
  • 目标知识迁移应用于交通红绿灯

• 20190415 PAKDD-19 Knowledge Graph Rule Mining via Transfer Learning

  • Knowledge Graph Rule Mining via Transfer Learning
  • 迁移学习应用于知识图谱

• 20190415 PAKDD-19 Adaptively Transfer Category-Classifier for Handwritten Chinese Character Recognition

  • Transfer learning for handwritten Chinese character recognition
  • 用迁移学习进行中文手写体识别

• 20190415 PAKDD-19 Multi-task Learning for Target-Dependent Sentiment Classification

  • Multi-task learning for sentiment classification
  • 用多任务学习进行任务依赖的情感分析

• 20190415 PAKDD-19 Spatial-Temporal Multi-Task Learning for Within-Field Cotton Yield Prediction

  • Spatial-Temporal multi-task learning for cotton yield prediction
  • 时空依赖的多任务学习用于棉花收入预测

• 20190415 PAKDD-19 Passenger Demand Forecasting with Multi-Task Convolutional Recurrent Neural Networks

  • Passenger demand forecasting with multi-task CRNN
  • 用多任务CRNN模型进行顾客需求估计

• 20190409 arXiv Unsupervised Domain Adaptation for Multispectral Pedestrian Detection

  • Domain adaptation for pedestrian detection
  • 无监督领域自适应用于多模态行人检测

• 20190408 arXiv Unsupervised Domain Adaptation of Contextualized Embeddings: A Case Study in Early Modern English

  • Domain adaptation in early modern english
  • Case study: 在英文中的domain adaptation

• 20190408 USENIX-19 Transfer Learning for Performance Modeling of Deep Neural Network Systems

  • Using transfer learning for performance modeling in DNN
  • 在深度网络中使用迁移学习进行性能建模

• 20190403 arXiv Transfer Learning for Clinical Time Series Analysis using Deep Neural Networks

  • Using transfer learning for multivariate clinical data
  • 使用迁移学习进行多元医疗数据迁移

• 20190403 arXiv Med3D: Transfer Learning for 3D Medical Image Analysis

  • Transfer learning for 3D medical image analysis
  • 迁移学习用于3D医疗图像分析

• 20190401 arXiv Cross-Subject Transfer Learning in Human Activity Recognition Systems using Generative Adversarial Networks

  • Cross-subject transfer learning using GAN
  • 用对抗网络进行跨用户的行为识别

• 20190305 arXiv Unsupervised Domain Adaptation Learning Algorithm for RGB-D Staircase Recognition

  • Domain adaptation for RGB-D staircase recognition
  • Domain adaptation进行深度和RGB楼梯识别

• 20190221 arXiv Transfusion: Understanding Transfer Learning with Applications to Medical Imaging

  • Analyzing the influence of transfer learning in medical imaging
  • 在医疗图像中分析迁移学习作用

• 20190123 arXiv Transfer Learning and Meta Classification Based Deep Churn Prediction System for Telecom Industry

  • Transfer learning in telcom industry
  • 迁移学习用于电信行业

• 20190123 arXiv Cold-start Playlist Recommendation with Multitask Learning

  • Cold-start playlist recommendation with multitask learning
  • 用多任务学习进行冷启动状态下的播放列表推荐

• 20190123 arXiv Adapting Convolutional Neural Networks for Geographical Domain Shift

  • Convolutional neural network for geographical domain shift
  • 将卷积网络用于地理学上的domain shift问题

• 20190117 NeurIPS-18 workshop Transfer Learning for Prosthetics Using Imitation Learning

  • Using transfer learning for prosthetics
  • 用迁移学习进行义肢的模仿学习

• 20190115 IJAERS Weightless Neural Network with Transfer Learning to Detect Distress in Asphalt

  • Transfer learning to detect distress in asphalt
  • 用迁移学习检测路面情况

• 20190115 arXiv Disease Knowledge Transfer across Neurodegenerative Diseases

  • Transfer learning for neurodegenerative disease
  • 迁移学习用于神经退行性疾病

• 20190111 ICMLA-18 Supervised Transfer Learning for Product Information Question Answering

  • Transfer learning for product information question answering
  • 利用迁移学习进行产品信息的对话

• 20190102 arXiv High Quality Monocular Depth Estimation via Transfer Learning

  • Monocular depth estimation using transfer learning
  • 用迁移学习进行单眼深度估计

• 20181230 arXiv The CORAL+ Algorithm for Unsupervised Domain Adaptation of PLDA

  • Use CORAL for speaker recognition
  • 用CORAL改进版进行speaker识别

• 20181230 arXiv Domain-Aware Generalized Zero-Shot Learning

  • Domain-aware zero-shot learning

• 20181225 arXiv A Multi-task Neural Approach for Emotion Attribution, Classification and Summarization

  • A multi-task approach for emotion attribution, classification, and summarization
  • 一个多任务方法同时用于情绪归属、分类和总结

• 20181225 arXiv A General Approach to Domain Adaptation with Applications in Astronomy

  • Adopting active learning to transfer model
  • 用主动学习来进行模型迁移并应用到天文学上

• 20181225 arXiv An Integrated Transfer Learning and Multitask Learning Approach for Pharmacokinetic Parameter Prediction

  • Using transfer learning for Pharmacokinetic Parameter Prediction
  • 用迁移学习进行药代动力学参数估计

• 20181221 arXiv Deep Transfer Learning for Static Malware Classification

  • Deep Transfer Learning for Static Malware Classification
  • 用深度迁移学习进行恶意软件分类

• 20181221 arXiv PnP-AdaNet: Plug-and-Play Adversarial Domain Adaptation Network with a Benchmark at Cross-modality Cardiac Segmentation

  • Adversarial transfer learning for medical images
  • 对抗迁移学习用于医学图像分割

• 20181220 arXiv Domain Adaptation for Reinforcement Learning on the Atari

  • Reinforcement domain adaptation on Atari games
  • 迁移强化学习用于Atari游戏

• 20181220 arXiv Deep UL2DL: Channel Knowledge Transfer from Uplink to Downlink

  • Channel knowledge transfer in CSI
  • Wifi定位中的知识迁移

• 20181219 NER-19 Transfer Learning in Brain-Computer Interfaces with Adversarial Variational Autoencoders

  • Transfer learning in brain-computer interfaces
  • 迁移学习在脑机交互中的应用

• 20181219 ICCPS-19 Simulation to scaled city: zero-shot policy transfer for traffic control via autonomous vehicles

  • Transfer learning in autonomous vehicles
  • 迁移学习用于自动驾驶车辆的策略迁移

• 20181218 arXiv Transfer learning to model inertial confinement fusion experiments

  • Using transfer learning for inertial confinement fusion
  • 用迁移学习进行惯性约束聚变

• 20181214 arXiv Bridging the Generalization Gap: Training Robust Models on Confounded Biological Data

  • Transfer learning for generalizing on biological data
  • 用迁移学习增强生物数据的泛化能力

• 20181214 BioCAS-19 ECG Arrhythmia Classification Using Transfer Learning from 2-Dimensional Deep CNN Features

  • Deep transfer learning for EEG Arrhythmia Classification
  • 深度迁移学习用于心率不齐分类

• 20181214 LAK-19 Transfer Learning using Representation Learning in Massive Online Open Courses

  • Transfer learning in MOOCs
  • 迁移学习用于大规模在线网络课程

• 20181214 DVPBA-19 Considering Race a Problem of Transfer Learning

  • Consider race in transfer learning
  • 在迁移学习问题中考虑种族问题(跨种族迁移)

• 20181213 arXiv Multichannel Semantic Segmentation with Unsupervised Domain Adaptation

  • Robot vision semantic segmentation with domain adaptation
  • 用于机器视觉中语义分割的domain adaptation

• 20181212 arXiv 3D Scene Parsing via Class-Wise Adaptation

  • Class-wise adaptation for 3D scene parsing
  • 类别的适配用于3D场景分析

• 20181212 arXiv Secure Federated Transfer Learning

  • Federated transfer learning + Encryption
  • 联邦迁移学习+加密(杨强团队)

• 20181206 NeurIPS-18 workshop Towards Continuous Domain adaptation for Healthcare

  • English: Continuous domain adaptation for healthcare
  • 中文：连续的domain adaptation用于健康监护

• 20181206 NeurIPS-18 workshop A Hybrid Instance-based Transfer Learning Method

  • English: Instance-based transfer learning for healthcare
  • 中文：基于样本的迁移学习用于健康监护

• 20181205 arXiv Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognition

  • English: Transfer learning for surgical phase recognition
  • 中文：迁移学习用于外科手术阶段识别

• 20181204 arXiv From Known to the Unknown: Transferring Knowledge to Answer Questions about Novel Visual and Semantic Concepts

  • English: Transfer learning for VQA
  • 中文：用迁移学习进行VQA任务

• 20181128 arXiv Cross-domain Deep Feature Combination for Bird Species Classification with Audio-visual Data

  • English: Cross-domain deep feature combination for bird species classification
  • 中文：跨领域的鸟分类

• 20181128 NeurIPS-18 workshop Multi-Task Generative Adversarial Network for Handling Imbalanced Clinical Data

  • English: Multi-task learning for imbalanced clinical data
  • 中文：多任务学习用于不平衡的就诊数据

• 20181128 WACV-19 CNN based dense underwater 3D scene reconstruction by transfer learning using bubble database

  • English: Transfer learning for underwater 3D scene reconstruction
  • 中文：用迁移学习进行水下3D场景重建

• 20181127 NeurIPS-18 workshop Predicting Diabetes Disease Evolution Using Financial Records and Recurrent Neural Networks

  • English: Predicting diabetes using financial records
  • 中文：用财务记录预测糖尿病

• 20181123 NIPS-18 workshop Population-aware Hierarchical Bayesian Domain Adaptation

  • English: Applying domain adaptation to health
  • 中文：将domain adaptation应用于健康

• 20181121 arXiv Transferrable End-to-End Learning for Protein Interface Prediction

  • English: Transfer learning for protein interface prediction
  • 中文：用迁移学习进行蛋白质接口预测

• 20181121 NSFREU-18 Transfer Learning with Deep CNNs for Gender Recognition and Age Estimation

  • English: Deep transfer learning for Gender Recognition and Age Estimation
  • 中文：用深度迁移学习进行性别识别和年龄估计

• 20181121 arXiv Distribution Discrepancy Maximization for Image Privacy Preserving

  • English: Distribution Discrepancy Maximization for Image Privacy Preserving
  • 中文：通过最大化分布差异来进行图片隐私保护

• 20181120 arXiv Spatial-temporal Multi-Task Learning for Within-field Cotton Yield Prediction

  • English: Multi-task learning for cotton yield prediction
  • 中文：多任务学习用于棉花产量预测

• 20181117 arXiv Unsupervised domain adaptation for medical imaging segmentation with self-ensembling

  • English: Medical imaging using transfer learning
  • 中文：使用迁移学习进行医学图像分割

• 20181117 arXiv Performance Estimation of Synthesis Flows cross Technologies using LSTMs and Transfer Learning

  • English: Performance Estimation of Synthesis Flows cross Technologies using LSTMs and Transfer Learning
  • 中文：利用迁移学习进行合成flow评价

• 20181117 AAAI-19 GaitSet: Regarding Gait as a Set for Cross-View Gait Recognition

  • English: Cross-view gait recognition
  • 中文：跨视图的步态识别

• 20181115 AAAI-19 Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents

  • English: Transfer learning for spoken language understanding
  • 中文：无监督迁移学习用于语言理解

• 20181114 arXiv A Framework of Transfer Learning in Object Detection for Embedded Systems

  • English: Transfer learning in embedded system for object detection
  • 中文：在嵌入式系统中进行针对目标检测的迁移学习

• 20181107 ICONIP-18 Transductive Learning with String Kernels for Cross-Domain Text Classification

  • English: String kernel for cross-domain text classification using transfer learning
  • 中文：用string kernel进行迁移学习跨领域文本分类

• 20181012 arXiv Bird Species Classification using Transfer Learning with Multistage Training

  • English: Using transfer learning for bird species classification
  • 中文：用迁移学习进行鸟类分类

• 20181012 arXiv Survival prediction using ensemble tumor segmentation and transfer learning

  • English: Predicting the survival of the tumor patient using transfer learning
  • 中文：用迁移学习估计肿瘤病人存活时间

• 20181012 ICMLA-18 Virtual Battery Parameter Identification using Transfer Learning based Stacked Autoencoder

  • English: Using transfer learning for calculating the virtual battery in a thermostatics load
  • 中文：用迁移学习进行恒温器的电量估计

• 20180912 PervasiveHealth-18 Transfer Learning and Data Fusion Approach to Recognize Activities of Daily Life

  • English: Transfer learning to perform activity recognition using multi-model sensors
  • 中文：用多模态传感器进行迁移学习，用于行为识别

• 20180912 ICIP-18 Adversarial Domain Adaptation with a Domain Similarity Discriminator for Semantic Segmentation of Urban Areas

  • English: Semantic segmentation using transfer learning
  • 中文：用迁移学习进行语义分割

• 20180912 arXiv Tensor Alignment Based Domain Adaptation for Hyperspectral Image Classification

  • English: Hyperspectral image classification using domain adaptation
  • 中文：用domain adaptation进行图像分类

• 20180909 arXiv Driving Experience Transfer Method for End-to-End Control of Self-Driving Cars

  • English: Driving experience transfer on self-driving cars
  • 中文：自动驾驶车上的驾驶经验迁移

• 20180909 arXiv Deep Learning for Domain Adaption: Engagement Recognition

  • English: deep transfer learning for engagement recognition
  • 中文：用深度迁移学习进行人机交互中的engagement识别

• 20180904 EMBC-18 Multi-Cell Multi-Task Convolutional Neural Networks for Diabetic Retinopathy Grading Kang

  • English: Use multi-task CNN for Diabetic Retinopathy Grading Kang
  • 中文：用多任务的CNN进行糖尿病的视网膜粒度检查

• 20180904 ICPR-18 Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks

  • English: Document image classification using transfer learning
  • 中文：使用迁移学习进行文档图像的分类

• 20180826 ISPRS journal Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images

  • English: a multi-task learning network for remote sensing
  • 中文：提出一个多任务的深度网络用于遥感图像检测

• 20180823 ICPR-18 Multi-task multiple kernel machines for personalized pain recognition from functional near-infrared spectroscopy brain signals

  • English: A multi-task method to recognize pains
  • 中文：提出一个multi-task框架来检测pain

• 20180821 arXiv Unsupervised adversarial domain adaptation for acoustic scene classification

  • English: Using transfer learning for acoustic classification
  • 中文：迁移学习用于声音场景分类

• 20180819 arXiv Transfer Learning and Organic Computing for Autonomous Vehicles

  • English: Propose different transfer learning methods to adapt the situation of autonomous driving
  • 中文：提出一些不同的迁移学习方法应用于自动驾驶的环境适配

• 20180819 arXiv Transfer Learning for Brain-Computer Interfaces: An Euclidean Space Data Alignment Approach

  • English: Propose to align the different distributions of EEG signals using transfer learning
  • 中文：针对EEG信号不同人分布不一样的问题提出迁移学习和数据增强的方式加以解决

• 20180801 arXiv Multimodal Deep Domain Adaptation

  • English: Use multi-modal DA in robotic vision
  • 中文：在机器人视觉中使用多模态的domain adaptation

• 20180801 arXiv Rank and Rate: Multi-task Learning for Recommender Systems

  • English: A multi-task system for recommendation
  • 中文：一个针对于推荐系统的多任务学习

• 20180801 MICCAI-18 Leveraging Unlabeled Whole-Slide-Images for Mitosis Detection

  • English: Use unlabeled images for mitosis detection
  • 中文：用未标记的图片进行细胞有丝分裂的检测

• 20180801 ECCV-18 DOCK: Detecting Objects by transferring Common-sense Knowledge

  • English: A method called DOCK for object detection using transfer learning
  • 中文：提出一个叫做DOCK的方法进行基于迁移学习的目标检测

• 20180801 ECCV-18 A Zero-Shot Framework for Sketch-based Image Retrieval

  • English: A Zero-Shot Framework for Sketch-based Image Retrieval
  • 中文：一个针对于简笔画图像检索的zero-shot框架

• 20180731 ICANN-18 Metric Embedding Autoencoders for Unsupervised Cross-Dataset Transfer Learning

  • English: Deep transfer learning for Re-ID
  • 中文：将深度迁移学习用于Re-ID

• 20180705 arXiv 将迁移学习应用于自动驾驶中的不同天气适配：Modular Vehicle Control for Transferring Semantic Information to Unseen Weather Conditions using GANs

• 20180627 arXiv 用迁移学习进行感染预测：Domain Adaptation for Infection Prediction from Symptoms Based on Data from Different Study Designs and Contexts

• 20180627 arXiv 生成模型用于姿态迁移：Generative Models for Pose Transfer

• 20180622 arXiv 跨领域的人脸识别用于银行认证系统：Cross-Domain Deep Face Matching for Real Banking Security Systems

• 20180621 arXiv 迁移学习用于角膜组织的分类：Transfer Learning with Human Corneal Tissues: An Analysis of Optimal Cut-Off Layer

• 20180621 arXiv 迁移学习用于强化学习中的图像翻译：Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

• 20180615 Interspeech-18 很全面地探索了很多类方法在语音识别上的应用：A Study of Enhancement, Augmentation, and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition

• 20180615 Interspeech-18 对话中的语音识别：Unsupervised Adaptation with Interpretable Disentangled Representations for Distant Conversational Speech Recognition

• 20180614 arXiv 跨数据集的person reid：Cross-dataset Person Re-Identification Using Similarity Preserved Generative Adversarial Networks

• 20180614 arXiv 将迁移学习应用于多个speaker的文字到语音：Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis

• 20180613 SIGIR-18 多任务学习用于推荐系统：Explainable Recommendation via Multi-Task Learning in Opinionated Text Data

• 20180613 CVPR-18 跨数据集的VQA：Cross-Dataset Adaptation for Visual Question Answering

• 20180612 ICASSP-18 迁移学习用于资源少的情感分类：Semi-supervised and Transfer learning approaches for low resource sentiment classification

• 20180612 KDD-18 多任务学习用于ICU病人数据挖掘：Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICU

• 20180610 CEIG-17 将迁移学习用于插图分类：Transfer Learning for Illustration Classification

• 20180610 BioNLP-18 将迁移学习用于病人实体分类：Embedding Transfer for Low-Resource Medical Named Entity Recognition: A Case Study on Patient Mobility

• 20180610 MICCAI-18 将迁移学习用于前列腺图分类：Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images

• 20180610 arXiv 迁移学习用于Coffee crop分类：A Comparative Study on Unsupervised Domain Adaptation Approaches for Coffee Crop Mapping

• 20180605 arXiv 迁移学习应用于胸X光片分割：Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation

• 20180604 arXiv 用CNN迁移学习进行硬化症检测：One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networks

• 20180530 MNRAS 用迁移学习检测银河星系兼并：Using transfer learning to detect galaxy mergers

• 20180529 arXiv 迁移学习用于表情识别：Meta Transfer Learning for Facial Emotion Recognition

• 20180524 KDD-18 用迁移学习方法进行人们的ID迁移：Learning and Transferring IDs Representation in E-commerce

• 20180519 arXiv 用迁移学习进行物体检测，200帧/秒：Object detection at 200 Frames Per Second

• 20180519 arXiv 用迁移学习进行肢体语言识别：Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform

• 20180516 ACL-18 将对抗迁移学习用于危机状态下的舆情分析：Domain Adaptation with Adversarial Training and Graph Embeddings

• 20180504 arXiv 用迁移学习进行心脏病检测分类：ECG Heartbeat Classification: A Deep Transferable Representation

• 20180427 CVPR-18(workshop) 将深度迁移学习用于Person-reidentification： Adaptation and Re-Identification Network: An Unsupervised Deep Transfer Learning Approach to Person Re-Identification

• 20180426 arXiv 迁移学习用于医学名字实体检测；Label-aware Double Transfer Learning for Cross-Specialty Medical Named Entity Recognition

• 20180425 arXiv 将bagging和dropping结合起来进行迁移的一个深度网络：A New Channel Boosted Convolution Neural Network using Transfer Learning

• 20180425 arXiv 迁移学习应用于自然语言任务：Dropping Networks for Transfer Learning

• 20180421 arXiv 采用联合分布适配的深度迁移网络用于工业生产中的错误诊断：Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application

• 20180419 arXiv 跨领域的推荐系统：CoNet: Collaborative Cross Networks for Cross-Domain Recommendation

• 20180413 arXiv 跨模态检索：Cross-Modal Retrieval with Implicit Concept Association

• 20180410 arXiv 用迁移学习进行犯罪现场的图像匹配：Cross-Domain Image Matching with Deep Feature Maps

• 20180408 ASRU-18 用迁移学习中的domain separation network进行speech recognition：Unsupervised Adaptation with Domain Separation Networks for Robust Speech Recognition

• 20180408 arXiv 小数据集上的迁移学习手写体识别：Boosting Handwriting Text Recognition in Small Databases with Transfer Learning

• 20180404 arXiv 用迁移学习进行物体检测：Transferring Common-Sense Knowledge for Object Detection

• 20180402 arXiv 将迁移学习用于癌症检测：Improve the performance of transfer learning without fine-tuning using dissimilarity-based multi-view learning for breast cancer histology images

• 迁移学习用于行为识别 Transfer learning for activity recognition

https://arxiv.org/pdf/1411.1792.pdf

https://www.nature.com/articles/nature21056.epdf?referrer_access_token=_snzJ5POVSgpHutcNN4lEtRgN0jAjWel9jnR3ZoTv0NXpMHRAJy8Qn10ys2O4tuP9jVts1q2g1KBbk3Pd3AelZ36FalmvJLxw1ypYW0UxU7iShiMp86DmQ5Sh3wOBhXDm9idRXzicpVoBBhnUsXHzVUdYCPiVV0Slqf-Q25Ntb1SX_HAv3aFVSRgPbogozIHYQE3zSkyIghcAppAjrIkw1HtSwMvZ1PXrt6fVYXt-dvwXKEtdCN8qEHg0vbfl4_m&tracking_referrer=edition.cnn.com