来源书籍

分布式机器学习:交替方向乘子法在机器学习中的应用

Skill 版本:v24 47 张卡片

雷大江 · 清华大学出版社 · 2021-05 · 第1版 · ISBN 978-7-302-56902-2

章节与卡片

01 引言

4 张卡片
  1. 数据规模的两种瓶颈 理解等级:中级 普通读书笔记卡
  2. 分布式SGD聚合梯度 理解等级:中级 普通读书笔记卡
  3. 并行度受协调开销限制 理解等级:高级 普通读书笔记卡
  4. 数据与任务并行的区别 理解等级:初级 普通读书笔记卡

02 交替方向乘子法

8 张卡片
  1. 凸性为何排除伪极小 理解等级:中级 普通读书笔记卡
  2. 拉格朗日对偶给下界 理解等级:中级 普通读书笔记卡
  3. 共轭改写线性约束对偶 理解等级:中级 普通读书笔记卡
  4. 鞍点连接原始与对偶 理解等级:高级 普通读书笔记卡
  5. 对偶分解拆开局部计算 理解等级:中级 普通读书笔记卡
  6. 增广项为何耦合变量 理解等级:中级 普通读书笔记卡
  7. ADMM交替两块再校约束 理解等级:中级 普通读书笔记卡
  8. 一致性约束统一模型 理解等级:中级 普通读书笔记卡

03 稀疏回归

4 张卡片
  1. Lasso把小系数压到零 理解等级:中级 普通读书笔记卡
  2. 软阈值分离稀疏更新 理解等级:中级 普通读书笔记卡
  3. 样本分片汇总系数 理解等级:中级 普通读书笔记卡
  4. 特征分片汇总预测 理解等级:中级 普通读书笔记卡

04 Huber回归

5 张卡片
  1. 用重构误差做分类 理解等级:中级 普通读书笔记卡
  2. 稀疏编码的两种约束 理解等级:中级 普通读书笔记卡
  3. Huber限制大残差影响 理解等级:中级 普通读书笔记卡
  4. Huber按预测或样本拆分 理解等级:中级 普通读书笔记卡
  5. Huber近端的输入阈值 理解等级:高级 普通读书笔记卡

05 交替方向乘子法在图像处理中的应用

3 张卡片
  1. 全变差抑制噪声梯度 理解等级:中级 普通读书笔记卡
  2. 周期边界让去模糊可FFT 理解等级:高级 普通读书笔记卡
  3. 全色锐化平衡光谱与边缘 理解等级:高级 普通读书笔记卡

06 加权Huber约束稀疏表达的鲁棒性算法

4 张卡片
  1. 残差大时降低像素权重 理解等级:中级 普通读书笔记卡
  2. 外层改权重内层解编码 理解等级:中级 普通读书笔记卡
  3. 逐类权重改变分类间距 理解等级:高级 普通读书笔记卡
  4. 遮挡权重需分场景评估 理解等级:高级 普通读书笔记卡

07 自适应加权的Huber约束稀疏表达的鲁棒性算法

3 张卡片
  1. 权重总量让残差竞争 理解等级:中级 普通读书笔记卡
  2. 零权重数量直连噪声假设 理解等级:高级 普通读书笔记卡
  3. 自适应权重的收益有条件 理解等级:高级 普通读书笔记卡

08 极大不相关多元逻辑回归

4 张卡片
  1. 多类概率共享归一化 理解等级:中级 普通读书笔记卡
  2. 类参数相似性可加罚 理解等级:高级 普通读书笔记卡
  3. 判别正则迁移到输出层 理解等级:中级 普通读书笔记卡
  4. 分区增加存在饱和点 理解等级:高级 普通读书笔记卡

09 快速稀疏多元逻辑回归

6 张卡片
  1. 重加权代理绕开尖点 理解等级:中级 普通读书笔记卡
  2. 稀疏多类训练分两步 理解等级:中级 普通读书笔记卡
  3. 样本分块共享全类参数 理解等级:中级 普通读书笔记卡
  4. 特征分块共享类别得分 理解等级:中级 普通读书笔记卡
  5. 加速比先注明基线 理解等级:高级 普通读书笔记卡
  6. 稀疏输入与稠密参数共存 理解等级:中级 普通读书笔记卡

10 CoCoA框架下的Lasso回归分布式求解

4 张卡片
  1. 选原始或对偶决定切分 理解等级:高级 普通读书笔记卡
  2. CoCoA用本地计算换通信 理解等级:高级 普通读书笔记卡
  3. CoCoA的局部Lasso 理解等级:中级 普通读书笔记卡
  4. 迭代计算与分布式存储 理解等级:中级 普通读书笔记卡

11 CoCoA框架下的稀疏多元逻辑回归分布式求解

2 张卡片
  1. 光滑多类损失形成局部Lasso 理解等级:高级 普通读书笔记卡
  2. 分开比较通信与预测质量 理解等级:高级 普通读书笔记卡

全书概览

《分布式机器学习:交替方向乘子法在机器学习中的应用》读书概览

  • 作者:雷大江
  • 出版:清华大学出版社,2021年5月第1版
  • 信息浓度:高,凸优化、对偶与分片推导解释次序、可分性和通信约束,应用章给出对照实验。
  • 稳定性:高,变量拆分、Huber保真、局部优化与聚合机制可复用,历史Spark环境及实验耗时按原条件理解。
  • 评级:经典原理(高浓度、高稳定性),AI专项,P4。
  • Skill 版本:v24
  • 执行模式:light
  • 建档进度:done

整书笔记 · 阅读覆盖 · 工作流交接

轻量模式下未执行生成后笔记复核、独立审查及审查结果优化。

章节进度追踪表

章节号 章节标题 状态 卡片数
00 前言 done 0
01 引言 done 4
02 交替方向乘子法 done 8
03 稀疏回归 done 4
04 Huber回归 done 5
05 交替方向乘子法在图像处理中的应用 done 3
06 加权Huber约束稀疏表达的鲁棒性算法 done 4
07 自适应加权的Huber约束稀疏表达的鲁棒性算法 done 3
08 极大不相关多元逻辑回归 done 4
09 快速稀疏多元逻辑回归 done 6
10 CoCoA框架下的Lasso回归分布式求解 done 4
11 CoCoA框架下的稀疏多元逻辑回归分布式求解 done 2

非正文排除

spine项 类型 排除理由
1 titlepage.xhtml 生成封面 仅嵌入封面图像
2 OEBPS/Text/cover.xhtml 封面 封面和阅读宣传语
3 OEBPS/Text/titlepage1.xhtml 题名页 书名和出版标识图像
4 OEBPS/Text/copyright.xhtml 版权页 CIP、版本和发行信息用于书目核对
5 OEBPS/Text/preface1.xhtml 内容提要 提纲式宣传摘要,技术主张在前言和正文展开
6 OEBPS/Text/preface2.xhtml 作者简介 履历介绍
7 OEBPS/Text/preface3.xhtml 资助说明 中英文资助声明

待关联术语

术语名 出现章节 一句话语境
Lassplore 01 分布式稀疏逻辑回归相关工作
GROCK 01 稀疏问题的并行贪婪块坐标求解
Angel 01 参数服务器平台举例
Twister 09 可替代的分发与聚合框架
LIBSVM 格式 09 稀疏数据的输入格式
ATWT-M3 05 全锐化基线方法
IHS 05 成分替换对照
GSA 05 融合对照
NMR 06、07 遮挡分类对照
IRGSC 06、07 特征与距离权重基线
FASTA 09 串行优化实验比较项

引用文献

标题 类型 出现章节 一句话语境
01[1] Zikopoulos P, Eaton C. Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data [M]. McGraw-Hill Osborne Media, 1989. 书 01 章末书目定位
01[2] Andrew M A, Erik B. Big data: the management revolution [J]. Harvard business review, 2012, 90 (10): 60-66. 论文 01 章末书目定位
01[3] De Mauro A, Greco M, Grimaldi M. A formal definition of Big Data based on its essential features [J]. Library Review, 2016, 65 (3): 122-135. 论文 01 章末书目定位
01[4] Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters [J]. Communications of the ACM, 2008, 51 (1): 107-113. 论文 01 章末书目定位
01[5] Zaharia M, Chowdhury M, Franklin M J, et al. Spark: cluster computing with working sets [C]//Proceedings of the 2nd USENIX Workshop on Hot Topics in Cloud Computing, Boston, MA, United States: USENIX Association, 2010: 10-10. 论文 01 章末书目定位
01[6] D’Costa A, Sayeed A M. Collaborative signal processing for distributed classification in sensor networks [C]//International Coference on Information Processing in Sensor Networks. Springer-Verlag, 2003: 193-208. 论文 01 章末书目定位
01[7] Kokiopoulou E, Frossard P. Distributed classification of multiple observation sets by consensus [J]. IEEE Transactions on Signal Processing, 2011, 59 (1): 104-114. 论文 01 章末书目定位
01[8] Guyon I, Elisseeff A. An introduction to variable and feature selection [J]. Journal of Machine Learning Research, 2003, 3 (3): 1157-1182. 论文 01 章末书目定位
01[9] Liu D, Wang D, Li H. Decentralized stabilization for a class of continuous-time nonlinear interconnected systems using online learning optimal control approach [J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 25 (2): 418-428. 论文 01 章末书目定位
01[10] Lv T, Deng S, Hu Y, et al. Quantitative prediction of precipitation in the east of northwest china during the flood period by using the year-to-year increment approach [J]. Journal of Arid Meteorology, 2015, 33 (3): 386-394. 论文 01 章末书目定位
01[11] LeCun Y, Bottou L, Orr G B. Neural Networks: Tricks of the Trade [J]. Canadian Journal of Anaesthesia, 2012, 41 (7): 658. 论文 01 章末书目定位
01[12] Li F, Wu B, Xu L, et al. A fast distributed stochastic gradient descent algorithm for matrix factorization [C]//Proceedings of 3rd International Workshop on Big Data, Streams and Heterogeneous Source Mining, PMLR, 2014: 77-87. 论文 01 章末书目定位
01[13] De S, Goldstein T. Efficient distributed SGD with variance reduction [C]//IEEE International Conference on Data Mining. New York, NY, USA: IEEE, 2016: 111-120. 论文 01 章末书目定位
01[14] Martin A Z, Markus W, Alexander S, et al. Parallelized Stochastic Gradient Descent [C]//Advances in Neural Information Processing Systems 23: Conference on Neural Information Processing Systems A Meeting Held December. DBLP, 2010: 2595-2603. 论文 01 章末书目定位
01[15] Meng Q, Chen W, Yu J, et al. Asynchronous Accelerated Stochastic Gradient Descent [C]//IJCAI2016.2016: 1853-1859. 论文 01 章末书目定位
01[16] Lee J, Ma T Y, Lin Q H. Distributed Stochastic Variance Reduced Gradient Methods [J]. [EB/OL]. (2016-01-06) [2020-05-19]. https://arXiv.org/abs/1507.07595. 论文 01 章末书目定位
01[17] De S, Goldstein T. Efficient Distributed SGD with Variance Reduction [C]//IEEE International Conference on Data Mining. IEEE, 2016: 111-120. 论文 01 章末书目定位
01[18] Zhang Y, Jordan M I. Splash: User-friendly Programming Interface for Parallelizing Stochastic Algorithms [EB/OL]. (2015-06-24) [2020-05-19]. https://arXiv.org/abs/1506.07552. 论文 01 章末书目定位
01[19] Borges J S, Bioucas-Dias J M, Marçal A R S. Fast Sparse Multinomial Regression Applied to Hyperspectral Data [C]//Proceedings of the 3rd International Conference on Image Analysis and Recognition. Povoa de Varzim, Portugal: Springer Berlin Heidelberg, 2006: 700-709. 论文 01 章末书目定位
01[20] Kim S J, Koh K, Lustig M, et al. An Interior-Point Method for Large-Scale l1-Regularized Least Squares [J]. IEEE Journal of Selected Topics in Signal Processing, 2007, 1 (4): 606-617. 论文 01 章末书目定位
01[21] Koh K, Kim S J, Boyd S. A method for large-scale l1-regularized logistic regression [C]//Proceedings of the 22nd National Conference on Artificial Intelligence. Vancouver, British Columbia, Canada: AAAI Press, 2007: 565-571. 论文 01 章末书目定位
01[22] Liu J, Chen J, Ye J. Large-scale sparse logistic regression [C]//Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’09. Paris, France: Association for Computing Machinery (ACM) , 2009: 547-555. 论文 01 章末书目定位
01[23] Peng Z, Yan M, Yin W. Parallel and distributed sparse optimization [C]//Proceedings of the 2013 47th Asilomar Conference on Signals, Systems and Computers. Pacific Grove, CA, United States: IEEE Computer Society, 2013: 659-664. 论文 01 章末书目定位
01[24] Gopal S, Yang Y. Distributed training of large-scale logistic models [C]//Proceedings of the 30th International Conference on Machine Learning. Atlanta, GA, United States: International Machine Learning Society (IMLS) , 2013: 948-956. 论文 01 章末书目定位
01[25] Raman P, Srinivasan S, Matsushima S, et al. DS-MLR: Exploiting double separability for scaling up distributed multinomial logistic regression [EB/OL]. (2016-04-16) [2020-05-19]. https://arXiv.org/abs/1604.04706. 论文 01 章末书目定位
01[26] Meng X, Bradley J, Yavuz B, et al. Mllib: Machine learning in apache spark [J]. The Journal of Machine Learning Research, 2016, 17 (1): 1235-1241. 论文 01 章末书目定位
01[27] Jiang J, Yu L, Jiang J, et al. Angel: a new large-scale machine learning system [J]. National Science Review, 2017, 5 (2): 216-236. 论文 01 章末书目定位
01[28] Gabay D, Mercier B. A dual algorithm for the solution of non linear variational problems via finite element approximation [M]. Great Britain: Institut de recherche d’informatique et d’automatique, 1975: 17-40. 书 01 章末书目定位
01[29] Chang T H, Hong M, Liao W C, et al. Asynchronous distributed ADMM for large-scale optimization—PartⅠ: Algorithm and convergence analysis [J]. IEEE Transactions on Signal Processing, 2016, 64 (12): 3118-3130. 论文 01 章末书目定位
01[30] Zhang R, Kwok J. Asynchronous distributed ADMM for consensus optimization [C]//In Proceedings of the 31st International Conference on Machine Learning. Great Britain: International Conference on Machine Learning, 2014: 1701-1709. 论文 01 章末书目定位
01[31] Bertsekas D P. Constrained optimization and Lagrange multiplier methods [M]. New York, USA: Academic Press, 2014: 24-28. 书 01 章末书目定位
01[32] Boyd S, Parikh N, Chu E, et al. Distributed optimization and statistical learning via the alternating direction method of multipliers [J]. Foundations & Trends in Machine Learning, 2010, 3 (1): 1-122. 论文 01 章末书目定位
01[33] Wei E, Ozdaglar A. Distributed alternating direction method of multipliers [C]//2012 IEEE 51st IEEE Conference on Decision and Control (CDC) . IEEE, 2013. 论文 01 章末书目定位
01[34] Wahlberg B, Boyd S, Annergren M, et al. An ADMM algorithm for a class of total variation regularized estimation problems [J]. The International Federation of Automatic Control, 2012, 45 (16): 83-88. 论文 01 章末书目定位
01[35] Nedic A, Ozdaglar A. On the rate of convergence of distributed subgradient methods for multi-agent optimization [C]//Decision and Control, 2007 46th IEEE Conference on IEEE, 2008. 论文 01 章末书目定位
01[36] Nedic A, Ozdaglar A, Parrilo P A. Constrained Consensus and Optimization in Multi-Agent Networks [J]. IEEE Transactions on Automatic Control, 2010, 55 (4): 922-38. 论文 01 章末书目定位
01[37] Schizas I D, Mateos G, Giannakis G B. Distributed LMS for Consensus-Based In-Network Adaptive Processing [J]. IEEE Transactions on Signal Processing, 2009, 57 (6): 2365-82. 论文 01 章末书目定位
01[38] Fukushima M. Application of the alternating direction of multipliers to separable convex programming problems [J]. Computational Optimization & Applications, 1992, 1 (1): 93-111. 论文 01 章末书目定位
01[39] 亢良伊,王建飞,刘杰,等.可扩展机器学习的并行与分布式优化算法综述[J].软件学报,2018,29(1):109-130. 论文 01 章末书目定位
01[40] Taylor G, Burmeister R, Xu Z, et al. Training Neural Networks Without Gradients: A Scalable ADMM Approach [J]. The Journal of Machine Learning Research, 2016 (48): 2722-2731. 论文 01 章末书目定位
01[41] Zhang R, Kwok J T. Asynchronous distributed ADMM for consensus optimization [C]//Proceedings of the 31st International Conference on International Conference on Machine Learning. Beijing, 2014: 1701-1709. 论文 01 章末书目定位
01[42] Qing L, Gang W, Yuan K, et al. On the Linear Convergence of the ADMM in Decentralized Consensus Optimization [J]. IEEE Transactions on Signal Processing a Publication of the IEEE Signal Processing Society, 2014. 论文 01 章末书目定位
01[43] Bradley J K, Kyrola A, Bickson D, et al. Parallel coordinate descent for L1-regularized loss minimization [EB/OL]. (2011-05-20) [2020-05-19]. https://arXiv.org/abs/1105.5379. 论文 01 章末书目定位
01[44] Wei E, Asuman O. On the O (1/k) convergence of asynchronous distributed alternating direction method of multipliers [C]//2013 IEEE Global Conference on Signal and Information Processing. Austin TX, 2013: 551-554. 论文 01 章末书目定位
01[45] Smith V, Forte S, Ma C, et al. CoCoA: A general framework for communication-efficient distributed optimization [J]. The Journal of Machine Learning Research, 2017, 18 (1): 8590-8638. 论文 01 章末书目定位
01[46] Abadi M, Barham P, Chen J, et al. TensorFlow: A system for large-scale machine learning [C]//Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation. Savannah, GA, United States: USENIX Association, 2016: 265-283. 论文 01 章末书目定位
01[47] Jia Y, Shelhamer E, Donahue J, et al. Caffe: Convolutional architecture for fast feature embedding [C]//Proceedings of the 2014 ACM Conference on Multimedia, MM 2014. Orlando, FL, United States: Association for Computing Machinery (ACM) , 2014: 675-678. 论文 01 章末书目定位
02[1] Boyd s, Vandenberghe L. Convex Optimization [M]. Cambridge, UK: Cambridge University Press, 2004. 书 02 章末书目定位
02[2] Boyd S, Parikh N, Chu E, et al. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers [J]. Foundations & Trends in Machine Learning, 2010, 3 (1): 1-122. 论文 02 章末书目定位
02[3] He, B S, Yuan, X M. On the Convergence Rate of the Douglas-Rachford Alternating Direction Method [J]. Siam Journal on Numerical Analysis, 2012, 50 (2): 700-709. 论文 02 章末书目定位
02[4] He, B S, Yuan, X M. On non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers [J]. Numerische Mathematik, 2014, 130 (3): 567-577. 论文 02 章末书目定位
03[1] Boyd S, Parikh N, Chu E, et al. Distributed optimization and statistical learning via the alternating direction method of multipliers [J]. Foundations and Trends in Machine learning, 2011, 3 (1): 1-122. 论文 03 章末书目定位
03[2] Ramdas A, Tibshirani R J. Fast and flexible admm algorithms for trend filtering [J]. Journal of Computational and Graphical Statistics, 2016, 25 (3): 839-858. 论文 03 章末书目定位
03[3] Zhang Z, Xu Y, Yang J, et al. A survey of sparse representation: algorithms and applications [J]. IEEE Access, 2015, 3: 490-530. 论文 03 章末书目定位
03[4] 刘建伟,崔立鹏,刘泽宇,等.正则化稀疏模型[J].计算机学报,2015,38(7):1307-1325. 论文 03 章末书目定位
03[5] 周雁舟,乔辉,吴晓萍,等.基于LASSO-LARS的软件复杂性度量属性特征选择研究[J].计算机科学,2013,40(11):169-173. 论文 03 章末书目定位
03[6] Tibshirani R. Regression shrinkage and selection via the lasso [J]. Journal of the Royal Statistical Society: Series B (Methodological) , 1996, 58 (1): 267-288. 论文 03 章末书目定位
04[1] 余家林,孙季丰,李万益.基于多核稀疏编码的三维人体姿态估计[J].电子学报,2016,44(8):1899-1908. 论文 04 章末书目定位
04[2] 王宪保,章国琼,姚明海.稀疏编码改进方法及其在缺陷检测中的应用研究[J].小型微型计算机系统,2017,38(1):165-168. 论文 04 章末书目定位
04[3] 赵玉兰,苑全德,孟祥萍.基于稀疏编码和机器学习的多姿态人脸识别算法[J].吉林大学学报(理学版),2018,40(2):340-346. 论文 04 章末书目定位
04[4] Yanan L, Fei W, Zhihua Z, et al. Sparse Representation Using Nonnegative Curds and Whey [C]//IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2010: 3578-3585. 论文 04 章末书目定位
04[5] Shenghua G, Wai Hung T, Liang Tien C, et al. Local features are not lonely—Laplacian sparse coding for image classification [C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, California, USA: IEEE, 2010: 3555-3561. 论文 04 章末书目定位
04[6] Wang J, Yang J, Yu K, et al. Locality-constrained Linear Coding for image classification [C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, California, USA: IEEE, 2010: 3360-3367. 论文 04 章末书目定位
04[7] Ramírez I, Lecumberry F, Sapiro G. Universal priors for sparse modeling [C]//2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing. IEEE, 2009: 197-200. 论文 04 章末书目定位
05[1] 贺兴华.MATLAB 7.X图像处理[M].北京:人民邮电出版社,2006. 书 05 章末书目定位
05[2] 张峥嵘,孙玉宝,黄丽丽,等.全变差图像恢复的交替方向乘子法[J].计算机工程与应用2010,46(14):8-11. 论文 05 章末书目定位
05[3] Rudin L I, Osher S. Total variation based image restoration with free local constraints [C]//IEEE International Conference on Image Precessing. IEEE Xplore, 1994: 31-35. 论文 05 章末书目定位
05[4] Wang Y, Yang J, Yin W, et al. A New Alternating Minimization Algorithm for Total Variation Image Reconstruction [J]. SIAM Journal on Imaging Sciences, 2008, 1 (3): 248-272. 论文 05 章末书目定位
05[5] Rafael C. Gonzalez, Richard E. Woods. Digital Image Processing [J]. prentice hall international, 2008, 28 (4): 484-486. 论文 05 章末书目定位
05[6] Ng M K, Chan R H, Tang W C. A Fast Algorithm for Deblurring Models with Neumann Boundary Conditions [J]. Siam Journal on Scientific Computing, 1999, 21 (3): 851-866. 论文 05 章末书目定位
05[7] Thomas C, Ranchin T, Wald L, et al. Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on remote sensing physics [J]. IEEE Transactions on Geoscience and Remote Sensing, 2008, 46 (5): 1301-1312. 论文 05 章末书目定位
05[8] Liu Y, Liu S, Wang Z. A general framework for image fusion based on multi-scale transform and sparse representation [J]. Information Fusion, 2015, 24: 147-164. 论文 05 章末书目定位
05[9] Ji F, Li Z R, Chang X, et al. Remote Sensing Image Fusion Method Based on PCA and NSCT Transform [J]. Journal of Graphics, 2017, 38 (2): 247-252. 论文 05 章末书目定位
05[10] Choi M. A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter [J]. IEEE Transactions on Geoscience and Remote Sensing, 2006, 44 (6): 1672-1682. 论文 05 章末书目定位
05[11] Rahmani S, Strait M, Merkurjev D, et al. An Adaptive IHS Pan-Sharpening Method [J]. IEEE Geoscience and Remote Sensing Letters, 2010, 7 (4): 746-750. 论文 05 章末书目定位
05[12] Xu L, Zhang Y M, Gao Y N, et al. Using guided filtering to improve gram-schmidt based Pansharpening method for Geo Eye-1 satellite images [C]//International Conference on Information Systems and Computing Technology. Paris, France: Atlantis Press, 2016: 33-37. 论文 05 章末书目定位
05[13] Ranchin T, Wald L. Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation [J]. Photogrammetric Engineering & Remote Sensing, 2000, 66 (2): 49-61. 论文 05 章末书目定位
05[14] Otazu X, Gonzalez-Audicana M, Fors O, et al. Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods [J]. IEEE Transactions on Geoscience and Remote Sensing, 2005, 43 (10): 2376-2385. 论文 05 章末书目定位
05[15] Aiazzi B, Alparone L, Baronti S, et al. MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery [J]. Photogrammetric Engineering & Remote Sensing, 2006, 72 (5): 591-596. 论文 05 章末书目定位
05[16] Khan M M, Alparone L, Chanussot J. Pansharpening quality assessment using the modulation transfer functions of instruments [J]. IEEE transactions on geoscience and remote sensing, 2009, 47 (11): 3880-3891. 论文 05 章末书目定位
05[17] Ballester C, Caselles V, Igual L, et al. A variational model for P+XS image fusion [J]. International Journal of Computer Vision, 2006, 69 (1): 43-58. 论文 05 章末书目定位
05[18] Piella G. Image fusion for enhanced visualization: A variational approach [J]. International journal of computer vision, 2009, 83 (1): 1-11. 论文 05 章末书目定位
05[19] Aiazzi B, Alparone L, Baronti S, et al. MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery [J]. Photogrammetric Engineering & Remote Sensing, 2006, 72 (5): 591-596. 论文 05 章末书目定位
05[20] Baronti S, Aiazzi B, Selva M, et al. A theoretical analysis of the effects of aliasing and misregistration on pansharpened imagery [J]. IEEE Journal of Selected Topics in Signal Processing, 2011, 5 (3): 446-453. 论文 05 章末书目定位
05[21] Shan Q, Jia J Y, Agarwala A. High-quality motion deblurring from a single image [J]. Acm transactions on graphics (tog) , 2008, 27 (3): 1-10. 论文 05 章末书目定位
05[22] Zeng D L, Hu Y W, Huang Y, et al. Pan-sharpening with structural consistency and l1/2 gradient prior [J]. Remote Sensing Letters, 2016, 7 (12): 1170-1179. 论文 05 章末书目定位
05[23] Tao P D, An L T H. A DC optimization algorithm for solving the trust-region subproblem [J]. SIAM Journal on Optimization, 1998, 8 (2): 476-505. 论文 05 章末书目定位
06[1] Jianwei Z, Ping Y, Shengyong C, et al. Iterative Re-Constrained Group Sparse Face Recognition With Adaptive Weights Learning [J]. IEEE Transactions on Image Processing, 2017, 26 (5): 2408-2423. 论文 06 章末书目定位
06[2] Meng Y, Lei Z, Jian Y, et al. Robust sparse coding for face recognition [M]. Computer Vision and Pattern Recognition. Colorado Springs, CO, USA: IEEE, 2011: 625-632. 书 06 章末书目定位
06[3] Can Yi L, Hai M, Jie G, et al. Face recognition via Weighted Sparse Representation [J]. Journal of Visual Communication & Image Representation, 2013, 24 (2): 111-116. 论文 06 章末书目定位
06[4] Zizhu F, Ming N, Qi Z, et al. Weighted sparse representation for face recognition [J]. Neurocomputing, 2015, 151 (1): 304-309. 论文 06 章末书目定位
06[5] Timofte R, Gool L V. Adaptive and Weighted Collaborative Representations for image classification [J]. Pattern Recognition Letters, 2014, 43 (1): 127-135. 论文 06 章末书目定位
06[6] Tao L, Jian Xun M, Ying L, et al. Robust face recognition via sparse boosting representation [J]. Neurocomputing, 2016, 214: 944-957. 论文 06 章末书目定位
06[7] Jian Xun M, Qiankun F, Weisheng L. Adaptive Class Preserving Representation for Image Classification [C]//IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, United states;IEEE. 2017: 2624-2632. 论文 06 章末书目定位
06[8] Boyd S, Parikh N, Chu E, et al. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers [J]. Foundations & Trends in Machine Learning, 2010, 3 (1): 1-122. 论文 06 章末书目定位
06[9] Wei D, Wotao Y. On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers [J]. Journal of Scientific Computing, 2015, 66 (3): 889-916. 论文 06 章末书目定位
06[10] Goldstein T, Donoghue, Setzer S. Fast Alternating Direction Optimization Methods [J]. Siam Journal on Imaging Sciences, 2014, 7 (3): 225-231. 论文 06 章末书目定位
06[11] He B, Yuan X. On non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers [J]. Numerische Mathematik, 2015, 130 (3): 567-577. 论文 06 章末书目定位
06[12] Haoxi L, Haifeng H, Yip C. Comments On “Iterative Re-constrained Group Sparse Face Recognition with Adaptive Weights Learning” [J]. IEEE Trans Image Process, 2017, 26 (11): 5475-5476. 论文 06 章末书目定位
07[1] Tao L, Jian Xun M, Ying L, et al. Robust face recognition via sparse boosting representation [J]. Neurocomputing, 2016, 214: 944-957. 论文 07 章末书目定位
07[2] Jian Xun M, Qiankun F, Weisheng L. Adaptive Class Preserving Representation for Image Classification [C]//IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, United states;IEEE. 2017: 2624-2632. 论文 07 章末书目定位
07[3] Wei D, Wotao Y. On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers [J]. Journal of Scientific Computing, 2015, 66 (3): 889-916. 论文 07 章末书目定位
07[4] Goldstein T, Donoghue, Setzer S. Fast Alternating Direction Optimization Methods [J]. Siam Journal on Imaging Sciences, 2014, 7 (3): 225-231. 论文 07 章末书目定位
07[5] He B, Yuan X. On non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers [J]. Numerische Mathematik, 2015, 130 (3): 567-577. 论文 07 章末书目定位
07[6] Haoxi L, Haifeng H, Yip C. Comments On “Iterative Re-constrained Group Sparse Face Recognition with Adaptive Weights Learning” [J]. IEEE Trans Image Process, 2017, 26 (11): 5475-5476. 论文 07 章末书目定位
07[7] 赵玉兰,苑全德,孟祥萍.基于稀疏编码和机器学习的多姿态人脸识别算法[J].吉林大学学报(理学版),2018,40(2):340~346. 论文 07 章末书目定位
07[8] Dexing Z, Zichao X, Yanrui L, et al. Loose L1/2 regularised sparse representation for face recognition [J]. Computer Vision Iet, 2015, 9 (2): 251-258. 论文 07 章末书目定位
07[9] Boyd, Vandenberghe, Faybusovich. Convex Optimization [J]. IEEE Transactions on Automatic Control, 2006, 51 (11): 1859-1859. 论文 07 章末书目定位
08[1] Jr D H W, Lemeshow S. Applied Logistic Regression [J]. Technometrics, 2000, 34 (1): 358-359. 论文 08 章末书目定位
08[2] Shevade S K, Keerthi S S. A simple and efficient algorithm for gene selection using sparse logistic regression [J]. Bioinformatics, 2003, 19 (17): 2246-2253. 论文 08 章末书目定位
08[3] Algamal Z Y, Ali H T M. An efficient gene selection method for high-dimensional microarray data based on sparse logistic regression [J]. Electronic Journal of Applied Statistical Analysis, 2017, 10 (1): 242-256. 论文 08 章末书目定位
08[4] Zou H, Hastie T. Regularization and variable selection via the elastic net [J]. Journal of the Royal Statistical Society, 2005, 67 (2): 301-320. 论文 08 章末书目定位
08[5] Kurth T, Walker A M, Glynn R J, et al. Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect [J]. American Journal of Epidemiology, 2006, 163 (3): 262. 论文 08 章末书目定位
08[6] Zou H. The Adaptive Lasso and Its Oracle Properties [J]. Publications of the American Statistical Association, 2006, 101 (476): 1418-1429. 论文 08 章末书目定位
08[7] Galar M, Ndez A, Barrenechea E, et al. An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes [J]. Pattern Recognition, 2011, 44 (8): 1761-1776. 论文 08 章末书目定位
08[8] Borges J S, Bioucas-Dias J M, Marçal A R S. Fast Sparse Multinomial Regression Applied to Hyperspectral Data [M]. Palo Alto, CA, USA: Springer Berlin Heidelberg, 2006: 700-709. 书 08 章末书目定位
08[9] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition [EB/OL]. (2014-05-26) [2020-05-19]. http://arXiv.org/abs.1409.1556. 论文 08 章末书目定位
08[10] Chang C C, Lin C J. LIBSVM: A library for support vector machines [J]. ACM Trans. Intell. Syst. Technol., 2011, 2 (3): 1-27. 论文 08 章末书目定位
09[1] Rubin D B. Iteratively reweighted least squares [J]. Encyclopedia of Statistical Science, 1983, 4 (1): 1-8. 论文 09 章末书目定位
09[2] Krishnapuram B, Carin L, Figueiredo M A, et al. Sparse multinomial logistic regression: Fast algorithms and generalization bounds [J]. IEEE transactions on pattern analysis and machine intelligence, 2005, 27 (6): 957-968. 论文 09 章末书目定位
09[3] Borges J S, Bioucas-Dias J M, Marçal A R S. Fast Sparse Multinomial Regression Applied to Hyperspectral Data [C]//Proceedings of the 3rd International Conference on Image Analysis and Recognition, ICIAR 2006. Povoa de Varzim, Portugal: Springer Berlin Heidelberg, 2006: 700-709. 论文 09 章末书目定位
09[4] Li S, Maddah-Ali M A, Avestimehr A S. Fundamental tradeoff between computation and communication in distributed computing [C]//Proceedings of the IEEE International Symposium on Information Theory. Los Angeles, CA, United States: IEEE, 2018: 109-128. 论文 09 章末书目定位
09[5] Liu T-Y, Chen W, Wang T. Distributed Machine Learning: Foundations, Trends, and Practices [C]//Proceedings of the Proceedings of the 26th International Conference on World Wide Web Companion. Perth, WA, Australia: International World Wide Web Conferences Steering Committee, 2019: 913-915. 论文 09 章末书目定位
09[6] Chen J, Li K, Tang Z, et al. A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment [J]. IEEE Transactions on Parallel and Distributed Systems, 2017, 28 (4): 919-933. 论文 09 章末书目定位
09[7] Mateos G, Bazerque J A, Giannakis G B. Distributed Sparse Linear Regression [J]. IEEE Transactions on Signal Processing, 2010, 58 (10): 5262-5276. 论文 09 章末书目定位
09[8] Hao Z, Cano A, Giannakis G B. Distributed Consensus-Based Demodulation: Algorithms and Error Analysis [J]. IEEE Transactions on Wireless Communications, 2010, 9 (6): 2044-2054. 论文 09 章末书目定位
09[9] Schizas I D, Mateos G, Giannakis G B. Distributed LMS for Consensus-Based In-Network Adaptive Processing [J]. IEEE Transactions on Signal Processing, 2009, 57 (6): 2365-2382. 论文 09 章末书目定位
09[10] Deng W, Yin W. On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers [J]. Journal of Scientific Computing, 2015, 66 (3): 889-916. 论文 09 章末书目定位
09[11] Boyd S, Parikh N, Chu E, et al. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers [J]. Foundations & Trends in Machine Learning, 2010, 3 (1): 1-122. 论文 09 章末书目定位
09[12] Goldstein T, O’Donoghue B, Setzer S, et al. Fast alternating direction optimization methods [J]. Siam Journal on Imaging Sciences, 2014, 7 (3): 1588-1623. 论文 09 章末书目定位
09[13] He B, Yuan X. On non-ergodic convergence rate of Douglas–Rachford alternating direction method of multipliers [J]. Numerische Mathematik, 2012, 130 (3): 567-577. 论文 09 章末书目定位
09[14] Chang C C, Lin C J. LIBSVM: A library for support vector machines [J]. ACM Trans. Intell. Syst. Technol., 2011, 2 (3): 1-27. 论文 09 章末书目定位
10[1] Bottou L. Large-scale machine learning with stochastic gradient descent [C]//Proceedings of COMPSTAT’2010. Physica-Verlag HD, 2010: 177-186. 论文 10 章末书目定位
10[2] Boyd S, Parikh N, Chu E, et al. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers [J]. Foundations & Trends in Machine Learning, 2010, 3 (1): 1-122. 论文 10 章末书目定位
10[3] Smith V, Forte S, Ma C, et al. CoCo A: A general framework for communication-efficient distributed optimization [J]. The Journal of Machine Learning Research, 2017, 18 (1): 8590-8638. 论文 10 章末书目定位
10[4] Wang J, Kolar M, Srebro N, et al. Efficient distributed learning with sparsity [C]//Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 2017: 3636-3645. 论文 10 章末书目定位
10[5] Krishnapuram B, Carin L, Figueiredo M A T, et al. Sparse multinomial logistic regression: Fast algorithms and generalization bounds [J]. IEEE transactions on pattern analysis and machine intelligence, 2005, 27 (6): 957-968. 论文 10 章末书目定位
10[6] Zou H, Hastie T. Regularization and Variable Selection via the Elastic Net [J]. Journal of The Royal Statistical Society Series B-statistical Methodology, 2005, 67, 301-320. 论文 10 章末书目定位
10[7] Vapnik V. Statistical Learning Theory [M]. New York, NY: Wiley, 1998. 书 10 章末书目定位
11[1] Liu J, Chen J, Ye J. Large-scale sparse logistic regression [C]//Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining. 2009: 547-556. 论文 11 章末书目定位
11[2] Koh K, Kim S J, Boyd S. An interior-point method for large-scale l1-regularized logistic regression [J]. Journal of Machine learning research, 2007, 8 (Jul): 1519-1555. 论文 11 章末书目定位
11[3] Algamal Z. An efficient gene selection method for high-dimensional microarray data based on sparse logistic regression [J]. Electronic Journal of Applied Statistical Analysis, 2017, 10 (1): 242-256. 论文 11 章末书目定位
11[4] Ng A Y. Feature selection, L1 vs. L2 regularization, and rotational invariance [C]//Proceedings of the twenty-first international conference on Machine learning. 2004: 78-85. 论文 11 章末书目定位
11[5] Kwak C, Clayton-Matthews A. Multinomial logistic regression [J]. Nursing Research, 2002, 51 (6): 404-410. 论文 11 章末书目定位

资金安全问题案例

问题标题 问题卡 解决方案卡 出现章节 一句话说明

实践卡进度

序号 实践标题 实践方式 状态 关联章节 产出
1 核对两种分片的通信量 横向学习 done 09 核对两种分片的通信量
2 比较局部求解预算 最小实验 done 10 比较局部求解预算

实践候选筛选:done

保留分片通信与局部计算预算两个问题。全量 Spark 集群复现与公开人脸数据实验需要额外环境,当前计划集中于可控的局部分解和通信假设。

相关主题

从本书的主题进入跨书阅读,对照其他书籍的讲解。下方数量包含主题关联的全部卡片与书籍。

暂无公开主题。