第1章 緒論···································································································1
1.1 機(jī)器學(xué)習(xí)簡(jiǎn)介·······················································································2
1.2 機(jī)器學(xué)習(xí)方法的分類(lèi)··············································································5
1.3 機(jī)器學(xué)習(xí)框架·······················································································7
1.4 Python 的機(jī)器學(xué)習(xí)開(kāi)發(fā)環(huán)境····································································9
1.5 習(xí)題································································································.10
第2章 回歸分析··························································································.11
2.1 一元線(xiàn)性回歸····················································································.11
2.2 多元線(xiàn)性回歸····················································································.14
2.3 多項(xiàng)式回歸·······················································································.16
2.4 回歸分析的效果評(píng)價(jià)···········································································.17
2.5 邏輯回歸··························································································.19
2.6 實(shí)例與編程求解·················································································.22
2.7 習(xí)題································································································.26
第3章 k-近鄰算法························································································.28
3.1 k-近鄰分類(lèi)算法·················································································.28
3.2 k 值的選取························································································.30
3.3 距離度量··························································································.31
3.4 k-近鄰回歸算法·················································································.31
3.5 k-近鄰算法的性能和特點(diǎn)·····································································.33
3.6 實(shí)例與編程求解·················································································.34
3.7 習(xí)題································································································.36
第4章 決策樹(shù)·····························································································.38
4.1 決策樹(shù)的原理····················································································.38
4.2 決策樹(shù)的構(gòu)造算法··············································································.39
4.3 信息熵·····························································································.43
4.4 ID3 算法··························································································.43
4.5 C4.5 算法·························································································.44
4.6 CART 算法·······················································································.45
4.7 決策樹(shù)的剪枝····················································································.47
4.8 決策樹(shù)的特點(diǎn)····················································································.48
4.9 實(shí)例與編程求解·················································································.48
4.10 習(xí)題······························································································.52
第5章 貝葉斯分類(lèi)器····················································································.54
5.1 概率相關(guān)知識(shí)····················································································.54
5.2 貝葉斯分類(lèi)原理·················································································.55
5.3 樸素貝葉斯分類(lèi)器··············································································.56
5.4 實(shí)例與編程求解·················································································.59
5.5 習(xí)題································································································.62
第6章 支持向量機(jī)·······················································································.63
6.1 二分類(lèi)問(wèn)題·······················································································.63
6.2 支持向量機(jī)分類(lèi)原理···········································································.65
6.3 支持向量機(jī)中的核方法········································································.71
6.4 支持向量機(jī)的特點(diǎn)··············································································.74
6.5 多分類(lèi)問(wèn)題·······················································································.75
6.6 支持向量回歸····················································································.76
6.7 實(shí)例與編程求解·················································································.78
6.8 習(xí)題································································································.81
第7章 模型性能評(píng)估····················································································.84
7.1 模型性能評(píng)估的原理與方法·································································.84
7.2 錯(cuò)誤率與準(zhǔn)確率·················································································.86
7.3 混淆矩陣··························································································.87
7.4 精確率、召回率與F1 指標(biāo)···································································.88
7.5 P-R 曲線(xiàn)與ROC 曲線(xiàn)·········································································.90
7.6 實(shí)例與編程求解·················································································.93
7.7 習(xí)題································································································.96
第8章 集成學(xué)習(xí)··························································································.98
8.1 集成學(xué)習(xí)的原理·················································································.98
8.2 Bagging 和隨機(jī)森林············································································100
8.3 Boosting 和Adaboost···········································································102
8.4 提升樹(shù)·····························································································104
8.5 實(shí)例與編程求解·················································································106
8.6 習(xí)題································································································109
第9章 降維算法·························································································.111
9.1 降維的概念······················································································.111
9.2 主成分分析·······················································································112
9.3 奇異值分解·······················································································117
9.4 主成分分析的特點(diǎn)··············································································118
9.5 實(shí)例與編程求解·················································································119
9.6 習(xí)題································································································124
第10 章 聚類(lèi)·······························································································125
10.1 聚類(lèi)的概念·····················································································125
10.2 基于劃分的聚類(lèi)方法·········································································127
10.3 基于層次的聚類(lèi)方法·········································································129
10.4 基于密度的聚類(lèi)方法·········································································133
10.5 聚類(lèi)評(píng)估························································································135
10.6 確定數(shù)據(jù)集中簇的數(shù)目······································································138
10.7 幾種聚類(lèi)方法的特點(diǎn)·········································································139
10.8 實(shí)例與編程求解···············································································140
10.9 習(xí)題······························································································142
第11章 期望-最大化（EM）算法與高斯混合模型···············································144
11.1 極大似然估計(jì)法···············································································144
11.2 EM 算法·························································································147
11.3 高斯混合模型··················································································151
11.4 EM 算法和高斯混合模型的特點(diǎn)···························································155
11.5 實(shí)例與編程求解···············································································156
11.6 習(xí)題······························································································158
第12章 神經(jīng)網(wǎng)絡(luò)·························································································160
12.1 神經(jīng)元與感知機(jī)···············································································160
12.2 BP 神經(jīng)網(wǎng)絡(luò)····················································································164
12.3 神經(jīng)網(wǎng)絡(luò)模型的特點(diǎn)·········································································170
12.4 實(shí)例與編程求解···············································································171
12.5 習(xí)題······························································································174
第13章 深度學(xué)習(xí)·························································································175
13.1 卷積神經(jīng)網(wǎng)絡(luò)··················································································175
13.2 循環(huán)神經(jīng)網(wǎng)絡(luò)··················································································179
13.3 生成式對(duì)抗網(wǎng)絡(luò)···············································································184
13.4 幾種深度學(xué)習(xí)方法的特點(diǎn)···································································189
13.5 實(shí)例與編程求解···············································································190
13.6 習(xí)題······························································································193
參考文獻(xiàn)·······································································································195