機器學習進階筆記之一 | TensorFlow安裝與入門

引言

TensorFlow是Google基於DistBelief進行研發的第二代人工智慧學習系統，被廣泛用於語音識別或圖像識別等多項機器深度學習領域。其命名來源於本身的運行原理。Tensor（張量）意味著N維數組，Flow（流）意味著基於數據流圖的計算，TensorFlow代表著張量從圖象的一端流動到另一端計算過程，是將複雜的數據結構傳輸至人工智慧神經網中進行分析和處理的過程。

TensorFlow完全開源，任何人都可以使用。可在小到一部智能手機、大到數千台數據中心伺服器的各種設備上運行。

『機器學習進階筆記』系列是將深入解析TensorFlow系統的技術實踐，從零開始，由淺入深，與大家一起走上機器學習的進階之路。

CUDA與TensorFlow安裝

按以往經驗，TensorFlow安裝一條pip命令就可以解決，前提是有fq工具，沒有的話去找找牆內別人分享的地址。而坑多在安裝支持gpu，需預先安裝英偉達的cuda，這裡坑比較多，推薦使用ubuntu deb的安裝方式來安裝cuda，run.sh的方式總感覺有很多問題，cuda的安裝具體可以參考。 注意鏈接裡面的tensorflow版本是以前的，tensorflow 現在官方上的要求是cuda7.5+cudnnV4，請在安裝的時候注意下。

Hello World

import tensorflow as tfn hello = tf.constant(Hello, TensorFlow!)n sess = tf.Session()n print sess.run(hello)n

首先，通過tf.constant創建一個常量，然後啟動Tensorflow的Session，調用sess的run方法來啟動整個graph。

接下來我們做下簡單的數學的方法：

import tensorflow as tfn a = tf.constant(2)n b = tf.constant(3)n with tf.Session() as sess:n print "a=2, b=3"n print "Addition with constants: %i" % sess.run(a+b)n print "Multiplication with constants: %i" % sess.run(a*b)n # outputn a=2, b=3n Addition with constants: 5n Multiplication with constants: 6n

接下來用tensorflow的placeholder來定義變數做類似計算：

import tensorflow as tfn a = tf.placeholder(tf.int16)n b = tf.placeholder(tf.int16)n add = tf.add(a, b)n mul = tf.mul(a, b)n with tf.Session() as sess:n # Run every operation with variable inputn print "Addition with variables: %i" % sess.run(add, feed_dict={a: 2, b: 3})n print "Multiplication with variables: %i" % sess.run(mul, feed_dict={a: 2, b: 3})n # output:n Addition with variables: 5n Multiplication with variables: 6n matrix1 = tf.constant([[3., 3.]])n matrix2 = tf.constant([[2.],[2.]])n with tf.Session() as sess:n result = sess.run(product)n print resultn

線性回歸

以下代碼來自GitHub - aymericdamien/TensorFlow-Examples: TensorFlow Tutorial and Examples for beginners,僅作學慣用

import tensorflow as tfn import numpyn import matplotlib.pyplot as pltn rng = numpy.randomnn # Parametersn learning_rate = 0.01n training_epochs = 2000n display_step = 50nn # Training Datan train_X = numpy.asarray([3.3,4.4,5.5,6.71,6.93,4.168,9.779,6.182,7.59,2.167,7.042,10.791,5.313,7.997,5.654,9.27,3.1])n train_Y = numpy.asarray([1.7,2.76,2.09,3.19,1.694,1.573,3.366,2.596,2.53,1.221,2.827,3.465,1.65,2.904,2.42,2.94,1.3])n n_samples = train_X.shape[0]nn # tf Graph Inputn X = tf.placeholder("float")n Y = tf.placeholder("float")nn # Create Modelnn # Set model weightsn W = tf.Variable(rng.randn(), name="weight")n b = tf.Variable(rng.randn(), name="bias")nn # Construct a linear modeln activation = tf.add(tf.mul(X, W), b)nn # Minimize the squared errorsn cost = tf.reduce_sum(tf.pow(activation-Y, 2))/(2*n_samples) #L2 lossn optimizer = tf.train.GradientDescentOptimizer(learning_rate).minimize(cost) #Gradient descentnn # Initializing the variablesn init = tf.initialize_all_variables()nn # Launch the graphn with tf.Session() as sess:n sess.run(init)nn # Fit all training datan for epoch in range(training_epochs):n for (x, y) in zip(train_X, train_Y):n sess.run(optimizer, feed_dict={X: x, Y: y})nn #Display logs per epoch stepn if epoch % display_step == 0:n print "Epoch:", %04d % (epoch+1), "cost=", n "{:.9f}".format(sess.run(cost, feed_dict={X: train_X, Y:train_Y})), n "W=", sess.run(W), "b=", sess.run(b)nn print "Optimization Finished!"n print "cost=", sess.run(cost, feed_dict={X: train_X, Y: train_Y}), n "W=", sess.run(W), "b=", sess.run(b)nn #Graphic displayn plt.plot(train_X, train_Y, ro, label=Original data)n plt.plot(train_X, sess.run(W) * train_X + sess.run(b), label=Fitted line)n plt.legend()n plt.show()n

邏輯回歸

import tensorflow as tfn # Import MINST datan from tensorflow.examples.tutorials.mnist import input_datan mnist = input_data.read_data_sets("/tmp/data/", one_hot=True)nn # Parametersn learning_rate = 0.01n training_epochs = 25n batch_size = 100n display_step = 1nn # tf Graph Inputn x = tf.placeholder(tf.float32, [None, 784]) # mnist data image of shape 28*28=784n y = tf.placeholder(tf.float32, [None, 10]) # 0-9 digits recognition => 10 classesnn # Set model weightsn W = tf.Variable(tf.zeros([784, 10]))n b = tf.Variable(tf.zeros([10]))nn # Construct modeln pred = tf.nn.softmax(tf.matmul(x, W) + b) # Softmaxnn # Minimize error using cross entropyn cost = tf.reduce_mean(-tf.reduce_sum(y*tf.log(pred), reduction_indices=1))n # Gradient Descentn optimizer = tf.train.GradientDescentOptimizer(learning_rate).minimize(cost)nn # Initializing the variablesn init = tf.initialize_all_variables()nn # Launch the graphn with tf.Session() as sess:n sess.run(init)nn # Training cyclen for epoch in range(training_epochs):n avg_cost = 0.n total_batch = int(mnist.train.num_examples/batch_size)n # Loop over all batchesn for i in range(total_batch):n batch_xs, batch_ys = mnist.train.next_batch(batch_size)n # Run optimization op (backprop) and cost op (to get loss value)n _, c = sess.run([optimizer, cost], feed_dict={x: batch_xs,n y: batch_ys})n # Compute average lossn avg_cost += c / total_batchn # Display logs per epoch stepn if (epoch+1) % display_step == 0:n print "Epoch:", %04d % (epoch+1), "cost=", "{:.9f}".format(avg_cost)nn print "Optimization Finished!"nn # Test modeln correct_prediction = tf.equal(tf.argmax(pred, 1), tf.argmax(y, 1))n # Calculate accuracyn accuracy = tf.reduce_mean(tf.cast(correct_prediction, tf.float32))n print "Accuracy:", accuracy.eval({x: mnist.test.images, y: mnist.test.labels})nn # result :n Epoch: 0001 cost= 29.860467369n Epoch: 0002 cost= 22.001451784n Epoch: 0003 cost= 21.019925554n Epoch: 0004 cost= 20.561320320n Epoch: 0005 cost= 20.109135756n Epoch: 0006 cost= 19.927862290n Epoch: 0007 cost= 19.548687116n Epoch: 0008 cost= 19.429119071n Epoch: 0009 cost= 19.397068211n Epoch: 0010 cost= 19.180813479n Epoch: 0011 cost= 19.026808132n Epoch: 0012 cost= 19.057875510n Epoch: 0013 cost= 19.009575057n Epoch: 0014 cost= 18.873240641n Epoch: 0015 cost= 18.718575359n Epoch: 0016 cost= 18.718761925n Epoch: 0017 cost= 18.673640560n Epoch: 0018 cost= 18.562128253n Epoch: 0019 cost= 18.458205289n Epoch: 0020 cost= 18.538211225n Epoch: 0021 cost= 18.443384213n Epoch: 0022 cost= 18.428727668n Epoch: 0023 cost= 18.304270616n Epoch: 0024 cost= 18.323529782n Epoch: 0025 cost= 18.247192113n Optimization Finished!n (10000, 784)n Accuracy 0.9206n

這裡有個小插曲，ipython notebook在一個notebook打開時，一直在佔用GPU資源，可能是之前有一個notebook一直打開著，然後佔用著GPU資源，然後在計算Accuracy的」InternalError: Dst tensor is not initialized.」 然後找了github上面也有這個問題InternalError: Dst tensor is not initialized.,可以肯定是GPU的memory相關的問題，所以就嘗試加上tf.device(『/cpu:0』)，將Accuracy這步拉到cpu上計算，但是又出現OOM的問題，最後nvidia-smi時，發現有一個python腳本一直佔用3g多的顯存，把它kill之後恢復了，之前還比較吐槽怎麼可能10000*784個float就把顯存撐爆呢，原來是自己的問題。

這裡邏輯回歸，model是一個softmax函數用來做多元分類，大概意思是選擇10當中最後預測概率最高作為最終的分類。

其實基本的tensorflow沒有特別好講的，語法的課程什麼可以去看看基本的文檔，之後我會找一點經典有趣的tensorflow的代碼應用來看看，畢竟『show me the code 』才是程序猿應有的態度。

本文由『UCloud內核與虛擬化研發團隊』提供。

關於作者：

Burness（@段石石 ）， UCloud平台研發中心深度學習研發工程師，tflearn Contributor，做過電商推薦、精準化營銷相關演算法工作，專註於分散式深度學習框架、計算機視覺演算法研究，平時喜歡玩玩演算法，研究研究開源的項目，偶爾也會去一些數據比賽打打醬油，生活中是個極客，對新技術、新技能痴迷。

「UCloud機構號」將獨家分享雲計算領域的技術洞見、行業資訊以及一切你想知道的相關訊息。

歡迎提問&求關注 o(*////▽////*)q～

以上。