Google Tensorflow 源码编译(二):Bazel

这几天终于把tensorflow安装上了,中间遇到过不少的问题,这里记录下来。供大家想源码安装的参考。

安装环境:POWER8处理器,Docker容器Ubuntu14.04镜像。

Build Bazel<v0.1.0> for IBM POWER8 CPU from Source Code

My computer's os is ubuntu 14.04 , and I want to install bazel, There is only java7 available, so I choose bazel 0.1.0.
Here are the steps that I succeed to install bazel 0.1.0 on my computer:

1. Get source code
  git clone https://github.com/bazelbuild/bazel.git
  git checkout 0.1.0

2. Install protobuf
  Check which version is needed:

  opuser@nova:~/tensorflow/bazel-0.1.0$ ls third_party/protobuf/
  LICENSE protobuf-java-3.0.0-alpha-3.jar protoc-linux-x86_64.exe protoc-osx-x86_32.exe protoc-windows-x86_32.exe
  README.md protoc-linux-x86_32.exe protoc-linux-x86_64.real protoc-osx-x86_64.exe protoc-windows-x86_64.exe

  protobuf-java-3.0.0-alpha-3.jar is the jar file bazel uses. so we need to install protobuf with version <3.0.0-alpha-3> , you can refer to "Build Protobuf<v3.0.0-alpha-3> for IBM POWER8 CPU from Source Code" to build protobuf .

3. Create a link protoc-linux-x86_64.exe to protoc binary file
  such as : ln -s /usr/bin/protoc $(pwd)/ third_party/protobuf/protoc-linux-x86_64.exe

4. Install other dependencies
4.1 sudo apt-get install zlib1g-dev zip unzip openjdk-7-jre openjdk-7-jdk
4.2 add java path to ~/.bashrc
  export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-ppc64el
  export JRE_HOME=${JAVA_HOME}/jre
  export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
  export PATH=${JAVA_HOME}/bin:$PATH

5. Modify bazel source code to support POWER cpu
5.1 in src/main/java/com/google/devtools/build/lib/util/CPU.java
  in enum "public enum CPU" add
  POWER("power", ImmutableSet.of("power", "power64le", "power64be", "ppc")),

5.2 in /src/main/java/com/google/devtools/build/lib/analysis/config/BuildConfiguration.java
  in function "public static class HostCpuConverter implements Converter<String>"add:
  case POWER:
  return "power";
5.3 in tools/cpp/CROSSTOOL, add
  default_toolchain {
  cpu: "power"
  toolchain_identifier: "local_linux"
  }
5.4 in third_party/BUILD, add
  config_setting(
  name = "power",
  values = {"host_cpu": "power"},
  )
5.5 in scripts/bootstrap/buildenv.sh, add
  MACHINE_IS_64BIT='yes'

6. Compile bazel
  ./compile // better to see step 7 before run ./compile
  after a long time, a message displayed:
  Build successful! Binary is here: /home/opuser/tensorflow/tools/bazel-0.1.0/output/bazel

7. Problems during compiling
  It is not easy to build bazel from source code. not to mention that I build it in a docker container. there are mainly two problems.

7.1 namespace-sandbox
  <error: mount() permission denied!>
  bazel may choose to build a sanbox which uses namespace . but there are priority strictions in container. to avoid this problem, you can choose not to build sandbox .
  I refer to dcreager's solution posted at https://github.com/bazelbuild/bazel/issues/418. create a bazelrc and use command "BAZELRC=/tmp/bazelrc ./compile.sh" to compile the code. the bazelrc file  contains:  
  startup --batch
  build --spawn_strategy=standalone --genrule_strategy=standalone

7.2 openjdk-7

  <error: unrecognized option -client!>

  The java installed on my computer does not support -client option, but -server option is ok. just as the issue  opened at

  https://github.com/bazelbuild/bazel/issues/56

   Although there is a commit about this:

  https://github.com/bazelbuild/bazel/commit/1fa163c42ee26a72c21c118ec820d677a431ee49#commitcomment-13207150.

  But it does not work to me. so I changed all the -client option to -server.

8. Reference

Can't run Bazel as part of a Docker build due to sandboxing issues
https://github.com/bazelbuild/bazel/issues/418
Compiling the Java example with SAP JVM does not work
https://github.com/bazelbuild/bazel/issues/56
Add jvm_opts attribute to the java_toolchain rule
https://github.com/bazelbuild/bazel/commit/1fa163c42ee26a72c21c118ec820d677a431ee49#commitcomment-13207150.

  

上一篇:TF Boys (TensorFlow Boys ) 养成记(二)


下一篇:人工智能(AI)库TensorFlow 踩坑日记之二