| Caffe | Torch | Theano | TensorFlow | |
| Language | C++, Python | Lua | Python | Python |
| Pretrained | Yes ++ | Yes ++ | Yes (Lasagne) | Inception |
| Multi-GPU: Data parallel | Yes | Yes | Yes | Yes |
| Multi-GPU: Model parallel | No | Yes | Experimental | Yes (best) |
| Readable source code | Yes (C++) | Yes (Lua) | No | No |
| Good at RNN | No | Mediocre | Yes | Yes (best) |