Theano: A CPU and GPU Math Compiler in Python

Abstract—Theano is a compiler for mathematical expressions in Python that combines the convenience of NumPy’s syntax with the speed of optimized native machine language. The user composes mathematical expressions in a high-level description that mimics NumPy’s syntax and semantics, while being statically typed and functional (as opposed to imperative). These expressions allow Theano to provide symbolic differentiation. Before performing computation, Theano optimizes the choice of expressions, translates them into C++ (or CUDA for GPU), compiles them into dynamically loaded Python modules, all automatically. Common machine learn-ing algorithms implemented with Theano are from 1.6 × to 7.5× faster than…

• CI
  Canadian Institute for Advanced Research
• UD
  Université de Montréal
• NS
  Natural Sciences and Engineering Research Council of Canada