Software:Chainer

From HandWiki
Short description: Machine learning software
Chainer
Original author(s)Seiya Tokui
Developer(s)Community, Preferred Networks, Inc.
Initial releaseJune 9, 2015; 9 years ago (2015-06-09).[1][2]
Written inPython
Platformcross-platform
Available inPython
TypeDeep learning library
LicenseMIT
Websitechainer.org

Chainer is an open source deep learning framework written purely in Python on top of NumPy and CuPy Python libraries. The development is led by Japanese venture company Preferred Networks in partnership with IBM, Intel, Microsoft, and Nvidia.[3][4][5][6]

Chainer is notable for its early adoption of "define-by-run" scheme, as well as its performance on large scale systems.[1] The first version was released in June 2015 and has gained large popularity in Japan since then.[1][2] Furthermore, in 2017, it was listed by KDnuggets in top 10 open source machine learning Python projects.[7]

In December 2019, Preferred Networks announced the transition of its development effort from Chainer to PyTorch and it will only provide maintenance patches after releasing v7.[8]

Define-by-run

Chainer was the first deep learning framework to introduce the define-by-run approach.[9][10] The traditional procedure to train a network was in two phases: define the fixed connections between mathematical operations (such as matrix multiplication and nonlinear activations) in the network, and then run the actual training calculation. This is called the define-and-run or static-graph approach. Theano and TensorFlow are among the notable frameworks that took this approach. In contrast, in the define-by-run or dynamic-graph approach, the connection in a network is not determined when the training is started. The network is determined during the training as the actual calculation is performed.

One of the advantages of this approach is that it is intuitive and flexible.[11] If the network has complicated control flows such as conditionals and loops, in the define-and-run approach, specially designed operations for such constructs are needed. On the other hand, in the define-by-run approach, programming language's native constructs such as if statements and for loops can be used to describe such flow. This flexibility is especially useful to implement recurrent neural networks.[12][13]

Another advantage is ease of debugging.[11] In the define-and-run approach, if an error (such as numeric error) has occurred in the training calculation, it is often difficult to inspect the fault, because the code written to define the network and the actual place of the error are separated. In the define-by-run approach, you can just suspend the calculation with the language's built-in debugger and inspect the data that flows on your code of the network.

Define-by-run has gained popularity since the introduction by Chainer and is now implemented in many other frameworks, including PyTorch[14] and TensorFlow.[11]

Extension libraries

Chainer has four extension libraries, ChainerMN, ChainerRL, ChainerCV and ChainerUI. ChainerMN enables Chainer to be used on multiple GPUs with performance significantly faster than other deep learning frameworks.[1] A supercomputer running Chainer on 1024 GPUs processed 90 epochs of ImageNet dataset on ResNet-50 network in 15 minutes, which is four times faster than the previous record held by Facebook.[15][16] ChainerRL adds state of art deep reinforcement learning algorithms, and ChainerUI is a management and visualization tool.

Applications

Chainer is used as the framework for PaintsChainer, a service which does automatic colorization of black and white, line only, draft drawings with minimal user input.[17][18]

See also

References

  1. ↑ 1.0 1.1 1.2 1.3 "Big-in-Japan AI code 'Chainer' shows how Intel will gun for GPUs". 2017-04-07. https://www.theregister.co.uk/2017/04/07/intel_chainer_ai_day/. 
  2. ↑ 2.0 2.1 "Deep Learning のフレームワーク Chainer を公開しました" (in ja-JP). 2015-06-09. https://research.preferred.jp/2015/06/deep-learning-chainer/. 
  3. ↑ "Chainer Homepage". https://chainer.org/#parters. 
  4. ↑ "IBM Wants to be "Red Hat" of Deep Learning". 2017-01-26. https://www.hpcwire.com/2017/01/26/ibm-wants-red-hat-deep-learning/. 
  5. ↑ "Intel Collaborating with Preferred Networks in Japan on Deep Learning". 2017-04-06. https://newsroom.intel.com/news/intel-collaborating-preferred-networks-japan-deep-learning/. 
  6. ↑ "Microsoft partners with Preferred Networks to bring Chainer deep learning technology to Azure - MSPoweruser" (in en-US). MSPoweruser. 2017-05-23. https://mspoweruser.com/microsoft-partners-with-preferred-networks-to-bring-chainer-deep-learning-technology-to-azure/. 
  7. ↑ "Top 20 Python Machine Learning Open Source Projects". 2017-11-24. https://www.kdnuggets.com/2016/11/top-20-python-machine-learning-open-source-updated.html. 
  8. ↑ "Preferred Networks Migrates its Deep Learning Research Platform to PyTorch" (in en-US). 2019-12-05. https://preferred.jp/en/news/pr20191205/. 
  9. ↑ Tokui, Seiya et al. (2015). "Chainer: a next-generation open source framework for deep learning". 29th Annual Conference on Neural Information Processing Systems (NIPS) 5. 
  10. ↑ Shimada, Naoki (September 14, 2017). Deep Learning with Chainer. Gijutsu-Hyohron. p. 61. ISBN 4774191868. 
  11. ↑ 11.0 11.1 11.2 "Eager Execution: An imperative, define-by-run interface to TensorFlow". https://research.googleblog.com/2017/10/eager-execution-imperative-define-by.html. 
  12. ↑ "Deep Learning With Dynamic Computation Graphs (ICLR 2017)". http://muratbuffalo.blogspot.jp/2017/01/deep-learning-with-dynamic-computation.html. 
  13. ↑ Hido, Shohei (8 November 2016). "Complex neural networks made easy by Chainer" (in en). https://www.oreilly.com/learning/complex-neural-networks-made-easy-by-chainer. Retrieved 26 June 2018. 
  14. ↑ Perez, Carlos E. (20 January 2017). "PyTorch, Dynamic Computational Graphs and Modular Deep Learning". https://medium.com/intuitionmachine/pytorch-dynamic-computational-graphs-and-modular-deep-learning-7e7f89f18d1. 
  15. ↑ "Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes" (pdf). https://www.preferred-networks.jp/docs/imagenet_in_15min.pdf. 
  16. ↑ Greene, Tristan (20 November 2017). "Facebook’s nerds bested by Japan’s in the race to train AI". https://thenextweb.com/artificial-intelligence/2017/11/20/researchers-did-in-15-minutes-what-takes-facebook-an-hour/. Retrieved 24 November 2017. 
  17. ↑ Know, Now You (2017-02-15). "This neural network-based software will add colour to your drawings for free". http://www.techly.com.au/2017/02/15/neural-network-based-software-will-add-colour-drawings-free/. 
  18. ↑ "Drawing app "pixiv Sketch" and automatic coloring service "PaintsChainer" collaborate to provide a new function for automatic coloring of illustrations!". 2017-05-24. https://www.preferred-networks.jp/en/news/pr20170524. 

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Chainer&oldid=2123383"