Software:Flux (machine-learning framework)

From HandWiki
Short description: Open-source machine-learning software library
Flux
FluxLogo.png
Original author(s)Michael J Innes,[1] Dhairya Gandhi,[2] and Contributors[3]
Repositorygithub.com/FluxML/Flux.jl
Written inJulia
TypeMachine learning library
LicenseMIT[4]
Websitehttps://fluxml.ai

Flux is an open-source machine-learning software library and ecosystem written in Julia.[1][5] Its current stable release is v. It has a layer-stacking-based interface for simpler models, and has a strong support on interoperability with other Julia packages instead of a monolithic design.[6] For example, GPU support is implemented transparently by CuArrays.jl[7] This is in contrast to some other machine learning frameworks which are implemented in other languages with Julia bindings, such as TensorFlow.jl, and thus are more limited by the functionality present in the underlying implementation, which is often in C or C++.[8] Flux joined NumFOCUS as an affiliated project in December of 2021.[9]

Flux's focus on interoperability has enabled, for example, support for Neural Differential Equations, by fusing Flux.jl and DifferentialEquations.jl into DiffEqFlux.jl.[10][11]

Flux supports recurrent and convolutional networks. It is also capable of differentiable programming[12][13][14] through its source-to-source automatic differentiation package, Zygote.jl.[15]

Julia is a popular language in machine-learning[16] and Flux.jl is its most highly regarded machine-learning repository.[16] A demonstration[17] compiling Julia code to run in Google's tensor processing unit (TPU) received praise from Google Brain AI lead Jeff Dean.[18]

Flux has been used as a framework to build neural networks that work with homomorphic encrypted data without ever decrypting it.[19][20] This kind of application is envisioned to be central for privacy to future API using machine-learning models.[21]

Flux.jl is an intermediate representation for running high level programs on CUDA hardware.[22][23] It was the predecessor to CUDAnative.jl which is also a GPU programming language.[24]

See also

References

  1. ↑ 1.0 1.1 Innes, Michael (2018-05-03). "Flux: Elegant machine learning with Julia" (in en). Journal of Open Source Software 3 (25): 602. doi:10.21105/joss.00602. Bibcode: 2018JOSS....3..602I. 
  2. ↑ Dhairya Gandhi, GitHub, 2021-06-27, https://github.com/DhairyaLGandhi, retrieved 2021-06-27 
  3. ↑ Flux Contributors, GitHub, 2021-06-27, https://github.com/FluxML/Flux.jl/graphs/contributors, retrieved 2021-06-27 
  4. ↑ "github.com/FluxML/Flux.jl/blob/master/LICENSE.md". 6 November 2021. https://github.com/FluxML/Flux.jl/blob/master/LICENSE.md. 
  5. ↑ Innes, Mike; Bradbury, James; Fischer, Keno; Gandhi, Dhairya; Mariya Joy, Neethu; Karmali, Tejan; Kelley, Matt; Pal, Avik et al.. "Building a Language and Compiler for Machine Learning". https://julialang.org/blog/2018/12/ml-language-compiler. 
  6. ↑ "Machine Learning and Artificial Intelligence". https://juliacomputing.com/domains/ml-and-ai.html. 
  7. ↑ Gandhi, Dhairya (2018-11-15). "Julia at NeurIPS and the Future of Machine Learning Tools". https://juliacomputing.com/blog/2018/11/15/julia-ml-three-papers.html. 
  8. ↑ Malmaud, Jonathan; White, Lyndon (2018-11-01). "TensorFlow.jl: An Idiomatic Julia Front End for TensorFlow" (in en). Journal of Open Source Software 3 (31): 1002. doi:10.21105/joss.01002. Bibcode: 2018JOSS....3.1002M. 
  9. ↑ "Flux <3 NumFOCUS". https://fluxml.ai/blog/2021/12/01/flux-numfocus.html. 
  10. ↑ Rackauckas, Chris; Innes, Mike; Ma, Yingbo; Bettencourt, Jesse; White, Lyndon; Dixit, Vaibhav (2019-02-06). "DiffEqFlux.jl - A Julia Library for Neural Differential Equations". arXiv:1902.02376 [cs.LG].
  11. ↑ Schlothauer, Sarah (2019-01-25). "Machine learning meets math: Solve differential equations with new Julia library" (in en-US). https://jaxenter.com/julia-machine-learning-library-154880.html. 
  12. ↑ "Flux – Reinforcement Learning vs. Differentiable Programming". https://fluxml.ai/2019/03/05/dp-vs-rl.html. 
  13. ↑ "Flux – What Is Differentiable Programming?". https://fluxml.ai/2019/02/07/what-is-differentiable-programming.html. 
  14. ↑ Heath, Nick (December 6, 2018). "Julia vs Python: Which programming language will rule machine learning in 2019?" (in en). https://www.techrepublic.com/article/julia-vs-python-which-programming-language-will-rule-machine-learning-in-2019/. 
  15. ↑ Innes, Michael (2018-10-18). "Don't Unroll Adjoint: Differentiating SSA-Form Programs". arXiv:1810.07951 [cs.PL].
  16. ↑ 16.0 16.1 Heath, Nick (January 25, 2019). "GitHub: The top 10 programming languages for machine learning" (in en). https://www.techrepublic.com/article/github-the-top-10-programming-languages-for-machine-learning/. 
  17. ↑ Saba, Elliot; Fischer, Keno (2018-10-23). "Automatic Full Compilation of Julia Programs and ML Models to Cloud TPUs". arXiv:1810.09868 [cs.PL].
  18. ↑ Dean, Jeff [@JeffDean] (2018-10-23). "Julia + TPUs = fast and easily expressible ML computations" (in en). https://twitter.com/JeffDean/status/1054951415339192321. 
  19. ↑ Patrawala, Fatema (2019-11-28). "Julia Computing research team runs machine learning model on encrypted data without decrypting it" (in en-US). https://hub.packtpub.com/julia-computing-research-team-runs-machine-learning-model-on-encrypted-data-without-decrypting-it/. 
  20. ↑ "Machine Learning on Encrypted Data Without Decrypting It". 2019-11-22. https://juliacomputing.com/blog/2019/11/22/encrypted-machine-learning.html. 
  21. ↑ Yadav, Rohit (2019-12-02). "Julia Computing Uses Homomorphic Encryption For ML. Is It The Way Forward?" (in en-US). https://analyticsindiamag.com/julia-computing-uses-homomorphic-encryption-for-ml-is-it-the-way-forward/. 
  22. ↑ Roesch, Jared and Lyubomirsky, Steven and Kirisame, Marisa and Pollock, Josh and Weber, Logan and Jiang, Ziheng and Chen, Tianqi and Moreau, Thierry and Tatlock, Zachary (2019). "Relay: A High-Level IR for Deep Learning". arXiv:1904.08368 [cs.LG].CS1 maint: multiple names: authors list (link)
  23. ↑ Tim Besard and Christophe Foket and Bjorn De Sutter (2019). "Effective Extensible Programming: Unleashing Julia on GPUs". IEEE Transactions on Parallel and Distributed Systems (Institute of Electrical and Electronics Engineers (IEEE)) 30 (4): 827–841. doi:10.1109/tpds.2018.2872064. 
  24. ↑ Besard, Tim (2018). Abstractions for Programming Graphics Processors in High-Level Programming Languages (PhD). Ghent University.




Retrieved from "https://handwiki.org/wiki/index.php?title=Software:Flux_(machine-learning_framework)&oldid=3471167"