江湖盛传……
OpenAI(曾经)的首席科学家Ilya Sutskever给了John Carmack一份论文清单,并说:「如果你真的把这些学会了,你就能理解当今人工智慧的90%重要内容。]
清单上的27篇研究论文(或课程)如下:
1. The Annotated Transformer
https://nlp.seas.harvard.edu/annotated-transformer/
2. The First Law of Complexodynamics
https://scottaaronson.blog/?p=762
3. The Unreasonable Effectiveness of RNNs
https://karpathy.github.io/2015/05/21/rnn-effectiveness/
4. Understanding LSTM Networks
https://colah.github.io/posts/2015-08-Understanding-LSTMs/
5. Recurrent Neural Network Regularization
https://arxiv.org/pdf/1409.2329
6. Keeping Neural Networks Simple by Minimizing the Description Length of the Weights
https://www.cs.toronto.edu/~hinton/absps/colt93.pdf
7. Pointer Networks
https://arxiv.org/pdf/1506.03134
8. ImageNet Classification with Deep CNNs
https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d…
9. Order Matters: Sequence to Sequence for Sets
https://arxiv.org/pdf/1511.06391
10. GPipe: Efficient Training of Giant Neural Networks
https://arxiv.org/pdf/1811.06965
11. Deep Residual Learning for Image Recognition
https://arxiv.org/pdf/1512.03385
12. Multi-Scale Context Aggregation by Dilated Convolutions
https://arxiv.org/pdf/1511.07122
13. Neural Quantum Chemistry
https://arxiv.org/pdf/1704.01212
14. Attention Is All You Need
https://arxiv.org/pdf/1706.03762
15. Neural Machine Translation by Jointly Learning to Align and Translate
https://arxiv.org/pdf/1409.0473
16. Identity Mappings in Deep Residual Networks
https://arxiv.org/pdf/1603.05027
17. A Simple NN Module for Relational Reasoning
https://arxiv.org/pdf/1706.01427
18. Variational Lossy Autoencoder
https://arxiv.org/pdf/1611.02731
19. Relational RNNs
https://arxiv.org/pdf/1806.01822
20. Quantifying the Rise and Fall of Complexity in Closed Systems
https://arxiv.org/pdf/1405.6903
21. Neural Turing Machines
https://arxiv.org/pdf/1410.5401
22. Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
https://arxiv.org/pdf/1512.02595
23. Scaling Laws for Neural LMs
https://arxiv.org/pdf/2001.08361
24. A Tutorial Introduction to the Minimum Description Length Principle
https://arxiv.org/pdf/math/0406077
25. Machine Super Intelligence Dissertation
https://pdfs.semanticscholar.org/e758/b579456545f8691bbadaf26bcd3b536c7…
26. PAGE 434 onwards: Komogrov Complexity
https://www.lirmm.fr/~ashen/kolmbook-eng-scan.pdf
27. CS231n Convolutional Neural Networks for Visual Recognition
https://cs231n.github.io/
无论是真是假,疑似Ilya的秘密文件夹在此
https://arc.net/folder/D0472A20-9C20-4D3F-B145-D2865C0A9FEE
就算被骗,你真搞懂了这些东西,应该也算半个神人吧?
本文 :https://architect.pub/ilya-sutskever-former-chief-scientist-openai-gave-john-carmack-list-papers 讨论:知识星球【首席架构师圈】或者加微信小号【ca_cto】或者加QQ群【792862318】 公众号
【jiagoushipro】
【架构师酒馆】
精彩图文详解架构方法论,架构实践,技术原理,技术趋势。
我们在等你,赶快扫描关注吧。
【ca_cea】
50000人社区,讨论:企业架构,云计算,大数据,数据科学,物联网,人工智能,安全,全栈开发,DevOps,数字化.
QQ群
【285069459】深度交流企业架构,业务架构,应用架构,数据架构,技术架构,集成架构,安全架构。以及大数据,云计算,物联网,人工智能等各种新兴技术。
加QQ群,有珍贵的报告和干货资料分享。
视频号 【架构师酒馆】
1分钟快速了解架构相关的基本概念,模型,方法,经验。
每天1分钟,架构心中熟。
知识星球 【首席架构师圈】向大咖提问,近距离接触,或者获得私密资料分享。
喜马拉雅 【超级架构师】路上或者车上了解最新黑科技资讯,架构心得。 【智能时刻,架构君和你聊黑科技】 知识星球 认识更多朋友,职场和技术闲聊。 知识星球【职场和技术】 微博 【架构师酒馆】 智能时刻 哔哩哔哩 【架构师酒馆】
抖音 【cea_cio】架构师酒馆
小红书 【cea_csa_cto】架构师酒馆
网站 CIO(首席信息官) https://cio.ceo 网站CIO,CTO和CDOhttps://cioctocdo.com网站架构师实战分享https://architect.pub网站程序员云开发分享https://pgmr.cloud官网 行天智能科技咨询公司 https://xingtian.ai 网站开发者闲谈https://blog.developer.chat网站首席隐私官内参https://cpo.work网站首席安全官内参https://cso.pub 网站CIO内参https://cio.cool 网站CDO内参https://cdo.fyi 网站CXO内参https://cxo.pub 网站首席架构师社区https://jiagoushi.pro
谢谢大家关注,转发,点赞和点在看。
热门跟贴