{"id":2697,"date":"2024-10-23T15:21:40","date_gmt":"2024-10-23T13:21:40","guid":{"rendered":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/?p=2697"},"modified":"2024-10-23T15:22:15","modified_gmt":"2024-10-23T13:22:15","slug":"laurent-daudet-promises-and-challenges-of-massive-scale-ai-the-case-of-large-language-models","status":"publish","type":"post","link":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/laurent-daudet-promises-and-challenges-of-massive-scale-ai-the-case-of-large-language-models\/","title":{"rendered":"Laurent Daudet – Promises and challenges of massive-scale AI \u2013 the case of large language models"},"content":{"rendered":"

[et_pb_section fb_built=”1″ admin_label=”section” _builder_version=”3.22″][et_pb_row _builder_version=”3.22.1″ border_color_all=”#3255c9″ border_style_all=”groove”][et_pb_column type=”1_2″ _builder_version=”3.22.1″][et_pb_text _builder_version=”3.22.1″ min_height=”11px” custom_margin=”||-25px|||” custom_padding=”||0px|||”]<\/p>\n

Laurent Daudet<\/span><\/p>\n

November 3, 4pm<\/span><\/p>\n

Room Turing Conseil, 45 rue des Saints P\u00e8res 75006 Paris & Online (Zoom)<\/span><\/p>\n

 <\/p>\n

[\/et_pb_text][\/et_pb_column][et_pb_column type=”1_2″ _builder_version=”3.22.1″][\/et_pb_column][\/et_pb_row][et_pb_row custom_padding=”44px|||||” custom_margin=”80px||80px” _builder_version=”3.22.1″][et_pb_column type=”2_3″ _builder_version=”3.22.1″][et_pb_text _builder_version=”3.22.1″ custom_margin=”-51px|||||” custom_padding=”0px|||||”]<\/p>\n

Abstract<\/strong><\/h3>\n

 <\/p>\n

OpenAi\u2019s GPT-3 language model has triggered a new generation of Machine Learning models. Leveraging Transformers architectures at billion-size parameters trained on massive unlabeled datasets, these language models achieve new capabilities such as text generation, question answering, or even zero-shot learning \u2013 tasks the model has not been explicitly trained for. However, training these models represent massive computing tasks, now done on dedicated supercomputers. Scaling up these models will require new hardware and optimized training algorithms.<\/p>\n

At LightOn \u2013 a spinoff of university research -, we develop a set of technologies to address these challenges. The Optical Processing Unit (OPU) technology makes some matrix-vector multiplications in a massively parallel fashion, at record-low power consumption. Now accessible on-premises or through the cloud, the OPU technology has been used by engineers and researchers worldwide in a variety of applications, for Machine Learning and scientific computing. We also train in an efficient manner large language models, such as PAGnol (demo at https:\/\/pagnol.lighton.ai ), the largest language model in French, that can be used for various<\/p>\n

[\/et_pb_text][\/et_pb_column][et_pb_column type=”1_3″ _builder_version=”3.22.1″][et_pb_video_slider _builder_version=”3.22.1″][et_pb_video_slider_item src=”https:\/\/www.youtube.com\/watch?v=Les4CT5KCIM” src_webm=”https:\/\/www.youtube.com\/watch?v=Les4CT5KCIM” _builder_version=”3.22.1″ show_image_overlay=”off”][\/et_pb_video_slider_item][\/et_pb_video_slider][et_pb_text admin_label=”Text” _builder_version=”3.22.1″]<\/p>\n

Click the image below to see slides<\/em><\/p>\n

[\/et_pb_text][et_pb_image src=”https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-content\/uploads\/sites\/27\/2024\/10\/Screenshot-2024-10-23-152145.png” url=”https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-content\/uploads\/sites\/27\/2021\/11\/LightOn_diiP_Nov21_slides-min.pdf” _builder_version=”3.22.1″ transform_styles__hover_enabled=”on” transform_scale__hover_enabled=”on” transform_translate__hover_enabled=”on” transform_rotate__hover_enabled=”on” transform_skew__hover_enabled=”on” transform_origin__hover_enabled=”on” transform_translate__hover=”-4px|-4px”][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=”1″ _builder_version=”3.22.1″][et_pb_row _builder_version=”3.22.1″][et_pb_column type=”1_3″ _builder_version=”3.22.1″][et_pb_image src=”https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-content\/uploads\/sites\/27\/2021\/10\/portrait.jpeg” align=”center” _builder_version=”3.22.1″ custom_margin=”20px|125px||||”][\/et_pb_image][\/et_pb_column][et_pb_column type=”2_3″ _builder_version=”3.22.1″][et_pb_text _builder_version=”3.22.1″ custom_padding=”0px|||||”]<\/p>\n

Laurent Daudet
<\/strong>CTO and co-founder at LightOn, Professor (on leave) of physics (Universit\u00e9 Paris Cit\u00e9)<\/p>\n


<\/strong><\/h3>\n

Laurent Daudet is currently employed as CTO at LightOn, a startup he co-founded in 2016, where he manages cross-disciplinary R&D projects, involving machine learning, optics, signal processing, electronics, and software engineering. Laurent is a recognized expert in signal processing and wave physics, and is currently on leave from his position of Professor of Physics at the Universit\u00e9 Paris Cit\u00e9. Prior to that or in parallel, he has held various academic positions: fellow of the Institut Universitaire de France, associate professor at Universit\u00e9 Pierre et Marie Curie, Visiting Senior Lecturer at Queen Mary University of London, UK, Visiting Professor at the National Institute for Informatics in Tokyo, Japan. Laurent has authored or co-authored more than 200 scientific publications, has been a consultant to various small and large companies, and is a co-inventor in several patents. He is a graduate in physics from Ecole Normale Sup\u00e9rieure in Paris, and holds a PhD in Applied Mathematics from Marseille University.<\/p>\n

[\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row custom_margin=”120px||” _builder_version=”3.22.1″ locked=”off”][et_pb_column type=”4_4″ _builder_version=”3.0.47″][et_pb_divider _builder_version=”3.22.1″][\/et_pb_divider][et_pb_text admin_label=”\u00c0 lire aussi” _builder_version=”3.22.1″ z_index_tablet=”500″]<\/p>\n

Other distinguished lectures
<\/span><\/h2>\n

[\/et_pb_text][et_pb_blog posts_number=”4″ include_categories=”65″ show_author=”off” show_date=”off” show_pagination=”off” module_id=”page_type_blog” _builder_version=”3.22.1″ header_level=”h4″ border_width_bottom_fullwidth=”1px” border_color_bottom_fullwidth=”rgba(51,51,51,0.18)” custom_padding=”||50px|” z_index_tablet=”500″][\/et_pb_blog][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"

Laurent Daudet November 3, 4pm Room Turing Conseil, 45 rue des Saints P\u00e8res 75006 Paris & Online (Zoom)  Abstract   OpenAi\u2019s GPT-3 language model has triggered a new generation of Machine Learning models. Leveraging Transformers architectures at billion-size parameters trained on massive unlabeled datasets, these language models achieve new capabilities such as text generation, question… Lire la suite Laurent Daudet – Promises and challenges of massive-scale AI \u2013 the case of large language models<\/span><\/a><\/p>\n","protected":false},"author":560,"featured_media":674,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[57,1,65],"tags":[],"class_list":["post-2697","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-57","category-diip","category-distinguished-lectures"],"_links":{"self":[{"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/posts\/2697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/users\/560"}],"replies":[{"embeddable":true,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/comments?post=2697"}],"version-history":[{"count":3,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/posts\/2697\/revisions"}],"predecessor-version":[{"id":2702,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/posts\/2697\/revisions\/2702"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/media\/674"}],"wp:attachment":[{"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/media?parent=2697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/categories?post=2697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wordpress-test.app.u-pariscite.fr\/diip\/wp-json\/wp\/v2\/tags?post=2697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}