METAUTO.ai

*Taken in the KAUST AI Initiative.

Mingchen Zhuge

Currently, I am in my second year as a PhD student at the KAUST AI Initiative. I am fortunate to have Jürgen Schmidhuber as my advisor.

My current research interests and skills include:

  • Multimodal: Multimodal Understanding/Generation; currently prefer video-based settings.
  • LLMs: Training LLMs and domain-specific fine-tuning.
  • Meta Learning: Recursive Self-Improvement.
  • Agent Society: Society of Mind, LLM-based Multi-Agent Systems.

😀 Seeking Internship Position for Summer 2024 😀 Will Join Meta as Research Scientist Intern in Summer 2024

Before joining KAUST, I've worked as an engineer, researcher (or intern) at NSFocus, Alibaba Group, IIAI (G42), SUSTech VIP Lab, and Microsoft.

Description of the image

Selected Publications ( Full list)


2024

Image Description
Language Agents as Optimizable Graphs
Mingchen Zhuge, Wenyi Wang, Louis Kirsch, Francesco Faccio, Dmitrii Khizbullin and Jürgen Schmidhuber
Technical Report
All agent frameworks could be revolutionized by graph-based innovation.
[Paper] [Code] [BibTex]

2023

Image Description
MetaGPT: Meta Programming For A Multi-Agent Collaborative Framework
Sirui Hong∗, Mingchen Zhuge∗, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu†, Jürgen Schmidhuber
ICLR 2024 (Oral)
Get 34k+ stars on GitHub; Oral Presentation (top 1.2% in 7,262)
[Paper] [Code] [BibTex]
Image Description
Mindstorms in Natural Language-Based Societies of Mind
Mingchen Zhuge*, Haozhe Liu*, Francesco Faccio*, Dylan R. Ashley*, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piękos, Aditya Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanić, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jü̈rgen Schmidhuber
Position Paper
Best Paper Award in NeurIPS Ro-FoMo Workshop
[Paper] [Code] [BibTex] [Award]

2022

Image Description
Salient Object Detection via Integrity Learning
Mingchen Zhuge*, Deng-Ping Fan*, Nian Liu, Dingwen Zhang, Dong Xu, Ling Shao
TPAMI2022
ESI Highly Cited Paper
[Paper] [Code] [Poster] [BibTex]

2021

Image Description
Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
Mingchen Zhuge*, Dehong Gao*, Deng-Ping Fan†, Linbo Jin, Ben Chen, Haoming Zhou, Minghui Qiu, Ling Shao
CVPR2021
Industry Application in alibaba.com
[Paper] [Code] [BibTex] [Talk]

Experience

Aug 2022 - Present

PhD Student, KAUST AI Initiative
Advisor: Jürgen Schmidhuber
Topic: Multimodal, LLMs, Agent Society, Meta Learning
Location: Thuwal, KSA

May 2022 - Aug 2022

Research Scientist Intern, Microsoft (WizardLM)
Host: Chongyang Tao
Topic: NLP, Multimodal LLM
Location: Beijing, China

Jul 2021 - Jan 2022

Visiting Scholar, SUSTech
Host: Feng Zheng
Topic: Multimodal (Audio-Visual)
Location: Shenzhen, China

Mar 2021 - Jun 2021

Research Intern, IIAI
Host: Deng-Ping Fan, Ling Shao
Topic: Computer Vision
Location: Abu Dhabi, UAE

May 2020 - Feb 2021

Algorithm Intern, Alibaba Group
Host: Dehong Gao
Topic: Multimodal (Vision-Language Pre-training)
Location: Hangzhou, China

March 2018 - Jun 2018

Research Intern, NSFocus
Host: Wenmao Liu
Topic: Blockchain, Network Security
Location: Beijing, China

Invited Talks


2021

机器之心: "走进全球顶尖实验室第一期-IIAI"
Host: 机器之心 (Synced)  

Representative Awards


2023

Best Paper Award in NeurIPS Ro-FoMo Workshop

2023

Outstanding Reviewer of CVPR2023 (232 out of 7000+)

2021

2021中兴蓝剑计划（武汉高校仅三人）

2019

第十六届中国研究生数学建模竞赛 国家级二等奖

2019

2019 ZTE Algorithm Competition Champion (Top 7/11000+)