01

About me

I am a PhD Student at KAUST AI Initiative, working with Jürgen Schmidhuber . Before starting my PhD I worked for over 3 years as a ML/Research Engineer.
I studied simultaneously Mathematics (BSc+MSc) and Computer Science (BSc) at the University of Warsaw. I wrote my Master's thesis on improving BERT's mathematical skills under the supervision of Mateusz Malinowski and Henryk Michalewski

I am interested in reasoning in neural networks. In practice, it means that I am mostly interested in analyzing and improving transformer architecture, LLMs and (goal-conditioned / hierarchical) reinforcement learning algorithms.

02

Publications

• Efficient Value Propagation with the Compositional Optimality Equation

  GCRL NeurIPS 2023 Workshop

  Piotr Piękos, Aditya Ramesh, Francesco Faccio, Jürgen Schmidhuber

• SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

  Robert Csordás, Piotr Piękos, Kazuki Irie, Jürgen Schmidhuber

• Utilizing a Malfunctioning 3D Printer by Modeling Its Dynamics with Artificial Intelligence

  ICRA 2024

  Renzo Cabalero^*, Piotr Piękos^*, Eric Feron, Jürgen Schmidhuber

• Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning

  ACL 2021 (oral)

  Piotr Piękos, Henryk Michalewski, Mateusz Malinowski

• Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search

  ICLR 2023 Oral (Notable top 5%)

  Michał Zawalski, Michał Tyrolski, Konrad Czechowski, Tomasz Odrzygóźdź. Damian Stachura. Piotr Piękos, Yuhuai Wu, Łukasz Kuciński, Piotr Miłoś

• Mindstorms in Natural Language-Based Societies of Mind

  R0-FoMo NeurIPS 2023 Workshop (Best Paper Award)

  Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piękos, Aditya Ramesh, Imanol Schlag, Weimin Shi, Aleksandar Stanić, Wenyi Wang, Yuhui Wang, Mengmeng Xu, Deng-Ping Fan, Bernard Ghanem, Jürgen Schmidhuber

02

Experience

• June 2023 - Aug 2023

  Research Internship

  IDSIA

  Working on sample efficient Goal-Conditioned RL and improving the speed of the Transformer.

• Sept 2022 - Present

  PhD Student (GPA 4.0/4.0)

  KAUST

  Supervised by Prof. Jürgen Schmidhuber. I am working on generalization, sample efficiency in context of language processing and reinforcement learning.

• Jan 2022 - Jul 2022

  Researcher

  AWARElab, IMPAN (Institue of Mathematics, Polish Academy of Sciences)

  Working on AdaSubS. Implementing experiments on the sokoban environment

• Oct 2021 - Jan 2022

  Research Engineer

  Allegro.PL

  Researching neural search methods for improving search recommendations on the Allegro.pl ("Polish Amazon") platform

• May 2020 - Sept 2021

  Working on Master thesis

  After promising initial results I decided to focus fully on my Master's thesis, the effect of that is the Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning paper.

• July 2017 - June 2020

  ML/DL Engineer

  ITmagination

  In ITmagination I created DL/ML solutions to help other companies. Example projects are: Object detection system for evaluating influencers, recommender system or a system to help with estimating staff needs in physical shops.

Download CV in a pdf

04

Contact Me

Email

piotrpiekos@gmail.com

Social

•