Scientific activities

„Computer Science is no more about computers than astronomy is about telescopes.”

Edsger W. Dijkstra, computer science professor

  1. PC Member KES 2024, 28th Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems, Seville, Spain, 11-13 September 2024
  2. PC Member KES 2023, 27th Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems, Athens, Greece
  3. PC Member KES AMSTA 2023, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications, 14 – 16 June 2023, at the Barceló Aran Mantegna Hotel in Rome, Italy
  4. PC Member KES 2022, 26nd Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  5. PC Member KES AMSTA 2022, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  6. PC Member KES 2021, 25nd Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  7. PC Member KES AMSTA 2021, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  8. PC Member DEMSME 2021, International conference on decision making for small and medium-sized enterprises (invitation)
  9. PC Member KES 2020, 24nd Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  10. PC Member KES AMSTA 2020, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  11. PC Member of Complex Collective Systems Workshop of PPAM 2019, CCS Workshop 13th International Conference on Parallel Processing and Applied Mathematics
  12. PC Member SDF 2019, Smart Digital Features 2019
  13. PC Member KES 2019, 23nd Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  14. PC Member, Invited speaker DEMSME 2019, Decision making for small and medium-sized enterprises
  15. PC Member KES AMSTA 2019, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  16. PC Member IEEE BIBE 2018, The 18th IEEE International Conference on BioInformatics and BioEngineering, Taiwan, October 29 - 31, 2018
  17. PC Member SIMPAR 2018, IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots, Brisbane, Australia, 16-19 May 2018
  18. PC Member AAMAS 2018, International Conference on Autonomous Agents and Multiagent Systems, Stockholm, Sweden, July 10-15, 2018
  19. PC Member KES 2018, 22nd Annual KES Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  20. PC Member KES AMSTA 2018, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  21. PC Member of Complex Collective Systems Workshop of PPAM 2017, CCS Workshop 12th International Conference on Parallel Processing and Applied Mathematics
  22. PC Member of Forum Innowacyjnych Technologii , 2017
  23. PC Member KES 2017, 21th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  24. PC Member ICRC 2017, IEEE International Conference on Robotic Computing
  25. PC Member KES AMSTA 2017, International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  26. PC Member SIMPAR 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots, San Francisco, USA, 2016
  27. Session chair at EURO 2016, 28th European Conference on Operational Research, special session: AHP and Beyond chaired together with Matteo Brunelli
  28. PC Member KES 2016, 20th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  29. PC Member KES AMSTA 2016, 11th International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  30. PC Member of Complex Collective Systems Workshop of PPAM 2015, CCS Workshop 11th International Conference on Parallel Processing and Applied Mathematics
  31. PC Member KES 2015, 19th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  32. PC Member KES AMSTA 2015, 9th International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  33. Associate Editor IROS 2014 (Conference Paper Review Board member)
  34. PC Member SIMPAR 2014, 4th International Conference on SIMULATION, MODELING, and PROGRAMMING for AUTONOMOUS ROBOTS
  35. PC Member KES AMSTA 2014, 8th International KES Conference on Agents and Multi-agent Systems – Technologies and Applications
  36. Co-Chair KES 2014, IS13, KES 2014 Invited Session, Modeling with Qualitative and Quantitative Pairwise Comparisons
  37. PC Member KES 2014, 18th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems
  38. Reviewer at ICRA 2014, IEEE International conference on Robotics and Automation 2014
  39. PC Member ICBR 2013, The 2013 International Conference on Individual and Collective Behaviors in Robotics
  40. Reviewer (and PC Member of Complex Collective Systems Workshop) of PPAM 2013 10th International Conference on Parallel Processing and Applied Mathematics
  41. Associate Editor (Conference Paper Review Board member) of IROS 2013
  42. PC Member, Reviewer of KES AMSTA 2013 7th International KES Conference on Agents and Multi-agent Systems - Technologies and Applications
  43. PC Member, Reviewer, Session Char of SIMPAR 2012 SIMULATION, MODELING, and PROGRAMMING for AUTONOMOUS ROBOTS
  44. PC Member of Complex Collective Systems Workshop at PPAM 2011 9th International Conference on Parallel Processing and Applied Mathematics

„A wise man once gave the following advice: spend the most time refereeing the best papers. If a paper is awful, please don't spend a great deal of time on it. If a paper is good, please do spend a little time to make it better.”

Taken from JFP Advice for Referees

Being a reviewer in a certain good journal, I saw the opinion of another reviewer:

„This paper has not reached to the acceptable level for publication in this top journal and lacks originality and novelty. The technical depth of this paper is superficial. No new techniques are presented in this paper. Authors need to bring novelty and originality to their work. Thus, the paper in the current form is not suitable for publication in this top journal. I reject this paper.”


I made over one hundred scientific reviews, most of them for scientific journals having impact factor(s). The journals for which I had the honor and pleasure to make reviews are listed below (the list may not be complete):

  1. European Journal of Operational Research (EJOR)
  2. Journal of Multi-Criteria Decision Analysis (JMCDA)
  3. Asia-Pacific Journal of Operational Research (APJOR)
  4. Journal of Operational Research Society (JORS)
  5. Omega - The International Journal of Management Science
  6. Expert Systems With Applications (ESWA)
  7. Fundamenta Informaticae journal (FI)
  8. Group Decision and Negotiation (GDN)
  9. International Journal of Approximate Reasoning (IJAR)
  10. Applied Soft Computing, The Official Journal of the World Federation on Soft Computing (WFSC)
  11. Computing and Informatics journal (CaI)
  12. SIMULATION: Transactions of The Society for Modeling and Simulation International journal
  13. Journal of Computational Science (JoCS)
  14. Neurocomputing journal
  15. Computing in Science & Engineering (CS&E)
  16. IEEE Access journal
  17. Scientometrics
  18. Journal of Business Research (BURE)
  19. International Journal of Industrial Engineering: Theory, Applications and Practice (IJIETAP)
  20. Organizacija journal
  21. KES Journal
  22. International Journal of Management and Decision Making
  23. Bulletin of the Polish Academy of Sciences (Technical Sciences)
  24. Folia Oeconomica, Acta Universitas Lodziensis
  25. MCDM Journal, University of Economics in Katowice

Other important non-journal reviews

  1. Mathematical Reviews Journal of American Mathematical Society
  2. MSc dissertation external reviewer, Laurentian University, Ontario, Canada
  3. PPAM 2009 8th International Conference on Parallel Processing and Applied Mathematics
  4. Habilitation review of dr inż. Miłosz Kadziński's scientific achievements
  5. Book review of Niespójność osądów w analitycznym procesie hierarchicznym by Anna Prusak

(April 2019) Reviewer of Omega - The International Journal of Management Science (Omega) (certificate to download)

(October 2018) Outstanding Reviewer of European Journal of Operational Research (EJOR) (certificate to download)

(August 2018) Recognized Reviewer of Applied Soft Computing Journal (ASCJ) (certificate to download)

(September 2017) Outstanding Reviewer of International Journal of Approximate Reasoning (IJAR) (certificate to download)

(September 2017) Outstanding Reviewer of Applied Soft Computing Journal (ASCJ) (certificate to download)

(June 2017) Recognized Reviewer of International Journal of Approximate Reasoning (IJAR) (certificate to download)

(November 2016) Recognized Reviewer of Expert Systems With Applications (ESWA) (certificate to download)

(November 2016) Outstanding Reviewer of European Journal of Operational Research (EJOR) (certificate to download)

(October 2016) Outstanding Reviewer of International Journal of Approximate Reasoning (IJAR) (certificate to download)

(October 2016) Recognized Reviewer of European Journal of Operational Research (EJOR) (certificate to download)

(August 2016) Recognized Reviewer of Applied Soft Computing Journal (ASCJ) (certificate to download)

(June 2016) Recognized Reviewer of International Journal of Approximate Reasoning (IJAR) (certificate to download)

(March 2015) Recognized Reviewer of Journal of Computational Science (JCS) (certificate to download)

Publons public profile

AGH UST Reviewers Publons' ranking list

I once saw the following review in some respectable magazine. Fits perfectly with everything (probably it is a kind of template). 8-)

This paper has not reached to the acceptable level for publication in this top journal and lacks originality and novelty. The technical depth of this paper is superficial. No new techniques are presented in this paper. Authors need to bring novelty and originality to their work. Thus, the paper in the current form is not suitable for publication in this top journal. I reject this paper.

  • Member of IEEE (Institute of Electrical and Electronics Engineers)
  • Member of International Society on MCDM (Multiple Criteria Decision Making)
  • Member of POSRS (Polish Operational and Systems Research Society)
  • Founder-member of PAIS (Polish Artificial Intelligence Society)
  • Bronze Member of KES International, Society of Artificial Intelligence

  1. K. Kułakowski, J. Szybowski, S. Ernst Prawie optymalna manipulacja parą alternatyw presentation at MZBO 2023 (Metody i Zastosowania Badań Operacyjnych 2023 - XLI Ogólnopolska Konferencja Naukowa im. Profesora Władysława Bukietyńskiego) , Lipowy Most k. Białego Stoku, Polska, October 15 - 17, 2023 (cert. of attendance), (conf. programme)
  2. K. Kułakowski Manipulation-resistant ranking aggregation method for the pairwise-comparisons method, presentation at IFORS 2023 , Santiago, Chile, July 10 - 14, 2023 (cert. of attendance)
  3. K. Kułakowski, W poszukiwaniu definicji sztucznej inteligencji, presentation at The 17th Conference Etyka Mediów , Kraków, Poland, Maj 17-18, 2023 (cert. of attendance)
  4. K. Kułakowski, J. Szybowski, J. Mazurek, S. Ernst, Group decision-making based on manipulated data, presentation at The 95nd Meeting of EURO Working Group on Multicriteria Decision Aiding, Jaen, Spain, April 13-15, 2023 (cert. of attendance)
  5. K. Kułakowski, Secure ranking aggregation for the pairwise comparisons method, presentation at International Workshop on Multiple Criteria Decision Making, 2023
  6. K. Kułakowski, M. Strada, Assessments manipulation in the pairwise comparisons method, presentation at 32nd European Conference on Operational Research (EURO 2022), Espoo, Finland, July 3 - 6, 2022 (cert. of attendance)
  7. K. Kułakowski, M. Strada, Single expert manipulations in the cardinal pairwise-comparisons method, presentation at 26th International Conference on Multiple Criteria Decision Making, Portsmouth, UK, 26 June - 1 July, 2022
  8. K. Kułakowski, Ranking methods for incomplete PC matrices, presentation at The 92nd Meeting of EURO Working Group on Multicriteria Decision Aiding, Cracow, Poland, September 16-18, 2021 (cert. of attendance)
  9. K. Kułakowski, J. Mazurek and M. Strada, Similarity of ranking vectors in the pairwise comparisons method, presentation at Hybrid EURO 2021 conference, Athens, Greece, 2021 (cert. of attendance)
  10. K. Kułakowski, A. Kędzior, Heuristic Rating Estimation in the Multi-Criteria Decision Making Process, presentation at International Workshop on Multiple Criteria Decision Making, 2021 (cert. of attendance)
  11. K. Kułakowski, Introduction to pairwise comparisons, presentation at KES 2019 conference, Budapest, Hungary
  12. K. Kułakowski, Quantification of incompleteness in the PC method, presentation at EURO 2019 conference 30th European Conference On Operational Research, Dublin, Ireland
  13. K. Kułakowski, Inconsistency of Incomplete Pairwise Comparisons Matrices, presentation at MCDM 2019 conference Conference on Multiple Crteria Decision-Making, Istanbul, Turkey
  14. K. Kułakowski, Heuristic rating estimation as a way of ranking prediction based on comparing alternatives in pairs keynote lecture at DEMSME 2019 - Decision making for small and medium-sized enterprises (cert. of invited talk), Czech Republic
  15. K. Kułakowski, A. Prusak, J. Szybowski Indices of incompletenes for the pairwise comparisons method 89th Meeting of the European Working Group on Multiple Criteria Decision Aiding (EWG/MCDA) (certificate of attendance), Itally
  16. K. Kułakowski, A. Prusak, J. Szybowski Incompletenss in the Pairwise Comparisons Method and Its Impact to Sensitivity, International Workshop on Multiple Criteria Decision Making '19, IWoMCDM, Ustroń, Poland, 2019
  17. K. Kułakowski, Inconsistency and Condition of Order Preservation - public lecture at 2018 International Conference on Management and Operations Research, China, July 7-9, 2018
  18. K. Kułakowski, Ordinal pairwise comparisons with and without ties - public lecture at International Symposium on the Analytic Hierarchy Process, July 12 - 15, 2018, Hong Kong, HK
  19. K. Kułakowski, Cardinal and ordinal inconsistency in the pairwise comparisons matrix - presentation at Silesian University in Opava, School of Business Administration in Karvina, Czech Republik, 24 May 2018
  20. Konrad Kułakowski, Jiří Mazurek, Jaroslav Ramík, Michael Soltys, When condition of order preservation is met? 87th Meeting of the European Working Group on Multiple Criteria Decision Aiding (EWG/MCDA), Delft University of Technology, April 2018, (certificate of attendance), Netherlands
  21. K. Kułakowski, Porównywanie alternatyw parami - metoda pomiaru rzeczy niemierzalnych, Seminarium Interdyscyplinarne S3 (Science meets Social Science), Department of Operations Research, Wroclaw University of Technology, March 8, 2018
  22. K. Kułakowski, Inconsistency in the ordinal pairwise comparisons with ties Graduate Seminar, Department of Mathematics at California State University Channel Islands, October 30, 2017 (letter of appreciation)
  23. K. Kułakowski, Pairwise comparisons - a method to measure what is not measurable Computer Science Seminar at California State University Channel Islands, October 3, 2017 (invitation)
  24. K. Kułakowski, The most inconsistent graph of paired comparisons with ties 21st Conference of the International Federation of Operational Research Societies (IFORS 2017), July 17 - 21, 2017
  25. K. Kułakowski, Inconsistency in the ordinal pairwise comparisons method with and without ties 24th International Conference on Multiple Criteria Decision Making (MCDM 2017), July 10 - 14, 2017 (cert. of participation)
  26. K. Kułakowski, Extensions of the Kendall and Babington Smith inconsistency index, International Workshop on Multiple Criteria Decision Making '17, IWoMCDM, Ustroń, Poland, 2017
  27. K. Kułakowski, Chrześcijańska Wielokulturowość, Republika Mnichów na Górze Athos, Katedra Historii Kultury Chrześcijańskiej, Akademia Ignatianum, Kraków 2017, (announcement)
  28. K. Kułakowski, A. Kędzior, Some Remarks on the Mean-Based Prioritization Methods in AHP, 8th International Conference, ICCCI 2016 Halkidiki, Greece
  29. K. Kułakowski, Analytic Hierarchy Process - HRE perspective, MCDA Workshop 2016, (cert. of participation)
  30. K. Kułakowski, J. Szybowski, K. Peter-Bombik, Sales forecasting based on the Heuristic Rating Estimation method, EURO Conference 2016, (pdf), (cert. of attendance)
  31. K. Kułakowski, Dynamic Concurrent Van Emde Boas Array , Data structure for the high performance computing, HiPEAC Workshop, AGH UST, 2016, (pdf)
  32. K. Kułakowski, Heuristic Rating Estimation - Metoda rankingowa wykorzystująca dane referencyjne, Seminarium Zespołu Matematyki Obliczeniowej i Metod Probabilistycznych, WMS AGH, 2016 (zaproszenie)
  33. K. Kułakowski, R. Juszczyk, and S. Ernst, A Concurrent Inconsistency Re- duction Algorithm for the Pairwise Comparisons Method, International Conference on Artificial Intelligence and Soft Computing, ICAISC 2015, Zakopane, Poland
  34. K. Kułakowski, Heuristic Rating Estimation - applications and further development, 6th international workshop on Multiple criteria decision making’15, 22–24 marca 2015, Ustroń́, Poland
  35. K. Kułakowski, Condition of Order Preservation and Inconsistency in AHP – Where the sense of justice and the inconsistency meet each other?, 27th European Conference on Operational Research, 12 -15 July 2015, Glasgow, UK
  36. K. Kułakowski, Heuristic Rating Estimation – another approach to the ranking procedure in AHP, MCDM 2015 – bridging disciplines : 23rd international conference on Multiple Criteria Decision Making : 2nd–7th August 2015, Hamburg, Germany
  37. K. Kułakowski, J. Szybowski, and R. Tadeusiewicz, Tender with Success – The Pairwise Comparisons Approach, 18th Annual Conference Knowledge-Based and Intelligent Information and Engineering Systems, KES-2014 Gdynia, Poland
  38. K. Kułakowski and P. Matyasik, Robust PI - The Simulation Robust Library Component for Pioneer 3DX, Multiagent System Technologies MATES, Koblenz, Landau, Germany 2013
  39. K. Kułakowski, CCLSim, the simulation environment for concurrent systems, DepCoS-RELCOMEX, Poland 2012 (cert. of participation)
  40. K. Kułakowski and T. Szmuc, Modeling Robot Behavior with CCL, Simulation, Modeling, and Programming for Autonomous Robots, SIMPAR 2012, Tsukuba, Japan
  41. K. Kułakowski and T. Stępień, Dynamic World Model with the Lazy Potential Function, 5th KES International Conference, KES-AMSTA 2011, Manchester, UK, June 29 – July 1, 2011
  42. K. Kułakowski and J. Wąs, Two Concurrent Algorithms of Discrete Potential Field Construction, Parallel Processing and Applied Mathematics, (PPAM) Wroclaw, Poland, 2009, (cert. of attendance)
  43. K. Kułakowski, cljRobust - Clojure Programming API for Lego Mindstorms NXT, 4th KES International Symposium, KES-AMSTA 2010, Gdynia, Poland
  44. J. Rzucidło and K. Kułakowski, Explorer – the robust search robot, Information Systems Architecture and Technology, Szklarska Poręba, Poland, 2010
  45. K. Kułakowski and P. Matyasik, RobustHX - The Robust Middleware Library for Hexor Robots, Simulation, Modeling, and Programming for Autonomous Robots, SIMPAR 2010
  46. K. Kułakowski, J. Wąs, and P. Topa, Simulation environment for modeling pedestrian dynamics, Intelligent Information Systems, Siedlce, Poland, 2010
  47. K. Kułakowski and J. Wąs, World model for autonomous mobile robot – formal approach, Intelligent Information Systems, Siedlce, Poland, 2010
  48. K. Kułakowski, Robust - Towards the Design of an Effective Control Library for Lego Mindstorms NXT, Conference on Software Engineering Techniques CEE-SET 2009, Kraków, Poland
  49. K. Kułakowski, Towards Java-based Intelligent Control Architecture, Intelligent Information Systems, Kraków, Poland, 2009
  50. K. Kułakowski and M. Kostrzewa, Rapid prototyping of real-time reactive systems, International Conference on Signals and Electronic Systems, ICSES 2008, Kraków, Poland
  51. K. Kułakowski and G. J. Nalepa, Using UML State Diagrams for Visual Modeling of Business Rules, International Multiconference on Computer Science and Information Technology, IMCSIT 2008, Poland
  52. K. Kułakowski, Hybrid modeling and verification of Java based software, IFIP International Federation for Information Processing Conference, Warsaw, Poland, 2007
  53. M. Kostrzewa and K. Kułakowski, A Practical Approach To The Modelling, Visualising And Executing Of Reactive Systems, MIXDES 2006, Gdynia, Poland
  54. K. Kułakowski, Modelowanie hybrydowe systemów reaktywnych z wykorzy- staniem sieci Petriego i algebry procesów CCS, SCR'06, Ustroń́, Poland 2006
  55. K. Kułakowski and M. Kostrzewa, Wspomaganie tworzenia oprogramowania systemów reaktywnych w Real Time Java, SCR'05, Ustroń́, Poland, 2006
  56. K. Kułakowski. Real-time Java – Platforma Programistyczna Dla Systemów Czasu Rzeczywistego, SCR’05, Ustroń, Poland, 2005
  57. K. Kułakowski, Weryfikacja zgodnoś́ci projektu ze specyfikacją z wykorzystaniem sieci Petriego i Algebry Procesów CCS, SCR’02, Ustroń, Poland, 2002
  58. K. Kułakowski, Problemy modelowania agentowego zorientowanych systemów zdecentralizowanych, SCR’01, Krynica, Polska, 2001

  • user/konrad/cv/others.txt