Publications

Self-Supervised Learning with an Information Maximization Criterion

Published in NeurIPS, 2022

This article proposes a self-supervised learning method that uses a second-order statistics-based mutual information measure that reflects the level of correlation among its arguments and prevents dimensional collapse by encouraging the spread of information across the whole feature space.

Recommended citation: Ozsoy, S., Hamdan, S.S., Arik, S.Ö., Yuret, D., & Erdogan, A.T. (2022). Self-Supervised Learning with an Information Maximization Criterion. ArXiv, abs/2209.07999. https://arxiv.org/abs/2209.07999

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Published in arXiv (Submitted to TMLR), 2022

The Beyond the Imitation Game Benchmark (BIG-bench) is a collaborative benchmark intended to probe large language models and extrapolate their future capabilities.

Skip Graph Middleware Implementation

Published in The 39th International Symposium on Reliable Distributed Systems (SRDS 2020), 2020

Y. Hassanzadeh-Nazarabadi, N. Nayal, S. Sameh Hamdan, A. Utkan Şahin, Ö. Özkasap, and A. Küpçü, ”Demo: Skip Graph Middleware Implementation”, in SRDS 2020.

Recommended citation: Y. Hassanzadeh-Nazarabadi, N. Nayal, S. Sameh Hamdan, A. Utkan Şahin, Ö. Özkasap, and A. Küpçü, ”Demo: Skip Graph Middleware Implementation”, in SRDS 2020. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9169463

A containerized proof-of-concept implementation of LightChain system

Published in IEEE International Conference on Blockchain and Cryptocurrency, 2020

This publication features our implementation of proof of concept of LightChain System.

Recommended citation: Y. Hassanzadeh-Nazarabadi, N. Nayal, S. Sameh Hamdan, Ö. Özkasap, and A. Küpçü, “A containerized proof-of-concept implementation of lightchain system,” in ICBC. IEEE, 2020. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9169463